2024-05-15T11:59:08.915 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-15T11:59:08.916 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --owner scheduled_leonidus@teuthology --name leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/orig.config.yaml 2024-05-15T11:59:08.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T11:59:09.046 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992 branch: wip-lusov-quiesce description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7706992' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiesce ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 9b63866860f0b71216b2c0a73aedd2e0a8a5c98b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 9b63866860f0b71216b2c0a73aedd2e0a8a5c98b selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiesce sha1: 9b63866860f0b71216b2c0a73aedd2e0a8a5c98b owner: scheduled_leonidus@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 413 sha1: 9b63866860f0b71216b2c0a73aedd2e0a8a5c98b sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiesce suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 9b63866860f0b71216b2c0a73aedd2e0a8a5c98b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBET1uHmh3L1CxDQtkWV7J4GKRHZfra2AJVv3EStswvyv4KlEyWeCPNN/jYGkyms8+xg0apcb69x8CqYYtvRBMes= smithi083.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxS/v0ZUCE+U5ZcfaMmdavL5WrSvFZLQzNkRfhFpxVTHPxEOD72uINkJ9Om6u24iH9nuMM/HBvCQLiLN1RGTkU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-15_11:41:37 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-15T11:59:09.046 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa; will attempt to use it 2024-05-15T11:59:09.047 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks 2024-05-15T11:59:09.047 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-15T11:59:09.049 INFO:teuthology.task.internal:Checking packages... 2024-05-15T11:59:09.073 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b' 2024-05-15T11:59:09.074 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-15T11:59:09.074 INFO:teuthology.packaging:ref: None 2024-05-15T11:59:09.074 INFO:teuthology.packaging:tag: None 2024-05-15T11:59:09.074 INFO:teuthology.packaging:branch: wip-lusov-quiesce 2024-05-15T11:59:09.074 INFO:teuthology.packaging:sha1: 9b63866860f0b71216b2c0a73aedd2e0a8a5c98b 2024-05-15T11:59:09.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiesce 2024-05-15T11:59:09.226 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3687.g9b638668 2024-05-15T11:59:09.228 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-15T11:59:09.236 INFO:teuthology.task.internal:no buildpackages task found 2024-05-15T11:59:09.236 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-15T11:59:09.250 INFO:teuthology.task.internal:Saving configuration 2024-05-15T11:59:09.266 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-15T11:59:09.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T11:59:09.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 11:54:00.412252', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBET1uHmh3L1CxDQtkWV7J4GKRHZfra2AJVv3EStswvyv4KlEyWeCPNN/jYGkyms8+xg0apcb69x8CqYYtvRBMes='} 2024-05-15T11:59:09.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 11:54:00.410838', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxS/v0ZUCE+U5ZcfaMmdavL5WrSvFZLQzNkRfhFpxVTHPxEOD72uINkJ9Om6u24iH9nuMM/HBvCQLiLN1RGTkU='} 2024-05-15T11:59:09.323 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-15T11:59:09.332 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-15T11:59:09.332 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-15T11:59:09.332 INFO:teuthology.run_tasks:Running task console_log... 2024-05-15T11:59:09.412 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2cc8abb0d0>, signals=[15]) 2024-05-15T11:59:09.413 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-15T11:59:09.421 INFO:teuthology.task.internal:Opening connections... 2024-05-15T11:59:09.421 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T11:59:09.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T11:59:09.500 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T11:59:09.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T11:59:09.591 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-15T11:59:09.599 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-05-15T11:59:09.616 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-05-15T11:59:09.616 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-05-15T11:59:09.672 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-05-15T11:59:09.672 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T11:59:09.673 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T11:59:09.674 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-05-15T11:59:09.695 DEBUG:teuthology.orchestra.run.smithi083:> uname -m 2024-05-15T11:59:09.712 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2024-05-15T11:59:09.713 DEBUG:teuthology.orchestra.run.smithi083:> cat /etc/os-release 2024-05-15T11:59:09.769 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="CentOS Stream" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="9" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:ID="centos" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="rhel fedora" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="9" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el9" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:LOGO="fedora-logo-icon" 2024-05-15T11:59:09.770 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-15T11:59:09.771 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://centos.org/" 2024-05-15T11:59:09.771 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-15T11:59:09.771 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-15T11:59:09.771 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-15T11:59:09.771 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2024-05-15T11:59:09.794 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-15T11:59:09.803 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-15T11:59:09.817 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-15T11:59:09.817 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-05-15T11:59:09.820 DEBUG:teuthology.orchestra.run.smithi083:> test '!' -e /home/ubuntu/cephtest 2024-05-15T11:59:09.835 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-15T11:59:09.846 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-15T11:59:09.846 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-05-15T11:59:09.878 DEBUG:teuthology.orchestra.run.smithi083:> test -z $(ls -A /var/lib/ceph) 2024-05-15T11:59:09.912 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-15T11:59:09.967 INFO:teuthology.run_tasks:Running task kernel... 2024-05-15T11:59:09.990 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-15T11:59:09.990 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-15T11:59:09.990 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T11:59:09.991 DEBUG:teuthology.orchestra.run.smithi083:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-15T11:59:10.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T11:59:10.007 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-05-15T11:59:10.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T11:59:10.008 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-05-15T11:59:10.063 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-437.el9.x86_64 2024-05-15T11:59:10.064 INFO:teuthology.task.kernel:Running kernel on smithi083: 5.14.0-437.el9.x86_64 2024-05-15T11:59:10.064 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum install -y kernel 2024-05-15T11:59:10.065 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-437.el9.x86_64 2024-05-15T11:59:10.065 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-437.el9.x86_64 2024-05-15T11:59:10.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-05-15T11:59:12.130 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.1 MB 00:00 2024-05-15T11:59:14.045 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.1 MB 00:02 2024-05-15T11:59:15.672 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 19 MB 00:02 2024-05-15T11:59:17.380 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 19 MB 00:02 2024-05-15T11:59:19.756 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-15T11:59:21.274 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 16 kB 00:00 2024-05-15T11:59:22.442 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-15T11:59:22.872 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-05-15T11:59:24.289 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 65 kB/s | 16 kB 00:00 2024-05-15T11:59:25.976 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-15T11:59:27.617 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-05-15T11:59:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-15T11:59:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-15T11:59:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-05-15T11:59:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-05-15T11:59:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-05-15T11:59:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-05-15T11:59:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-05-15T11:59:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T11:59:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 78 M 2024-05-15T11:59:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 123 M 2024-05-15T11:59:29.701 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-05-15T11:59:30.411 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 826 kB/s | 550 kB 00:00 2024-05-15T11:59:31.090 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-05-15T11:59:33.072 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-15T11:59:33.072 INFO:teuthology.orchestra.run.smithi083.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-15T11:59:33.158 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout: Package Architecture Version Repository Size 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-15T11:59:33.163 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-15T11:59:33.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T11:59:33.164 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-05-15T11:59:33.164 INFO:teuthology.orchestra.run.smithi083.stdout:================================================================================ 2024-05-15T11:59:33.164 INFO:teuthology.orchestra.run.smithi083.stdout:Install 4 Packages 2024-05-15T11:59:33.164 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T11:59:33.164 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 78 M 2024-05-15T11:59:33.165 INFO:teuthology.orchestra.run.smithi083.stdout:Installed size: 123 M 2024-05-15T11:59:33.165 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-05-15T11:59:33.542 INFO:teuthology.orchestra.run.smithi083.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 2.7 MB/s | 550 kB 00:00 2024-05-15T11:59:34.384 INFO:teuthology.orchestra.run.smithi083.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 15 MB/s | 15 MB 00:01 2024-05-15T11:59:34.926 INFO:teuthology.orchestra.run.smithi083.stdout:(3/4): kernel-modules-core-5.14.0-446.el9.x86_6 20 MB/s | 28 MB 00:01 2024-05-15T11:59:35.718 INFO:teuthology.orchestra.run.smithi083.stdout:(4/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 14 MB/s | 34 MB 00:02 2024-05-15T11:59:35.718 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-05-15T11:59:35.718 INFO:teuthology.orchestra.run.smithi083.stdout:Total 31 MB/s | 78 MB 00:02 2024-05-15T11:59:36.398 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-05-15T11:59:36.738 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-05-15T11:59:36.738 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-05-15T11:59:37.657 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-05-15T11:59:37.658 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-05-15T11:59:40.049 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-05-15T11:59:40.693 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-15T11:59:40.777 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T11:59:43.439 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T11:59:43.586 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T11:59:45.093 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 1.0 MB/s | 15 MB 00:15 2024-05-15T11:59:48.320 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T11:59:48.382 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T11:59:53.150 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T11:59:57.550 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-modules-core-5.14.0-446.el9.x86_6 1.0 MB/s | 28 MB 00:27 2024-05-15T11:59:58.225 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 1.2 MB/s | 34 MB 00:28 2024-05-15T11:59:58.226 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-05-15T11:59:58.226 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.7 MB/s | 78 MB 00:28 2024-05-15T11:59:58.910 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-05-15T11:59:59.250 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-05-15T11:59:59.250 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-05-15T12:00:00.207 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-05-15T12:00:00.207 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-05-15T12:00:02.590 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-05-15T12:00:03.208 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-15T12:00:03.294 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T12:00:05.947 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T12:00:06.083 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T12:00:10.812 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T12:00:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:15.606 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:22.370 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:22.409 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:22.762 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:22.762 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-15T12:00:22.762 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T12:00:22.762 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T12:00:23.621 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:00:23.622 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-05-15T12:00:23.962 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T12:00:24.027 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T12:00:24.027 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T12:00:24.027 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-15T12:00:24.027 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-15T12:00:24.027 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-15T12:00:24.027 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-15T12:00:24.028 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi083.front.sepia.ceph.com, path=None, version=distro) 2024-05-15T12:00:24.028 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T12:00:24.078 INFO:teuthology.orchestra.run.smithi083.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T12:00:24.078 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T12:00:24.078 DEBUG:teuthology.orchestra.run.smithi083:> sudo rpm -qi grub2-tools 2024-05-15T12:00:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:Name : grub2-tools 2024-05-15T12:00:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:Epoch : 1 2024-05-15T12:00:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:Version : 2.06 2024-05-15T12:00:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:Release : 68.el9 2024-05-15T12:00:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:Architecture: x86_64 2024-05-15T12:00:24.114 INFO:teuthology.orchestra.run.smithi083.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Group : Unspecified 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Size : 8264254 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:License : GPLv3+ 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Packager : builder@centos.org 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Vendor : CentOS 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Summary : Support tools for GRUB. 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:Description : 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:00:24.115 INFO:teuthology.orchestra.run.smithi083.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T12:00:24.116 INFO:teuthology.orchestra.run.smithi083.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T12:00:24.116 INFO:teuthology.orchestra.run.smithi083.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T12:00:24.116 INFO:teuthology.orchestra.run.smithi083.stdout:hardware devices. 2024-05-15T12:00:24.116 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:00:24.116 INFO:teuthology.orchestra.run.smithi083.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T12:00:24.117 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T12:00:24.117 INFO:teuthology.task.kernel:Updating grub on smithi083 to boot 5.14.0-446.el9.x86_64 2024-05-15T12:00:24.117 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T12:00:24.753 INFO:teuthology.orchestra.run.smithi083.stderr:Generating grub configuration file ... 2024-05-15T12:00:26.222 INFO:teuthology.orchestra.run.smithi083.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T12:00:26.255 INFO:teuthology.orchestra.run.smithi083.stderr:done 2024-05-15T12:00:26.258 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-05-15T12:00:26.273 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.BMJMzE3vdN 2024-05-15T12:00:26.273 DEBUG:teuthology.orchestra.run.smithi083:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.BMJMzE3vdN 2024-05-15T12:00:26.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.BMJMzE3vdN 2024-05-15T12:00:26.472 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.BMJMzE3vdN is 6KB 2024-05-15T12:00:26.521 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.BMJMzE3vdN 2024-05-15T12:00:26.535 DEBUG:teuthology.orchestra.run.smithi083:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T12:00:26.597 INFO:teuthology.orchestra.run.smithi083.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T12:00:26.597 INFO:teuthology.orchestra.run.smithi083.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T12:00:26.597 INFO:teuthology.orchestra.run.smithi083.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T12:00:26.597 INFO:teuthology.orchestra.run.smithi083.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-15T12:00:26.599 DEBUG:teuthology.orchestra.run.smithi083:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-15T12:00:26.751 DEBUG:teuthology.orchestra.run.smithi083:> sudo shutdown -r now 2024-05-15T12:00:45.314 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:45.357 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:45.666 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:45.666 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-15T12:00:45.666 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-15T12:00:45.667 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-15T12:00:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:00:46.468 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-05-15T12:00:46.815 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T12:00:46.893 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T12:00:46.894 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T12:00:46.894 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-15T12:00:46.894 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-15T12:00:46.894 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-15T12:00:46.894 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-15T12:00:46.894 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-05-15T12:00:46.894 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-05-15T12:00:46.945 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-15T12:00:46.945 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-15T12:00:46.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2024-05-15T12:00:46.979 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2024-05-15T12:00:46.979 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2024-05-15T12:00:46.979 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2024-05-15T12:00:46.979 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 68.el9 2024-05-15T12:00:46.979 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8264254 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2024-05-15T12:00:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:00:46.981 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2024-05-15T12:00:46.981 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-15T12:00:46.981 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-446.el9.x86_64 2024-05-15T12:00:46.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-15T12:00:47.591 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-05-15T12:00:48.969 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-15T12:00:48.997 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-05-15T12:00:48.999 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-05-15T12:00:49.015 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.yRp2MhLlRC 2024-05-15T12:00:49.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yRp2MhLlRC 2024-05-15T12:00:49.081 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.yRp2MhLlRC 2024-05-15T12:00:49.219 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.yRp2MhLlRC is 6KB 2024-05-15T12:00:49.238 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.yRp2MhLlRC 2024-05-15T12:00:49.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2024-05-15T12:00:49.322 INFO:teuthology.orchestra.run.smithi077.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-15T12:00:49.322 INFO:teuthology.orchestra.run.smithi077.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-15T12:00:49.323 INFO:teuthology.orchestra.run.smithi077.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-15T12:00:49.323 INFO:teuthology.orchestra.run.smithi077.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-15T12:00:49.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-15T12:00:49.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-05-15T12:00:56.758 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-15T12:00:56.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-05-15T12:00:56.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:01:19.506 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-15T12:01:19.507 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-05-15T12:01:19.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:01:31.423 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-05-15T12:01:40.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-05-15T12:01:40.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:01:58.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.83 2024-05-15T12:02:10.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-05-15T12:02:10.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:02:11.151 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-05-15T12:02:11.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-05-15T12:02:11.524 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-446.el9.x86_64"... 2024-05-15T12:02:11.525 DEBUG:teuthology.orchestra.run.smithi083:> uname -r 2024-05-15T12:02:11.539 INFO:teuthology.orchestra.run.smithi083.stdout:5.14.0-446.el9.x86_64 2024-05-15T12:02:11.539 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-15T12:02:11.539 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T12:02:11.539 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T12:02:12.540 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-15T12:02:12.540 DEBUG:teuthology.orchestra.run.smithi083:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-15T12:02:12.611 INFO:teuthology.orchestra.run.smithi083.stdout:ttyS1 2024-05-15T12:02:12.645 DEBUG:teuthology.parallel:result is None 2024-05-15T12:02:19.510 DEBUG:teuthology.orchestra.remote:timed out 2024-05-15T12:02:28.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-05-15T12:02:28.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:02:31.948 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-05-15T12:02:32.431 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-05-15T12:02:32.431 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-446.el9.x86_64"... 2024-05-15T12:02:32.431 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-05-15T12:02:32.446 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-446.el9.x86_64 2024-05-15T12:02:32.446 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-15T12:02:32.446 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-15T12:02:32.446 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-15T12:02:33.448 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-15T12:02:33.448 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-15T12:02:33.522 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-05-15T12:02:33.573 DEBUG:teuthology.parallel:result is None 2024-05-15T12:02:33.574 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-15T12:02:33.582 INFO:teuthology.task.internal:Creating test directory... 2024-05-15T12:02:33.582 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T12:02:33.585 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-15T12:02:33.605 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-15T12:02:33.612 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-15T12:02:33.623 INFO:teuthology.task.internal:Creating archive directory... 2024-05-15T12:02:33.623 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T12:02:33.641 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-15T12:02:33.692 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-15T12:02:33.698 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-15T12:02:33.699 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T12:02:33.708 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-15T12:02:33.747 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T12:02:33.757 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T12:02:33.759 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T12:02:33.770 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-15T12:02:33.771 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-15T12:02:33.778 INFO:teuthology.task.internal:Configuring sudo... 2024-05-15T12:02:33.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T12:02:33.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-15T12:02:33.839 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-15T12:02:33.849 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-15T12:02:33.849 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T12:02:33.867 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-15T12:02:33.895 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T12:02:33.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T12:02:34.032 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T12:02:34.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T12:02:34.113 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:02:34.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T12:02:34.179 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T12:02:34.223 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-15T12:02:34.275 DEBUG:teuthology.orchestra.run.smithi083:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T12:02:34.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-15T12:02:34.401 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:02:34.401 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-15T12:02:34.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-05-15T12:02:34.469 DEBUG:teuthology.orchestra.run.smithi083:> sudo service rsyslog restart 2024-05-15T12:02:34.506 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T12:02:34.581 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T12:02:35.067 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-15T12:02:35.076 INFO:teuthology.task.internal:Starting timer... 2024-05-15T12:02:35.076 INFO:teuthology.run_tasks:Running task pcp... 2024-05-15T12:02:35.091 INFO:teuthology.run_tasks:Running task selinux... 2024-05-15T12:02:35.099 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-15T12:02:35.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-05-15T12:02:35.181 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-05-15T12:02:35.183 DEBUG:teuthology.orchestra.run.smithi083:> sudo service auditd rotate 2024-05-15T12:02:35.243 INFO:teuthology.orchestra.run.smithi083.stdout:Rotating logs: 2024-05-15T12:02:35.245 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-15T12:02:35.245 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-05-15T12:02:35.281 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-05-15T12:02:35.281 DEBUG:teuthology.orchestra.run.smithi083:> /usr/sbin/getenforce 2024-05-15T12:02:35.310 INFO:teuthology.orchestra.run.smithi083.stdout:Permissive 2024-05-15T12:02:35.310 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi083.front.sepia.ceph.com': 'permissive'} 2024-05-15T12:02:35.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T12:02:35.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T12:02:35.346 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T12:02:35.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T12:02:35.376 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-15T12:02:35.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-05-15T12:02:35.411 DEBUG:teuthology.orchestra.run.smithi083:> sudo /usr/sbin/setenforce permissive 2024-05-15T12:02:35.442 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-15T12:02:35.452 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-15T12:02:35.457 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-15T12:02:35.586 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-15T12:02:35.606 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-15T12:02:35.608 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi083.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-15T12:06:50.194 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi083.front.sepia.ceph.com')] 2024-05-15T12:06:50.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-05-15T12:06:50.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:06:50.275 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-05-15T12:06:50.357 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-05-15T12:06:50.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-05-15T12:06:50.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi083.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-15T12:06:50.432 DEBUG:teuthology.orchestra.run.smithi083:> true 2024-05-15T12:06:50.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi083.front.sepia.ceph.com' 2024-05-15T12:06:50.514 INFO:teuthology.run_tasks:Running task clock... 2024-05-15T12:06:50.525 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-15T12:06:50.525 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T12:06:50.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T12:06:50.528 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-15T12:06:50.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T12:06:50.554 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T12:06:50.568 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T12:06:50.585 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-15T12:06:50.592 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-05-15T12:06:50.599 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-15T12:06:50.602 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-05-15T12:06:50.616 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T12:06:50.622 INFO:teuthology.orchestra.run.smithi083.stderr:sudo: ntpd: command not found 2024-05-15T12:06:50.630 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T12:06:50.633 INFO:teuthology.orchestra.run.smithi083.stdout:506 Cannot talk to daemon 2024-05-15T12:06:50.647 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-15T12:06:50.661 INFO:teuthology.orchestra.run.smithi083.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-15T12:06:50.686 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-05-15T12:06:50.690 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T12:06:50.690 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-05-15T12:06:50.690 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.690 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.690 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.690 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.724 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-05-15T12:06:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T12:06:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-05-15T12:06:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.728 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.729 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T12:06:50.729 INFO:teuthology.run_tasks:Running task install... 2024-05-15T12:06:50.737 DEBUG:teuthology.task.install:project ceph 2024-05-15T12:06:50.737 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b'}} 2024-05-15T12:06:50.737 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b'} 2024-05-15T12:06:50.737 INFO:teuthology.task.install:Using flavor: default 2024-05-15T12:06:50.743 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-15T12:06:50.743 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-15T12:06:50.743 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b', 'tag': None, 'wait_for_package': False} 2024-05-15T12:06:50.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9b63866860f0b71216b2c0a73aedd2e0a8a5c98b 2024-05-15T12:06:50.746 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b', 'tag': None, 'wait_for_package': False} 2024-05-15T12:06:50.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9b63866860f0b71216b2c0a73aedd2e0a8a5c98b 2024-05-15T12:06:50.889 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/ 2024-05-15T12:06:50.889 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3687.g9b638668 2024-05-15T12:06:50.967 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/ 2024-05-15T12:06:50.967 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3687.g9b638668 2024-05-15T12:06:51.065 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T12:06:51.066 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:06:51.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T12:06:51.073 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-15T12:06:51.073 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:06:51.073 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-15T12:06:51.092 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-15T12:06:51.092 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T12:06:51.100 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-15T12:06:51.100 DEBUG:teuthology.orchestra.run.smithi083:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-15T12:06:51.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T12:06:51.165 DEBUG:teuthology.orchestra.run.smithi083:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-15T12:06:51.232 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T12:06:51.241 DEBUG:teuthology.orchestra.run.smithi083:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-15T12:06:51.297 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-05-15T12:06:51.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-05-15T12:06:51.304 INFO:teuthology.orchestra.run.smithi083.stdout:check_obsoletes = 1 2024-05-15T12:06:51.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum clean all 2024-05-15T12:06:51.532 INFO:teuthology.orchestra.run.smithi077.stdout:57 files removed 2024-05-15T12:06:51.542 INFO:teuthology.orchestra.run.smithi083.stdout:57 files removed 2024-05-15T12:06:51.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-15T12:06:51.570 DEBUG:teuthology.orchestra.run.smithi083:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-15T12:06:52.228 INFO:teuthology.orchestra.run.smithi083.stdout:ceph packages for x86_64 216 kB/s | 84 kB 00:00 2024-05-15T12:06:52.254 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-05-15T12:06:52.637 INFO:teuthology.orchestra.run.smithi083.stdout:ceph noarch packages 33 kB/s | 12 kB 00:00 2024-05-15T12:06:52.704 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 30 kB/s | 12 kB 00:00 2024-05-15T12:06:53.021 INFO:teuthology.orchestra.run.smithi083.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-15T12:06:53.080 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-05-15T12:06:53.606 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-05-15T12:06:54.746 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.1 MB 00:01 2024-05-15T12:06:55.573 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-05-15T12:06:56.606 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-15T12:06:59.566 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-05-15T12:07:00.799 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-05-15T12:07:01.467 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-15T12:07:02.224 INFO:teuthology.orchestra.run.smithi083.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-05-15T12:07:07.543 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 3.6 MB/s | 21 MB 00:05 2024-05-15T12:07:12.768 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 18 kB/s | 1.7 kB 00:00 2024-05-15T12:07:15.153 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T12:07:15.154 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T12:07:15.165 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-15T12:07:15.166 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-15T12:07:15.167 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-15T12:07:15.167 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T12:07:15.169 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-15T12:07:15.172 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-15T12:07:15.172 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-15T12:07:15.233 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.0.0-3687.g9b638668.el9 ceph 6.6 k 2024-05-15T12:07:15.257 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.0.0-3687.g9b638668.el9 ceph 5.4 M 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.0.0-3687.g9b638668.el9 ceph 891 k 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3687.g9b638668.el9 ceph 145 k 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.0.0-3687.g9b638668.el9 ceph 1.5 M 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 143 k 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 3.5 M 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 7.4 M 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 49 k 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.0.0-3687.g9b638668.el9 ceph 11 M 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.0.0-3687.g9b638668.el9 ceph 49 M 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 273 k 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 763 k 2024-05-15T12:07:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.0.0-3687.g9b638668.el9 ceph 225 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.0.0-3687.g9b638668.el9 ceph 27 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 18 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.0.0-3687.g9b638668.el9 ceph 32 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 748 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.0.0-3687.g9b638668.el9 ceph 127 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-15T12:07:15.259 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.0.0-3687.g9b638668.el9 ceph 161 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.0.0-3687.g9b638668.el9 ceph 321 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.0.0-3687.g9b638668.el9 ceph 299 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.0.0-3687.g9b638668.el9 ceph 100 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.0.0-3687.g9b638668.el9 ceph 85 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.0.0-3687.g9b638668.el9 ceph 3.1 M 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.0.0-3687.g9b638668.el9 ceph 170 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-15T12:07:15.260 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 3.4 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 3.1 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.0.0-3687.g9b638668.el9 ceph 21 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 34 k 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.0.0-3687.g9b638668.el9 ceph 2.4 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 274 k 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.0.0-3687.g9b638668.el9 ceph 4.7 M 2024-05-15T12:07:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.0.0-3687.g9b638668.el9 ceph 17 M 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 16 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.0.0-3687.g9b638668.el9 ceph 25 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.0.0-3687.g9b638668.el9 ceph 163 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T12:07:15.262 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 501 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 5.4 M 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T12:07:15.263 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.0.0-3687.g9b638668.el9 ceph 45 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.0.0-3687.g9b638668.el9 ceph 136 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-15T12:07:15.264 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T12:07:15.265 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T12:07:15.266 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-15T12:07:15.267 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T12:07:15.268 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 8 Packages 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 226 M 2024-05-15T12:07:15.269 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-05-15T12:07:16.095 INFO:teuthology.orchestra.run.smithi077.stdout:(1/156): ceph-19.0.0-3687.g9b638668.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-05-15T12:07:16.337 INFO:teuthology.orchestra.run.smithi077.stdout:(2/156): ceph-fuse-19.0.0-3687.g9b638668.el9.x8 3.6 MB/s | 891 kB 00:00 2024-05-15T12:07:16.395 INFO:teuthology.orchestra.run.smithi077.stdout:(3/156): ceph-immutable-object-cache-19.0.0-368 2.4 MB/s | 145 kB 00:00 2024-05-15T12:07:16.637 INFO:teuthology.orchestra.run.smithi077.stdout:(4/156): ceph-mds-19.0.0-3687.g9b638668.el9.x86 9.8 MB/s | 2.4 MB 00:00 2024-05-15T12:07:16.813 INFO:teuthology.orchestra.run.smithi077.stdout:(5/156): ceph-mgr-19.0.0-3687.g9b638668.el9.x86 8.7 MB/s | 1.5 MB 00:00 2024-05-15T12:07:16.963 INFO:teuthology.orchestra.run.smithi077.stdout:(6/156): ceph-base-19.0.0-3687.g9b638668.el9.x8 4.7 MB/s | 5.4 MB 00:01 2024-05-15T12:07:17.688 INFO:teuthology.orchestra.run.smithi077.stdout:(7/156): ceph-mon-19.0.0-3687.g9b638668.el9.x86 5.4 MB/s | 4.7 MB 00:00 2024-05-15T12:07:18.972 INFO:teuthology.orchestra.run.smithi077.stdout:(8/156): ceph-radosgw-19.0.0-3687.g9b638668.el9 8.3 MB/s | 11 MB 00:01 2024-05-15T12:07:19.172 INFO:teuthology.orchestra.run.smithi077.stdout:(9/156): ceph-selinux-19.0.0-3687.g9b638668.el9 126 kB/s | 25 kB 00:00 2024-05-15T12:07:20.056 INFO:teuthology.orchestra.run.smithi077.stdout:(10/156): ceph-common-19.0.0-3687.g9b638668.el9 5.0 MB/s | 21 MB 00:04 2024-05-15T12:07:20.881 INFO:teuthology.orchestra.run.smithi077.stdout:(11/156): cephfs-mirror-19.0.0-3687.g9b638668.e 272 kB/s | 225 kB 00:00 2024-05-15T12:07:20.964 INFO:teuthology.orchestra.run.smithi077.stdout:(12/156): cephfs-shell-19.0.0-3687.g9b638668.el 325 kB/s | 27 kB 00:00 2024-05-15T12:07:21.064 INFO:teuthology.orchestra.run.smithi077.stdout:(13/156): libcephfs-devel-19.0.0-3687.g9b638668 318 kB/s | 32 kB 00:00 2024-05-15T12:07:21.240 INFO:teuthology.orchestra.run.smithi077.stdout:(14/156): ceph-osd-19.0.0-3687.g9b638668.el9.x8 3.9 MB/s | 17 MB 00:04 2024-05-15T12:07:21.307 INFO:teuthology.orchestra.run.smithi077.stdout:(15/156): libcephfs2-19.0.0-3687.g9b638668.el9. 3.0 MB/s | 748 kB 00:00 2024-05-15T12:07:21.332 INFO:teuthology.orchestra.run.smithi077.stdout:(16/156): libcephsqlite-19.0.0-3687.g9b638668.e 1.7 MB/s | 163 kB 00:00 2024-05-15T12:07:21.393 INFO:teuthology.orchestra.run.smithi083.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-05-15T12:07:21.799 INFO:teuthology.orchestra.run.smithi077.stdout:(17/156): librados-devel-19.0.0-3687.g9b638668. 257 kB/s | 127 kB 00:00 2024-05-15T12:07:21.908 INFO:teuthology.orchestra.run.smithi077.stdout:(18/156): libradosstriper1-19.0.0-3687.g9b63866 871 kB/s | 501 kB 00:00 2024-05-15T12:07:22.191 INFO:teuthology.orchestra.run.smithi077.stdout:(19/156): python3-ceph-argparse-19.0.0-3687.g9b 159 kB/s | 45 kB 00:00 2024-05-15T12:07:22.925 INFO:teuthology.orchestra.run.smithi077.stdout:(20/156): python3-ceph-common-19.0.0-3687.g9b63 185 kB/s | 136 kB 00:00 2024-05-15T12:07:23.350 INFO:teuthology.orchestra.run.smithi077.stdout:(21/156): ceph-test-19.0.0-3687.g9b638668.el9.x 12 MB/s | 49 MB 00:04 2024-05-15T12:07:23.375 INFO:teuthology.orchestra.run.smithi077.stdout:(22/156): python3-cephfs-19.0.0-3687.g9b638668. 358 kB/s | 161 kB 00:00 2024-05-15T12:07:23.459 INFO:teuthology.orchestra.run.smithi077.stdout:(23/156): librgw2-19.0.0-3687.g9b638668.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-05-15T12:07:23.484 INFO:teuthology.orchestra.run.smithi077.stdout:(24/156): python3-rados-19.0.0-3687.g9b638668.e 2.3 MB/s | 321 kB 00:00 2024-05-15T12:07:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:(25/156): python3-rgw-19.0.0-3687.g9b638668.el9 1.4 MB/s | 100 kB 00:00 2024-05-15T12:07:23.552 INFO:teuthology.orchestra.run.smithi077.stdout:(26/156): rbd-fuse-19.0.0-3687.g9b638668.el9.x8 1.2 MB/s | 85 kB 00:00 2024-05-15T12:07:23.577 INFO:teuthology.orchestra.run.smithi077.stdout:(27/156): python3-rbd-19.0.0-3687.g9b638668.el9 1.4 MB/s | 299 kB 00:00 2024-05-15T12:07:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:(28/156): rbd-nbd-19.0.0-3687.g9b638668.el9.x86 1.0 MB/s | 170 kB 00:00 2024-05-15T12:07:23.736 INFO:teuthology.orchestra.run.smithi077.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3687.g 216 kB/s | 34 kB 00:00 2024-05-15T12:07:23.770 INFO:teuthology.orchestra.run.smithi077.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3687.g9b63866 2.8 MB/s | 143 kB 00:00 2024-05-15T12:07:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:(31/156): rbd-mirror-19.0.0-3687.g9b638668.el9. 5.1 MB/s | 3.1 MB 00:00 2024-05-15T12:07:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3687.g9b 1.1 MB/s | 274 kB 00:00 2024-05-15T12:07:24.471 INFO:teuthology.orchestra.run.smithi077.stdout:(33/156): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-05-15T12:07:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:(34/156): ceph-mgr-rook-19.0.0-3687.g9b638668.e 423 kB/s | 49 kB 00:00 2024-05-15T12:07:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3687.g9 329 kB/s | 16 kB 00:00 2024-05-15T12:07:24.588 INFO:teuthology.orchestra.run.smithi077.stdout:(36/156): ceph-mgr-dashboard-19.0.0-3687.g9b638 4.2 MB/s | 3.5 MB 00:00 2024-05-15T12:07:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:(37/156): ceph-volume-19.0.0-3687.g9b638668.el9 2.3 MB/s | 273 kB 00:00 2024-05-15T12:07:24.647 INFO:teuthology.orchestra.run.smithi077.stdout:(38/156): cephadm-19.0.0-3687.g9b638668.el9.noa 5.9 MB/s | 763 kB 00:00 2024-05-15T12:07:24.672 INFO:teuthology.orchestra.run.smithi077.stdout:(39/156): cephfs-top-19.0.0-3687.g9b638668.el9. 217 kB/s | 18 kB 00:00 2024-05-15T12:07:24.739 INFO:teuthology.orchestra.run.smithi077.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 641 kB/s | 80 kB 00:00 2024-05-15T12:07:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-05-15T12:07:24.831 INFO:teuthology.orchestra.run.smithi077.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-05-15T12:07:24.882 INFO:teuthology.orchestra.run.smithi077.stdout:(43/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-05-15T12:07:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-05-15T12:07:24.932 INFO:teuthology.orchestra.run.smithi077.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-15T12:07:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-05-15T12:07:24.991 INFO:teuthology.orchestra.run.smithi077.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-15T12:07:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-15T12:07:25.125 INFO:teuthology.orchestra.run.smithi077.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 987 kB/s | 107 kB 00:00 2024-05-15T12:07:25.159 INFO:teuthology.orchestra.run.smithi077.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-05-15T12:07:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 367 kB/s | 21 kB 00:00 2024-05-15T12:07:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-05-15T12:07:25.243 INFO:teuthology.orchestra.run.smithi077.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 557 kB/s | 33 kB 00:00 2024-05-15T12:07:25.327 INFO:teuthology.orchestra.run.smithi077.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-05-15T12:07:25.344 INFO:teuthology.orchestra.run.smithi077.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 181 kB/s | 18 kB 00:00 2024-05-15T12:07:25.361 INFO:teuthology.orchestra.run.smithi077.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 332 kB/s | 11 kB 00:00 2024-05-15T12:07:25.386 INFO:teuthology.orchestra.run.smithi077.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-05-15T12:07:25.411 INFO:teuthology.orchestra.run.smithi077.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-05-15T12:07:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-05-15T12:07:25.512 INFO:teuthology.orchestra.run.smithi077.stdout:(60/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-05-15T12:07:25.537 INFO:teuthology.orchestra.run.smithi077.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 304 kB/s | 25 kB 00:00 2024-05-15T12:07:25.562 INFO:teuthology.orchestra.run.smithi077.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-05-15T12:07:25.588 INFO:teuthology.orchestra.run.smithi077.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-15T12:07:25.621 INFO:teuthology.orchestra.run.smithi077.stdout:(64/156): libtool-2.4.6-45.el9.x86_64.rpm 2.7 MB/s | 582 kB 00:00 2024-05-15T12:07:25.647 INFO:teuthology.orchestra.run.smithi077.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 601 kB/s | 35 kB 00:00 2024-05-15T12:07:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-15T12:07:25.739 INFO:teuthology.orchestra.run.smithi077.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-05-15T12:07:25.806 INFO:teuthology.orchestra.run.smithi077.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-05-15T12:07:25.881 INFO:teuthology.orchestra.run.smithi077.stdout:(69/156): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-05-15T12:07:25.907 INFO:teuthology.orchestra.run.smithi077.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-05-15T12:07:25.957 INFO:teuthology.orchestra.run.smithi077.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 4.1 MB/s | 911 kB 00:00 2024-05-15T12:07:25.991 INFO:teuthology.orchestra.run.smithi077.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-05-15T12:07:26.016 INFO:teuthology.orchestra.run.smithi077.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-15T12:07:26.058 INFO:teuthology.orchestra.run.smithi077.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-05-15T12:07:26.158 INFO:teuthology.orchestra.run.smithi077.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-05-15T12:07:26.184 INFO:teuthology.orchestra.run.smithi077.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-05-15T12:07:26.209 INFO:teuthology.orchestra.run.smithi077.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-05-15T12:07:26.234 INFO:teuthology.orchestra.run.smithi077.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-05-15T12:07:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-05-15T12:07:26.285 INFO:teuthology.orchestra.run.smithi077.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 687 kB/s | 35 kB 00:00 2024-05-15T12:07:26.369 INFO:teuthology.orchestra.run.smithi077.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-05-15T12:07:26.394 INFO:teuthology.orchestra.run.smithi077.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-05-15T12:07:26.419 INFO:teuthology.orchestra.run.smithi077.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-05-15T12:07:26.444 INFO:teuthology.orchestra.run.smithi077.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-05-15T12:07:26.470 INFO:teuthology.orchestra.run.smithi077.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-05-15T12:07:26.495 INFO:teuthology.orchestra.run.smithi077.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-05-15T12:07:26.520 INFO:teuthology.orchestra.run.smithi077.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-05-15T12:07:26.565 INFO:teuthology.orchestra.run.smithi083.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-15T12:07:26.571 INFO:teuthology.orchestra.run.smithi077.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-05-15T12:07:26.587 INFO:teuthology.orchestra.run.smithi077.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 763 kB/s | 51 kB 00:00 2024-05-15T12:07:26.604 INFO:teuthology.orchestra.run.smithi077.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-05-15T12:07:26.680 INFO:teuthology.orchestra.run.smithi077.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-15T12:07:26.705 INFO:teuthology.orchestra.run.smithi077.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-05-15T12:07:26.730 INFO:teuthology.orchestra.run.smithi077.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-05-15T12:07:26.756 INFO:teuthology.orchestra.run.smithi077.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-15T12:07:26.781 INFO:teuthology.orchestra.run.smithi077.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-05-15T12:07:26.806 INFO:teuthology.orchestra.run.smithi077.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-05-15T12:07:26.832 INFO:teuthology.orchestra.run.smithi077.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-15T12:07:26.857 INFO:teuthology.orchestra.run.smithi077.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-15T12:07:26.883 INFO:teuthology.orchestra.run.smithi077.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-15T12:07:26.908 INFO:teuthology.orchestra.run.smithi077.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-15T12:07:26.933 INFO:teuthology.orchestra.run.smithi077.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-05-15T12:07:27.042 INFO:teuthology.orchestra.run.smithi077.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-05-15T12:07:27.209 INFO:teuthology.orchestra.run.smithi077.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-05-15T12:07:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-05-15T12:07:27.718 INFO:teuthology.orchestra.run.smithi077.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 67 kB/s | 19 kB 00:00 2024-05-15T12:07:28.060 INFO:teuthology.orchestra.run.smithi077.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 363 kB/s | 309 kB 00:00 2024-05-15T12:07:28.185 INFO:teuthology.orchestra.run.smithi077.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 208 kB/s | 26 kB 00:00 2024-05-15T12:07:28.319 INFO:teuthology.orchestra.run.smithi077.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-05-15T12:07:28.361 INFO:teuthology.orchestra.run.smithi077.stdout:(109/156): abseil-cpp-20211102.0-3.el9.x86_64.r 416 kB/s | 548 kB 00:01 2024-05-15T12:07:28.544 INFO:teuthology.orchestra.run.smithi077.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 299 kB/s | 67 kB 00:00 2024-05-15T12:07:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 503 kB/s | 151 kB 00:00 2024-05-15T12:07:28.867 INFO:teuthology.orchestra.run.smithi083.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T12:07:28.868 INFO:teuthology.orchestra.run.smithi083.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-15T12:07:28.878 INFO:teuthology.orchestra.run.smithi083.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-15T12:07:28.879 INFO:teuthology.orchestra.run.smithi083.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-15T12:07:28.880 INFO:teuthology.orchestra.run.smithi083.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-15T12:07:28.881 INFO:teuthology.orchestra.run.smithi083.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T12:07:28.882 INFO:teuthology.orchestra.run.smithi083.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-15T12:07:28.884 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-15T12:07:28.885 INFO:teuthology.orchestra.run.smithi083.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-15T12:07:28.945 INFO:teuthology.orchestra.run.smithi083.stdout:Dependencies resolved. 2024-05-15T12:07:28.963 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-05-15T12:07:28.963 INFO:teuthology.orchestra.run.smithi083.stdout: Package Arch Version Repository Size 2024-05-15T12:07:28.963 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-05-15T12:07:28.963 INFO:teuthology.orchestra.run.smithi083.stdout:Installing: 2024-05-15T12:07:28.963 INFO:teuthology.orchestra.run.smithi083.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-15T12:07:28.963 INFO:teuthology.orchestra.run.smithi083.stdout: ceph x86_64 2:19.0.0-3687.g9b638668.el9 ceph 6.6 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base x86_64 2:19.0.0-3687.g9b638668.el9 ceph 5.4 M 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse x86_64 2:19.0.0-3687.g9b638668.el9 ceph 891 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3687.g9b638668.el9 ceph 145 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr x86_64 2:19.0.0-3687.g9b638668.el9 ceph 1.5 M 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 143 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 3.5 M 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 7.4 M 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 49 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw x86_64 2:19.0.0-3687.g9b638668.el9 ceph 11 M 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test x86_64 2:19.0.0-3687.g9b638668.el9 ceph 49 M 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 273 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 763 k 2024-05-15T12:07:28.964 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror x86_64 2:19.0.0-3687.g9b638668.el9 ceph 225 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell x86_64 2:19.0.0-3687.g9b638668.el9 ceph 27 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 18 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel x86_64 2:19.0.0-3687.g9b638668.el9 ceph 32 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 748 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel x86_64 2:19.0.0-3687.g9b638668.el9 ceph 127 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-15T12:07:28.965 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs x86_64 2:19.0.0-3687.g9b638668.el9 ceph 161 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados x86_64 2:19.0.0-3687.g9b638668.el9 ceph 321 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd x86_64 2:19.0.0-3687.g9b638668.el9 ceph 299 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw x86_64 2:19.0.0-3687.g9b638668.el9 ceph 100 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse x86_64 2:19.0.0-3687.g9b638668.el9 ceph 85 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror x86_64 2:19.0.0-3687.g9b638668.el9 ceph 3.1 M 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd x86_64 2:19.0.0-3687.g9b638668.el9 ceph 170 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrading: 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-15T12:07:28.966 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: librados2 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 3.4 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 3.1 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout:Installing dependencies: 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common x86_64 2:19.0.0-3687.g9b638668.el9 ceph 21 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 34 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds x86_64 2:19.0.0-3687.g9b638668.el9 ceph 2.4 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 274 k 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon x86_64 2:19.0.0-3687.g9b638668.el9 ceph 4.7 M 2024-05-15T12:07:28.967 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd x86_64 2:19.0.0-3687.g9b638668.el9 ceph 17 M 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3687.g9b638668.el9 ceph-noarch 16 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux x86_64 2:19.0.0-3687.g9b638668.el9 ceph 25 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite x86_64 2:19.0.0-3687.g9b638668.el9 ceph 163 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-15T12:07:28.968 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 501 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2 x86_64 2:19.0.0-3687.g9b638668.el9 ceph 5.4 M 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-15T12:07:28.969 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse x86_64 2:19.0.0-3687.g9b638668.el9 ceph 45 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common x86_64 2:19.0.0-3687.g9b638668.el9 ceph 136 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-15T12:07:28.970 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-15T12:07:28.971 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-15T12:07:28.972 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-15T12:07:28.973 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-15T12:07:28.974 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout:Installing weak dependencies: 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction Summary 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout:======================================================================================= 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout:Install 148 Packages 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout:Upgrade 8 Packages 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:07:28.975 INFO:teuthology.orchestra.run.smithi083.stdout:Total download size: 226 M 2024-05-15T12:07:28.976 INFO:teuthology.orchestra.run.smithi083.stdout:Downloading Packages: 2024-05-15T12:07:29.403 INFO:teuthology.orchestra.run.smithi077.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 739 kB/s | 548 kB 00:00 2024-05-15T12:07:29.520 INFO:teuthology.orchestra.run.smithi077.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 372 kB/s | 43 kB 00:00 2024-05-15T12:07:29.608 INFO:teuthology.orchestra.run.smithi083.stdout:(1/156): ceph-19.0.0-3687.g9b638668.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-05-15T12:07:29.646 INFO:teuthology.orchestra.run.smithi077.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 258 kB/s | 32 kB 00:00 2024-05-15T12:07:29.763 INFO:teuthology.orchestra.run.smithi077.stdout:(115/156): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-05-15T12:07:29.788 INFO:teuthology.orchestra.run.smithi077.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 675 kB/s | 839 kB 00:01 2024-05-15T12:07:30.055 INFO:teuthology.orchestra.run.smithi077.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 588 kB/s | 172 kB 00:00 2024-05-15T12:07:30.297 INFO:teuthology.orchestra.run.smithi077.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 705 kB/s | 358 kB 00:00 2024-05-15T12:07:30.367 INFO:teuthology.orchestra.run.smithi083.stdout:(2/156): ceph-fuse-19.0.0-3687.g9b638668.el9.x8 1.1 MB/s | 891 kB 00:00 2024-05-15T12:07:30.501 INFO:teuthology.orchestra.run.smithi083.stdout:(3/156): ceph-immutable-object-cache-19.0.0-368 1.1 MB/s | 145 kB 00:00 2024-05-15T12:07:30.539 INFO:teuthology.orchestra.run.smithi077.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 146 kB/s | 35 kB 00:00 2024-05-15T12:07:30.573 INFO:teuthology.orchestra.run.smithi077.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 586 kB/s | 303 kB 00:00 2024-05-15T12:07:30.709 INFO:teuthology.orchestra.run.smithi083.stdout:(4/156): ceph-common-19.0.0-3687.g9b638668.el9. 16 MB/s | 21 MB 00:01 2024-05-15T12:07:30.839 INFO:teuthology.orchestra.run.smithi077.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 685 kB/s | 206 kB 00:00 2024-05-15T12:07:30.843 INFO:teuthology.orchestra.run.smithi083.stdout:(5/156): ceph-mgr-19.0.0-3687.g9b638668.el9.x86 11 MB/s | 1.5 MB 00:00 2024-05-15T12:07:31.048 INFO:teuthology.orchestra.run.smithi077.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 694 kB/s | 144 kB 00:00 2024-05-15T12:07:31.076 INFO:teuthology.orchestra.run.smithi083.stdout:(6/156): ceph-base-19.0.0-3687.g9b638668.el9.x8 3.2 MB/s | 5.4 MB 00:01 2024-05-15T12:07:31.143 INFO:teuthology.orchestra.run.smithi083.stdout:(7/156): ceph-mon-19.0.0-3687.g9b638668.el9.x86 16 MB/s | 4.7 MB 00:00 2024-05-15T12:07:31.173 INFO:teuthology.orchestra.run.smithi077.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-05-15T12:07:31.269 INFO:teuthology.orchestra.run.smithi083.stdout:(8/156): ceph-mds-19.0.0-3687.g9b638668.el9.x86 3.1 MB/s | 2.4 MB 00:00 2024-05-15T12:07:31.299 INFO:teuthology.orchestra.run.smithi077.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2024-05-15T12:07:31.352 INFO:teuthology.orchestra.run.smithi083.stdout:(9/156): ceph-selinux-19.0.0-3687.g9b638668.el9 301 kB/s | 25 kB 00:00 2024-05-15T12:07:31.424 INFO:teuthology.orchestra.run.smithi077.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 185 kB/s | 23 kB 00:00 2024-05-15T12:07:31.541 INFO:teuthology.orchestra.run.smithi077.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2024-05-15T12:07:31.658 INFO:teuthology.orchestra.run.smithi077.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-05-15T12:07:31.753 INFO:teuthology.orchestra.run.smithi083.stdout:(10/156): ceph-radosgw-19.0.0-3687.g9b638668.el 17 MB/s | 11 MB 00:00 2024-05-15T12:07:31.811 INFO:teuthology.orchestra.run.smithi083.stdout:(11/156): cephfs-mirror-19.0.0-3687.g9b638668.e 3.8 MB/s | 225 kB 00:00 2024-05-15T12:07:31.937 INFO:teuthology.orchestra.run.smithi083.stdout:(12/156): cephfs-shell-19.0.0-3687.g9b638668.el 216 kB/s | 27 kB 00:00 2024-05-15T12:07:31.995 INFO:teuthology.orchestra.run.smithi083.stdout:(13/156): libcephfs-devel-19.0.0-3687.g9b638668 546 kB/s | 32 kB 00:00 2024-05-15T12:07:32.079 INFO:teuthology.orchestra.run.smithi083.stdout:(14/156): libcephfs2-19.0.0-3687.g9b638668.el9. 8.8 MB/s | 748 kB 00:00 2024-05-15T12:07:32.121 INFO:teuthology.orchestra.run.smithi083.stdout:(15/156): libcephsqlite-19.0.0-3687.g9b638668.e 3.8 MB/s | 163 kB 00:00 2024-05-15T12:07:32.171 INFO:teuthology.orchestra.run.smithi083.stdout:(16/156): librados-devel-19.0.0-3687.g9b638668. 2.5 MB/s | 127 kB 00:00 2024-05-15T12:07:32.255 INFO:teuthology.orchestra.run.smithi083.stdout:(17/156): libradosstriper1-19.0.0-3687.g9b63866 5.9 MB/s | 501 kB 00:00 2024-05-15T12:07:32.647 INFO:teuthology.orchestra.run.smithi083.stdout:(18/156): librgw2-19.0.0-3687.g9b638668.el9.x86 14 MB/s | 5.4 MB 00:00 2024-05-15T12:07:32.697 INFO:teuthology.orchestra.run.smithi083.stdout:(19/156): python3-ceph-argparse-19.0.0-3687.g9b 909 kB/s | 45 kB 00:00 2024-05-15T12:07:32.765 INFO:teuthology.orchestra.run.smithi083.stdout:(20/156): python3-ceph-common-19.0.0-3687.g9b63 2.0 MB/s | 136 kB 00:00 2024-05-15T12:07:32.831 INFO:teuthology.orchestra.run.smithi083.stdout:(21/156): python3-cephfs-19.0.0-3687.g9b638668. 2.4 MB/s | 161 kB 00:00 2024-05-15T12:07:32.898 INFO:teuthology.orchestra.run.smithi083.stdout:(22/156): python3-rados-19.0.0-3687.g9b638668.e 4.7 MB/s | 321 kB 00:00 2024-05-15T12:07:32.965 INFO:teuthology.orchestra.run.smithi083.stdout:(23/156): python3-rbd-19.0.0-3687.g9b638668.el9 4.4 MB/s | 299 kB 00:00 2024-05-15T12:07:32.967 INFO:teuthology.orchestra.run.smithi077.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 799 kB/s | 1.0 MB 00:01 2024-05-15T12:07:33.024 INFO:teuthology.orchestra.run.smithi083.stdout:(24/156): python3-rgw-19.0.0-3687.g9b638668.el9 1.7 MB/s | 100 kB 00:00 2024-05-15T12:07:33.042 INFO:teuthology.orchestra.run.smithi077.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 845 kB/s | 2.0 MB 00:02 2024-05-15T12:07:33.084 INFO:teuthology.orchestra.run.smithi077.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-05-15T12:07:33.091 INFO:teuthology.orchestra.run.smithi083.stdout:(25/156): rbd-fuse-19.0.0-3687.g9b638668.el9.x8 1.3 MB/s | 85 kB 00:00 2024-05-15T12:07:33.159 INFO:teuthology.orchestra.run.smithi077.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 673 kB/s | 79 kB 00:00 2024-05-15T12:07:33.201 INFO:teuthology.orchestra.run.smithi077.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 492 kB/s | 58 kB 00:00 2024-05-15T12:07:33.318 INFO:teuthology.orchestra.run.smithi077.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 141 kB/s | 16 kB 00:00 2024-05-15T12:07:33.391 INFO:teuthology.orchestra.run.smithi083.stdout:(26/156): rbd-mirror-19.0.0-3687.g9b638668.el9. 10 MB/s | 3.1 MB 00:00 2024-05-15T12:07:33.402 INFO:teuthology.orchestra.run.smithi077.stdout:(134/156): libarrow-9.0.0-11.el9.x86_64.rpm 795 kB/s | 4.4 MB 00:05 2024-05-15T12:07:33.466 INFO:teuthology.orchestra.run.smithi083.stdout:(27/156): rbd-nbd-19.0.0-3687.g9b638668.el9.x86 2.2 MB/s | 170 kB 00:00 2024-05-15T12:07:33.519 INFO:teuthology.orchestra.run.smithi077.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 242 kB/s | 28 kB 00:00 2024-05-15T12:07:33.525 INFO:teuthology.orchestra.run.smithi083.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3687.g 588 kB/s | 34 kB 00:00 2024-05-15T12:07:33.544 INFO:teuthology.orchestra.run.smithi077.stdout:(136/156): python3-pecan-1.4.2-3.el9.noarch.rpm 708 kB/s | 272 kB 00:00 2024-05-15T12:07:33.569 INFO:teuthology.orchestra.run.smithi077.stdout:(137/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 359 kB/s | 90 kB 00:00 2024-05-15T12:07:33.584 INFO:teuthology.orchestra.run.smithi083.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3687.g9b63866 2.4 MB/s | 143 kB 00:00 2024-05-15T12:07:33.636 INFO:teuthology.orchestra.run.smithi077.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2024-05-15T12:07:33.687 INFO:teuthology.orchestra.run.smithi077.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 506 kB/s | 59 kB 00:00 2024-05-15T12:07:33.754 INFO:teuthology.orchestra.run.smithi077.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2024-05-15T12:07:33.804 INFO:teuthology.orchestra.run.smithi077.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 436 kB/s | 51 kB 00:00 2024-05-15T12:07:33.871 INFO:teuthology.orchestra.run.smithi077.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 626 kB/s | 188 kB 00:00 2024-05-15T12:07:33.921 INFO:teuthology.orchestra.run.smithi077.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 767 kB/s | 90 kB 00:00 2024-05-15T12:07:33.926 INFO:teuthology.orchestra.run.smithi083.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3687.g9b638 10 MB/s | 3.5 MB 00:00 2024-05-15T12:07:34.038 INFO:teuthology.orchestra.run.smithi077.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2024-05-15T12:07:34.063 INFO:teuthology.orchestra.run.smithi077.stdout:(145/156): python3-webob-1.8.7-6.el9.noarch.rpm 742 kB/s | 230 kB 00:00 2024-05-15T12:07:34.331 INFO:teuthology.orchestra.run.smithi077.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 657 kB/s | 192 kB 00:00 2024-05-15T12:07:34.381 INFO:teuthology.orchestra.run.smithi077.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 838 kB/s | 427 kB 00:00 2024-05-15T12:07:34.593 INFO:teuthology.orchestra.run.smithi083.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-05-15T12:07:34.777 INFO:teuthology.orchestra.run.smithi083.stdout:(32/156): ceph-osd-19.0.0-3687.g9b638668.el9.x8 4.5 MB/s | 17 MB 00:03 2024-05-15T12:07:34.802 INFO:teuthology.orchestra.run.smithi083.stdout:(33/156): ceph-mgr-modules-core-19.0.0-3687.g9b 1.3 MB/s | 274 kB 00:00 2024-05-15T12:07:34.844 INFO:teuthology.orchestra.run.smithi083.stdout:(34/156): ceph-mgr-rook-19.0.0-3687.g9b638668.e 737 kB/s | 49 kB 00:00 2024-05-15T12:07:34.869 INFO:teuthology.orchestra.run.smithi083.stdout:(35/156): ceph-prometheus-alerts-19.0.0-3687.g9 245 kB/s | 16 kB 00:00 2024-05-15T12:07:34.928 INFO:teuthology.orchestra.run.smithi083.stdout:(36/156): ceph-volume-19.0.0-3687.g9b638668.el9 3.2 MB/s | 273 kB 00:00 2024-05-15T12:07:34.970 INFO:teuthology.orchestra.run.smithi083.stdout:(37/156): cephadm-19.0.0-3687.g9b638668.el9.noa 7.4 MB/s | 763 kB 00:00 2024-05-15T12:07:35.028 INFO:teuthology.orchestra.run.smithi083.stdout:(38/156): cephfs-top-19.0.0-3687.g9b638668.el9. 182 kB/s | 18 kB 00:00 2024-05-15T12:07:35.064 INFO:teuthology.orchestra.run.smithi077.stdout:(148/156): librados2-19.0.0-3687.g9b638668.el9. 4.6 MB/s | 3.4 MB 00:00 2024-05-15T12:07:35.170 INFO:teuthology.orchestra.run.smithi083.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-05-15T12:07:35.331 INFO:teuthology.orchestra.run.smithi077.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 8.7 MB/s | 2.3 MB 00:00 2024-05-15T12:07:35.415 INFO:teuthology.orchestra.run.smithi077.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 22 MB/s | 1.8 MB 00:00 2024-05-15T12:07:35.457 INFO:teuthology.orchestra.run.smithi077.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-05-15T12:07:35.507 INFO:teuthology.orchestra.run.smithi077.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 4.8 MB/s | 248 kB 00:00 2024-05-15T12:07:35.582 INFO:teuthology.orchestra.run.smithi077.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-05-15T12:07:35.674 INFO:teuthology.orchestra.run.smithi077.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 26 MB/s | 2.4 MB 00:00 2024-05-15T12:07:35.679 INFO:teuthology.orchestra.run.smithi083.stdout:(40/156): ceph-test-19.0.0-3687.g9b638668.el9.x 11 MB/s | 49 MB 00:04 2024-05-15T12:07:35.704 INFO:teuthology.orchestra.run.smithi083.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 366 kB/s | 195 kB 00:00 2024-05-15T12:07:35.730 INFO:teuthology.orchestra.run.smithi083.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-05-15T12:07:35.749 INFO:teuthology.orchestra.run.smithi077.stdout:(155/156): thrift-0.15.0-2.el9.x86_64.rpm 961 kB/s | 1.6 MB 00:01 2024-05-15T12:07:35.788 INFO:teuthology.orchestra.run.smithi083.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-05-15T12:07:35.800 INFO:teuthology.orchestra.run.smithi077.stdout:(156/156): librbd1-19.0.0-3687.g9b638668.el9.x8 2.2 MB/s | 3.1 MB 00:01 2024-05-15T12:07:35.802 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-05-15T12:07:35.803 INFO:teuthology.orchestra.run.smithi077.stdout:Total 11 MB/s | 226 MB 00:20 2024-05-15T12:07:35.847 INFO:teuthology.orchestra.run.smithi083.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-05-15T12:07:35.914 INFO:teuthology.orchestra.run.smithi083.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-15T12:07:35.939 INFO:teuthology.orchestra.run.smithi083.stdout:(46/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 976 kB/s | 253 kB 00:00 2024-05-15T12:07:35.981 INFO:teuthology.orchestra.run.smithi083.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-05-15T12:07:36.031 INFO:teuthology.orchestra.run.smithi083.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 3.8 MB/s | 1.2 MB 00:00 2024-05-15T12:07:36.090 INFO:teuthology.orchestra.run.smithi083.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-15T12:07:36.115 INFO:teuthology.orchestra.run.smithi083.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-05-15T12:07:36.149 INFO:teuthology.orchestra.run.smithi083.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 5.5 MB/s | 943 kB 00:00 2024-05-15T12:07:36.174 INFO:teuthology.orchestra.run.smithi083.stdout:(52/156): elfutils-libelf-devel-0.190-2.el9.x86 257 kB/s | 21 kB 00:00 2024-05-15T12:07:36.208 INFO:teuthology.orchestra.run.smithi083.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 559 kB/s | 33 kB 00:00 2024-05-15T12:07:36.233 INFO:teuthology.orchestra.run.smithi083.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-15T12:07:36.267 INFO:teuthology.orchestra.run.smithi083.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 310 kB/s | 18 kB 00:00 2024-05-15T12:07:36.309 INFO:teuthology.orchestra.run.smithi083.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 148 kB/s | 11 kB 00:00 2024-05-15T12:07:36.334 INFO:teuthology.orchestra.run.smithi083.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-05-15T12:07:36.368 INFO:teuthology.orchestra.run.smithi083.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-05-15T12:07:36.468 INFO:teuthology.orchestra.run.smithi083.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-05-15T12:07:36.502 INFO:teuthology.orchestra.run.smithi083.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 582 kB 00:00 2024-05-15T12:07:36.519 INFO:teuthology.orchestra.run.smithi083.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 505 kB/s | 25 kB 00:00 2024-05-15T12:07:36.553 INFO:teuthology.orchestra.run.smithi083.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 940 kB/s | 47 kB 00:00 2024-05-15T12:07:36.586 INFO:teuthology.orchestra.run.smithi083.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-05-15T12:07:36.611 INFO:teuthology.orchestra.run.smithi083.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-05-15T12:07:36.645 INFO:teuthology.orchestra.run.smithi083.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-05-15T12:07:36.729 INFO:teuthology.orchestra.run.smithi083.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.4 MB/s | 3.0 MB 00:00 2024-05-15T12:07:36.955 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-05-15T12:07:36.971 INFO:teuthology.orchestra.run.smithi083.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 6.6 MB/s | 1.6 MB 00:00 2024-05-15T12:07:37.105 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-05-15T12:07:37.106 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-05-15T12:07:37.112 INFO:teuthology.orchestra.run.smithi083.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 6.3 MB/s | 911 kB 00:00 2024-05-15T12:07:37.180 INFO:teuthology.orchestra.run.smithi083.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-05-15T12:07:37.205 INFO:teuthology.orchestra.run.smithi083.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-15T12:07:37.272 INFO:teuthology.orchestra.run.smithi083.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 7.2 MB/s | 4.7 MB 00:00 2024-05-15T12:07:37.339 INFO:teuthology.orchestra.run.smithi083.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-15T12:07:37.372 INFO:teuthology.orchestra.run.smithi083.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-05-15T12:07:37.439 INFO:teuthology.orchestra.run.smithi083.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-05-15T12:07:37.506 INFO:teuthology.orchestra.run.smithi083.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-05-15T12:07:37.556 INFO:teuthology.orchestra.run.smithi083.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-05-15T12:07:37.640 INFO:teuthology.orchestra.run.smithi083.stdout:(77/156): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-05-15T12:07:37.657 INFO:teuthology.orchestra.run.smithi083.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 191 kB/s | 19 kB 00:00 2024-05-15T12:07:37.699 INFO:teuthology.orchestra.run.smithi083.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-05-15T12:07:37.716 INFO:teuthology.orchestra.run.smithi083.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 595 kB/s | 35 kB 00:00 2024-05-15T12:07:37.825 INFO:teuthology.orchestra.run.smithi083.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-05-15T12:07:37.850 INFO:teuthology.orchestra.run.smithi083.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.8 MB/s | 250 kB 00:00 2024-05-15T12:07:37.892 INFO:teuthology.orchestra.run.smithi083.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-05-15T12:07:37.917 INFO:teuthology.orchestra.run.smithi083.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-15T12:07:37.951 INFO:teuthology.orchestra.run.smithi083.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-05-15T12:07:37.984 INFO:teuthology.orchestra.run.smithi083.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-05-15T12:07:38.010 INFO:teuthology.orchestra.run.smithi083.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-05-15T12:07:38.085 INFO:teuthology.orchestra.run.smithi083.stdout:(88/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-05-15T12:07:38.119 INFO:teuthology.orchestra.run.smithi083.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-05-15T12:07:38.145 INFO:teuthology.orchestra.run.smithi083.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-05-15T12:07:38.170 INFO:teuthology.orchestra.run.smithi083.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.5 MB/s | 279 kB 00:00 2024-05-15T12:07:38.228 INFO:teuthology.orchestra.run.smithi083.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 498 kB/s | 42 kB 00:00 2024-05-15T12:07:38.262 INFO:teuthology.orchestra.run.smithi083.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-05-15T12:07:38.287 INFO:teuthology.orchestra.run.smithi083.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-15T12:07:38.321 INFO:teuthology.orchestra.run.smithi083.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-05-15T12:07:38.346 INFO:teuthology.orchestra.run.smithi083.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-05-15T12:07:38.388 INFO:teuthology.orchestra.run.smithi083.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 305 kB 00:00 2024-05-15T12:07:38.414 INFO:teuthology.orchestra.run.smithi083.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 863 kB/s | 58 kB 00:00 2024-05-15T12:07:38.472 INFO:teuthology.orchestra.run.smithi083.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-15T12:07:38.498 INFO:teuthology.orchestra.run.smithi083.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 860 kB/s | 94 kB 00:00 2024-05-15T12:07:38.531 INFO:teuthology.orchestra.run.smithi083.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-05-15T12:07:38.590 INFO:teuthology.orchestra.run.smithi083.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-05-15T12:07:38.765 INFO:teuthology.orchestra.run.smithi083.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-05-15T12:07:39.007 INFO:teuthology.orchestra.run.smithi083.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-05-15T12:07:39.107 INFO:teuthology.orchestra.run.smithi083.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-05-15T12:07:39.199 INFO:teuthology.orchestra.run.smithi083.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 102 kB/s | 19 kB 00:00 2024-05-15T12:07:39.233 INFO:teuthology.orchestra.run.smithi083.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 661 kB/s | 309 kB 00:00 2024-05-15T12:07:39.258 INFO:teuthology.orchestra.run.smithi083.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 444 kB/s | 26 kB 00:00 2024-05-15T12:07:39.288 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-05-15T12:07:39.288 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-05-15T12:07:39.308 INFO:teuthology.orchestra.run.smithi083.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-05-15T12:07:39.350 INFO:teuthology.orchestra.run.smithi083.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 731 kB/s | 67 kB 00:00 2024-05-15T12:07:39.375 INFO:teuthology.orchestra.run.smithi083.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-15T12:07:39.509 INFO:teuthology.orchestra.run.smithi083.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-05-15T12:07:39.551 INFO:teuthology.orchestra.run.smithi083.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-05-15T12:07:39.577 INFO:teuthology.orchestra.run.smithi083.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 648 kB/s | 43 kB 00:00 2024-05-15T12:07:39.610 INFO:teuthology.orchestra.run.smithi083.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-05-15T12:07:39.636 INFO:teuthology.orchestra.run.smithi083.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 255 kB/s | 15 kB 00:00 2024-05-15T12:07:39.711 INFO:teuthology.orchestra.run.smithi083.stdout:(117/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.3 MB/s | 4.4 MB 00:00 2024-05-15T12:07:39.736 INFO:teuthology.orchestra.run.smithi083.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-05-15T12:07:39.770 INFO:teuthology.orchestra.run.smithi083.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-05-15T12:07:39.795 INFO:teuthology.orchestra.run.smithi083.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-05-15T12:07:39.812 INFO:teuthology.orchestra.run.smithi083.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 467 kB/s | 35 kB 00:00 2024-05-15T12:07:39.838 INFO:teuthology.orchestra.run.smithi083.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-05-15T12:07:39.871 INFO:teuthology.orchestra.run.smithi083.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-05-15T12:07:39.896 INFO:teuthology.orchestra.run.smithi083.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-05-15T12:07:39.930 INFO:teuthology.orchestra.run.smithi083.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2024-05-15T12:07:39.955 INFO:teuthology.orchestra.run.smithi083.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-05-15T12:07:39.989 INFO:teuthology.orchestra.run.smithi083.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-05-15T12:07:40.014 INFO:teuthology.orchestra.run.smithi083.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 334 kB/s | 20 kB 00:00 2024-05-15T12:07:40.065 INFO:teuthology.orchestra.run.smithi083.stdout:(129/156): python3-grpcio-1.46.7-10.el9.x86_64. 7.6 MB/s | 2.0 MB 00:00 2024-05-15T12:07:40.090 INFO:teuthology.orchestra.run.smithi083.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 614 kB/s | 46 kB 00:00 2024-05-15T12:07:40.124 INFO:teuthology.orchestra.run.smithi083.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-05-15T12:07:40.149 INFO:teuthology.orchestra.run.smithi083.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 983 kB/s | 58 kB 00:00 2024-05-15T12:07:40.183 INFO:teuthology.orchestra.run.smithi083.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-05-15T12:07:40.216 INFO:teuthology.orchestra.run.smithi083.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-05-15T12:07:40.241 INFO:teuthology.orchestra.run.smithi083.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-05-15T12:07:40.267 INFO:teuthology.orchestra.run.smithi083.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-05-15T12:07:40.317 INFO:teuthology.orchestra.run.smithi083.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-05-15T12:07:40.342 INFO:teuthology.orchestra.run.smithi083.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 307 kB/s | 31 kB 00:00 2024-05-15T12:07:40.368 INFO:teuthology.orchestra.run.smithi083.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-15T12:07:40.401 INFO:teuthology.orchestra.run.smithi083.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-15T12:07:40.426 INFO:teuthology.orchestra.run.smithi083.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 428 kB/s | 36 kB 00:00 2024-05-15T12:07:40.452 INFO:teuthology.orchestra.run.smithi083.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 608 kB/s | 51 kB 00:00 2024-05-15T12:07:40.477 INFO:teuthology.orchestra.run.smithi083.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-05-15T12:07:40.511 INFO:teuthology.orchestra.run.smithi083.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-05-15T12:07:40.536 INFO:teuthology.orchestra.run.smithi083.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 340 kB/s | 20 kB 00:00 2024-05-15T12:07:40.562 INFO:teuthology.orchestra.run.smithi083.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-05-15T12:07:40.587 INFO:teuthology.orchestra.run.smithi083.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-15T12:07:40.804 INFO:teuthology.orchestra.run.smithi083.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-05-15T12:07:41.021 INFO:teuthology.orchestra.run.smithi083.stdout:(149/156): librados2-19.0.0-3687.g9b638668.el9. 7.4 MB/s | 3.4 MB 00:00 2024-05-15T12:07:41.338 INFO:teuthology.orchestra.run.smithi083.stdout:(150/156): NetworkManager-1.47.90-1.el9.x86_64. 4.3 MB/s | 2.3 MB 00:00 2024-05-15T12:07:41.388 INFO:teuthology.orchestra.run.smithi083.stdout:(151/156): librbd1-19.0.0-3687.g9b638668.el9.x8 3.9 MB/s | 3.1 MB 00:00 2024-05-15T12:07:41.413 INFO:teuthology.orchestra.run.smithi083.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 553 kB/s | 41 kB 00:00 2024-05-15T12:07:41.588 INFO:teuthology.orchestra.run.smithi083.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-05-15T12:07:41.630 INFO:teuthology.orchestra.run.smithi083.stdout:(154/156): NetworkManager-libnm-1.47.90-1.el9.x 3.0 MB/s | 1.8 MB 00:00 2024-05-15T12:07:41.664 INFO:teuthology.orchestra.run.smithi083.stdout:(155/156): NetworkManager-tui-1.47.90-1.el9.x86 898 kB/s | 248 kB 00:00 2024-05-15T12:07:41.847 INFO:teuthology.orchestra.run.smithi083.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-05-15T12:07:41.854 INFO:teuthology.orchestra.run.smithi083.stdout:-------------------------------------------------------------------------------- 2024-05-15T12:07:41.854 INFO:teuthology.orchestra.run.smithi083.stdout:Total 18 MB/s | 226 MB 00:12 2024-05-15T12:07:43.071 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction check 2024-05-15T12:07:43.219 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction check succeeded. 2024-05-15T12:07:43.219 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction test 2024-05-15T12:07:45.368 INFO:teuthology.orchestra.run.smithi083.stdout:Transaction test succeeded. 2024-05-15T12:07:45.369 INFO:teuthology.orchestra.run.smithi083.stdout:Running transaction 2024-05-15T12:07:45.630 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-05-15T12:07:45.721 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-15T12:07:45.763 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-15T12:07:45.832 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-15T12:07:45.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-15T12:07:45.889 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-15T12:07:45.948 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-15T12:07:46.286 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-15T12:07:46.390 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.0.0-3687.g9b638668.el9.x86_64 8/164 2024-05-15T12:07:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.0.0-3687.g9b638668.el9.x86_64 8/164 2024-05-15T12:07:46.550 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 9/164 2024-05-15T12:07:46.644 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 9/164 2024-05-15T12:07:46.671 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.0.0-3687.g9b638668.el9.x86_64 10/164 2024-05-15T12:07:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-15T12:07:46.902 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-15T12:07:46.921 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 13/164 2024-05-15T12:07:47.025 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 13/164 2024-05-15T12:07:47.047 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86 14/164 2024-05-15T12:07:47.093 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86 14/164 2024-05-15T12:07:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-15T12:07:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-15T12:07:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-15T12:07:47.497 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-15T12:07:47.629 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-15T12:07:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-15T12:07:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-15T12:07:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-15T12:07:48.083 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-15T12:07:48.194 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-15T12:07:48.230 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-15T12:07:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-15T12:07:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-15T12:07:48.372 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-15T12:07:48.416 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-15T12:07:48.448 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-15T12:07:48.476 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-15T12:07:48.553 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-15T12:07:48.615 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-15T12:07:48.646 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-15T12:07:48.689 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-15T12:07:48.766 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-15T12:07:48.800 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.0.0-3687.g9b638668.el9. 32/164 2024-05-15T12:07:48.853 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.0.0-3687.g9b638668.el 33/164 2024-05-15T12:07:48.881 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.0.0-3687.g9b638668.el9.x86_6 34/164 2024-05-15T12:07:48.949 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-15T12:07:49.003 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-15T12:07:49.077 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-15T12:07:49.210 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-15T12:07:49.264 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-15T12:07:49.778 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-15T12:07:49.870 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-15T12:07:49.898 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-15T12:07:49.941 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-15T12:07:50.007 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.0.0-3687.g9b638668.el9.x86_6 44/164 2024-05-15T12:07:50.055 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-15T12:07:50.221 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-15T12:07:50.282 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-15T12:07:50.373 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-15T12:07:50.438 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-15T12:07:50.510 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-15T12:07:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-15T12:07:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-15T12:07:50.624 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-15T12:07:50.669 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-15T12:07:50.712 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-15T12:07:50.754 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-15T12:07:50.888 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-15T12:07:50.935 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-15T12:07:50.965 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-15T12:07:51.007 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-15T12:07:51.100 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-15T12:07:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-15T12:07:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-15T12:07:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-15T12:07:51.239 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-15T12:07:51.325 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-15T12:07:51.449 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-15T12:07:51.480 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-15T12:07:51.483 INFO:teuthology.orchestra.run.smithi083.stdout: Preparing : 1/1 2024-05-15T12:07:51.509 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-15T12:07:51.543 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-15T12:07:51.561 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-15T12:07:51.581 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-15T12:07:51.599 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-15T12:07:51.613 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-15T12:07:51.643 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-15T12:07:51.662 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-15T12:07:51.678 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-15T12:07:51.703 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-15T12:07:51.711 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-15T12:07:51.728 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-15T12:07:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-15T12:07:51.786 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-15T12:07:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-15T12:07:51.874 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-15T12:07:51.918 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-15T12:07:51.957 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-15T12:07:52.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-15T12:07:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-15T12:07:52.150 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-15T12:07:52.161 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-15T12:07:52.213 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librados2-2:19.0.0-3687.g9b638668.el9.x86_64 8/164 2024-05-15T12:07:52.318 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:19.0.0-3687.g9b638668.el9.x86_64 8/164 2024-05-15T12:07:52.364 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 9/164 2024-05-15T12:07:52.463 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 9/164 2024-05-15T12:07:52.494 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rados-2:19.0.0-3687.g9b638668.el9.x86_64 10/164 2024-05-15T12:07:52.665 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-15T12:07:52.720 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-15T12:07:52.744 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 13/164 2024-05-15T12:07:52.848 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 13/164 2024-05-15T12:07:52.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-15T12:07:52.870 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86 14/164 2024-05-15T12:07:52.922 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-15T12:07:52.933 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86 14/164 2024-05-15T12:07:52.954 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-15T12:07:52.956 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-15T12:07:52.976 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-15T12:07:53.055 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-15T12:07:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-15T12:07:53.173 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-15T12:07:53.193 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-15T12:07:53.242 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-15T12:07:53.336 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-15T12:07:53.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-15T12:07:53.448 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-15T12:07:53.469 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-15T12:07:53.528 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-15T12:07:53.529 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-15T12:07:53.641 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-15T12:07:53.730 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-15T12:07:53.940 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-15T12:07:54.044 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-15T12:07:54.077 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-15T12:07:54.111 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-15T12:07:54.176 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-15T12:07:54.184 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-15T12:07:54.220 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-15T12:07:54.263 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-15T12:07:54.287 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-15T12:07:54.295 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-15T12:07:54.323 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-15T12:07:54.392 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-15T12:07:54.446 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-15T12:07:54.485 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-15T12:07:54.528 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-15T12:07:54.605 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-15T12:07:54.640 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-common-2:19.0.0-3687.g9b638668.el9. 32/164 2024-05-15T12:07:54.683 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ceph-argparse-2:19.0.0-3687.g9b638668.el 33/164 2024-05-15T12:07:54.712 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cephfs-2:19.0.0-3687.g9b638668.el9.x86_6 34/164 2024-05-15T12:07:54.781 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-15T12:07:54.827 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-15T12:07:54.901 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-15T12:07:55.042 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-15T12:07:55.095 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-15T12:07:55.538 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-15T12:07:55.617 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-15T12:07:55.638 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-15T12:07:55.665 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-15T12:07:55.698 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-15T12:07:55.712 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-15T12:07:55.729 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-15T12:07:55.772 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-15T12:07:55.810 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librados-devel-2:19.0.0-3687.g9b638668.el9.x86_6 44/164 2024-05-15T12:07:55.852 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-15T12:07:56.001 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-15T12:07:56.012 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-15T12:07:56.053 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 101/164 2024-05-15T12:07:56.055 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-15T12:07:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 101/164 2024-05-15T12:07:56.146 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-15T12:07:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.0.0-3687.g9b638668.el9.x86_64 102/164 2024-05-15T12:07:56.211 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-15T12:07:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-15T12:07:56.300 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-15T12:07:56.332 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-15T12:07:56.368 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-15T12:07:56.415 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-15T12:07:56.451 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-15T12:07:56.494 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-15T12:07:56.536 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-15T12:07:56.673 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-15T12:07:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-15T12:07:56.723 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 105/164 2024-05-15T12:07:56.734 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-15T12:07:56.764 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-15T12:07:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 105/164 2024-05-15T12:07:56.805 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-15T12:07:56.816 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.0.0-3687.g9b638668.el9.x86_64 106/164 2024-05-15T12:07:56.900 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-15T12:07:57.072 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-15T12:07:57.223 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-15T12:07:57.255 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-15T12:07:57.280 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-15T12:07:57.366 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-15T12:07:57.490 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-15T12:07:57.529 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-15T12:07:57.557 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-15T12:07:57.603 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-15T12:07:57.647 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-15T12:07:57.687 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-15T12:07:57.717 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-15T12:07:57.751 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-15T12:07:57.784 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-15T12:07:57.826 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-15T12:07:57.861 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-15T12:07:57.947 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-15T12:07:57.992 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-15T12:07:58.022 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-15T12:07:58.069 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-15T12:07:58.168 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-15T12:07:58.216 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-15T12:07:58.944 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-15T12:07:58.998 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-15T12:07:59.032 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-15T12:07:59.130 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-15T12:07:59.135 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 107/164 2024-05-15T12:07:59.171 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 107/164 2024-05-15T12:07:59.189 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-15T12:07:59.277 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-15T12:07:59.309 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-15T12:07:59.488 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-15T12:07:59.515 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-15T12:07:59.595 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-15T12:07:59.730 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 107/164 2024-05-15T12:07:59.774 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 108/164 2024-05-15T12:07:59.864 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 108/164 2024-05-15T12:07:59.864 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T12:07:59.865 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T12:07:59.865 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:07:59.900 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 109/164 2024-05-15T12:08:00.260 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-15T12:08:00.371 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-15T12:08:01.640 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-15T12:08:01.720 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-15T12:08:01.747 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-15T12:08:01.780 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-15T12:08:02.096 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-15T12:08:02.144 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 101/164 2024-05-15T12:08:02.233 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 101/164 2024-05-15T12:08:02.265 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rbd-2:19.0.0-3687.g9b638668.el9.x86_64 102/164 2024-05-15T12:08:02.301 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-15T12:08:02.789 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-15T12:08:03.047 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 105/164 2024-05-15T12:08:03.117 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 105/164 2024-05-15T12:08:03.140 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-rgw-2:19.0.0-3687.g9b638668.el9.x86_64 106/164 2024-05-15T12:08:05.408 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 107/164 2024-05-15T12:08:05.445 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 107/164 2024-05-15T12:08:05.999 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 107/164 2024-05-15T12:08:06.032 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 108/164 2024-05-15T12:08:06.118 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 108/164 2024-05-15T12:08:06.118 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-15T12:08:06.118 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-15T12:08:06.118 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:06.149 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 109/164 2024-05-15T12:08:11.158 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 109/164 2024-05-15T12:08:11.158 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-05-15T12:08:11.158 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-05-15T12:08:11.159 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-05-15T12:08:11.159 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-05-15T12:08:11.159 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-05-15T12:08:11.159 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-05-15T12:08:11.159 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-05-15T12:08:11.159 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:11.330 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 110/164 2024-05-15T12:08:11.348 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 110/164 2024-05-15T12:08:11.348 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:11.348 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T12:08:11.348 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:12.841 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 111/164 2024-05-15T12:08:12.868 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 111/164 2024-05-15T12:08:12.868 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:12.868 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T12:08:12.868 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T12:08:12.868 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T12:08:12.868 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:13.092 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 112/164 2024-05-15T12:08:13.114 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 112/164 2024-05-15T12:08:13.114 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:13.115 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T12:08:13.115 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T12:08:13.115 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T12:08:13.115 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 113/164 2024-05-15T12:08:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 113/164 2024-05-15T12:08:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T12:08:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T12:08:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T12:08:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-15T12:08:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-15T12:08:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-15T12:08:13.986 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-15T12:08:14.034 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-15T12:08:14.111 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-15T12:08:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-15T12:08:14.337 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-15T12:08:14.393 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-15T12:08:14.425 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-15T12:08:14.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-15T12:08:14.880 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-3687.g9b638668.el9.noarch 125/164 2024-05-15T12:08:14.909 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.0.0-3687.g9b638668.el9.noarch 125/164 2024-05-15T12:08:14.941 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3687.g9b638668.e 126/164 2024-05-15T12:08:15.003 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3687.g9b638668. 127/164 2024-05-15T12:08:15.032 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noa 128/164 2024-05-15T12:08:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noa 128/164 2024-05-15T12:08:16.109 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.n 129/164 2024-05-15T12:08:17.078 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.n 129/164 2024-05-15T12:08:17.109 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b6 130/164 2024-05-15T12:08:17.218 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b6 130/164 2024-05-15T12:08:17.386 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3687.g9b638668.el 131/164 2024-05-15T12:08:17.459 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 132/164 2024-05-15T12:08:17.482 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 132/164 2024-05-15T12:08:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T12:08:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T12:08:17.485 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T12:08:17.486 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:17.529 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 133/164 2024-05-15T12:08:17.540 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 133/164 2024-05-15T12:08:17.654 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.0.0-3687.g9b638668.el9.x86_64 134/164 2024-05-15T12:08:17.705 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 135/164 2024-05-15T12:08:17.768 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 109/164 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /sys 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /proc 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /mnt 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /var/tmp 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /home 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /root 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout:skipping the directory /tmp 2024-05-15T12:08:17.769 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:17.943 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 110/164 2024-05-15T12:08:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 110/164 2024-05-15T12:08:17.962 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:17.962 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-15T12:08:17.962 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:18.640 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-15T12:08:18.673 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 137/164 2024-05-15T12:08:18.695 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 137/164 2024-05-15T12:08:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T12:08:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T12:08:18.696 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T12:08:18.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:18.740 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3687.g9b638 138/164 2024-05-15T12:08:18.762 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3687.g9b638 138/164 2024-05-15T12:08:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:18.763 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T12:08:18.763 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 139/164 2024-05-15T12:08:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 139/164 2024-05-15T12:08:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-15T12:08:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T12:08:18.830 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T12:08:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:19.141 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 140/164 2024-05-15T12:08:19.164 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 140/164 2024-05-15T12:08:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T12:08:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T12:08:19.164 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T12:08:19.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:19.460 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 111/164 2024-05-15T12:08:19.486 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 111/164 2024-05-15T12:08:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-15T12:08:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T12:08:19.486 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-15T12:08:19.487 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:19.710 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 112/164 2024-05-15T12:08:19.733 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 112/164 2024-05-15T12:08:19.734 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:19.734 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-15T12:08:19.734 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T12:08:19.734 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-15T12:08:19.734 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:20.177 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 113/164 2024-05-15T12:08:20.201 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 113/164 2024-05-15T12:08:20.202 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:20.202 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-15T12:08:20.202 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T12:08:20.202 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-15T12:08:20.202 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:20.307 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-15T12:08:20.402 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-15T12:08:20.469 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-15T12:08:20.655 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-15T12:08:20.712 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-15T12:08:20.797 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-15T12:08:20.886 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-15T12:08:21.024 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-15T12:08:21.070 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-15T12:08:21.102 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-15T12:08:21.130 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-15T12:08:21.542 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephadm-2:19.0.0-3687.g9b638668.el9.noarch 125/164 2024-05-15T12:08:21.570 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephadm-2:19.0.0-3687.g9b638668.el9.noarch 125/164 2024-05-15T12:08:21.602 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3687.g9b638668.e 126/164 2024-05-15T12:08:21.663 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3687.g9b638668. 127/164 2024-05-15T12:08:21.693 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noa 128/164 2024-05-15T12:08:22.724 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noa 128/164 2024-05-15T12:08:22.761 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.n 129/164 2024-05-15T12:08:23.721 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.n 129/164 2024-05-15T12:08:23.770 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b6 130/164 2024-05-15T12:08:23.803 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.0.0-3687.g9b638668.el9.x86_64 141/164 2024-05-15T12:08:23.853 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 142/164 2024-05-15T12:08:23.880 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b6 130/164 2024-05-15T12:08:23.893 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.0.0-3687.g9b638668.el9.x86_64 143/164 2024-05-15T12:08:23.925 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-15T12:08:23.953 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-15T12:08:24.041 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3687.g9b638668.el 131/164 2024-05-15T12:08:24.081 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 132/164 2024-05-15T12:08:24.105 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 132/164 2024-05-15T12:08:24.106 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:24.106 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-15T12:08:24.106 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T12:08:24.106 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-15T12:08:24.106 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:24.136 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.0.0-3687.g9b638668.el9.x86_64 146/164 2024-05-15T12:08:24.157 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 133/164 2024-05-15T12:08:24.169 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 133/164 2024-05-15T12:08:24.182 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-15T12:08:24.212 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.0.0-3687.g9b638668.el9.x86_ 148/164 2024-05-15T12:08:24.242 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-15T12:08:24.266 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-2:19.0.0-3687.g9b638668.el9.x86_64 134/164 2024-05-15T12:08:24.280 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-15T12:08:24.316 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 135/164 2024-05-15T12:08:24.882 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-15T12:08:24.920 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-15T12:08:24.940 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-15T12:08:25.245 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-15T12:08:25.292 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 137/164 2024-05-15T12:08:25.316 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 137/164 2024-05-15T12:08:25.316 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:25.316 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-15T12:08:25.316 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T12:08:25.316 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-15T12:08:25.317 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:25.360 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3687.g9b638 138/164 2024-05-15T12:08:25.383 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3687.g9b638 138/164 2024-05-15T12:08:25.383 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:25.383 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-15T12:08:25.383 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:25.443 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 139/164 2024-05-15T12:08:25.469 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 139/164 2024-05-15T12:08:25.470 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:25.470 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-15T12:08:25.470 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T12:08:25.470 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-15T12:08:25.470 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:25.763 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.0.0-3687.g9b638668.el9.noarch 152/164 2024-05-15T12:08:25.769 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 140/164 2024-05-15T12:08:25.793 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 140/164 2024-05-15T12:08:25.793 INFO:teuthology.orchestra.run.smithi083.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-15T12:08:25.793 INFO:teuthology.orchestra.run.smithi083.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-15T12:08:25.793 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T12:08:25.793 INFO:teuthology.orchestra.run.smithi083.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-15T12:08:25.793 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:25.858 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-15T12:08:25.906 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-15T12:08:25.990 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-15T12:08:26.019 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-15T12:08:26.045 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-15T12:08:26.045 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-15T12:08:26.129 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-15T12:08:26.154 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-15T12:08:26.154 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-15T12:08:26.238 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-15T12:08:26.263 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-15T12:08:26.268 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-15T12:08:26.268 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-15T12:08:26.448 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-15T12:08:26.449 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-15T12:08:26.526 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-15T12:08:26.597 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-15T12:08:30.415 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : ceph-test-2:19.0.0-3687.g9b638668.el9.x86_64 141/164 2024-05-15T12:08:30.463 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 142/164 2024-05-15T12:08:30.514 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : rbd-nbd-2:19.0.0-3687.g9b638668.el9.x86_64 143/164 2024-05-15T12:08:30.571 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-15T12:08:30.598 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-15T12:08:30.781 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-shell-2:19.0.0-3687.g9b638668.el9.x86_64 146/164 2024-05-15T12:08:30.819 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-15T12:08:30.850 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libcephfs-devel-2:19.0.0-3687.g9b638668.el9.x86_ 148/164 2024-05-15T12:08:30.879 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-15T12:08:30.925 INFO:teuthology.orchestra.run.smithi083.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-15T12:08:31.561 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-15T12:08:31.612 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-15T12:08:31.633 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.0.0-3687.g9b638668.el9.x86_64 1/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 2/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 3/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 4/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3687.g9b638 5/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 6/164 2024-05-15T12:08:32.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 7/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 8/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 9/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 10/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 11/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.0.0-3687.g9b638668.el9.x86_64 12/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 13/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.0.0-3687.g9b638668.el9.x86_64 14/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.0.0-3687.g9b638668.el9.x86_ 15/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 16/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 17/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.0.0-3687.g9b638668.el9.x86_6 18/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86 19/164 2024-05-15T12:08:32.074 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 20/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3687.g9b638668.el 21/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.0.0-3687.g9b638668.el9. 22/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.0.0-3687.g9b638668.el9.x86_6 23/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.0.0-3687.g9b638668.el9.x86_64 24/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.0.0-3687.g9b638668.el9.x86_64 25/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.0.0-3687.g9b638668.el9.x86_64 26/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 27/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 28/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.0.0-3687.g9b638668.el9.x86_64 29/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3687.g9b638668. 30/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noa 31/164 2024-05-15T12:08:32.075 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.n 32/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b6 33/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3687.g9b638668.el 34/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 35/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3687.g9b638668.e 36/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 37/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.0.0-3687.g9b638668.el9.noarch 38/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.0.0-3687.g9b638668.el9.noarch 39/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-15T12:08:32.076 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-15T12:08:32.077 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-15T12:08:32.078 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-15T12:08:32.079 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-15T12:08:32.080 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-15T12:08:32.081 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-15T12:08:32.082 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-15T12:08:32.083 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-15T12:08:32.084 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.0.0-3687.g9b638668.el9.x86_64 149/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 151/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-15T12:08:32.085 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-15T12:08:32.455 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : cephfs-top-2:19.0.0-3687.g9b638668.el9.noarch 152/164 2024-05-15T12:08:32.542 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-15T12:08:32.592 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-15T12:08:32.684 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-15T12:08:32.720 INFO:teuthology.orchestra.run.smithi083.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-15T12:08:32.746 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-15T12:08:32.746 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-15T12:08:32.822 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-15T12:08:32.856 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-15T12:08:32.856 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-15T12:08:32.948 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-15T12:08:32.973 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-15T12:08:32.979 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-15T12:08:32.979 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-15T12:08:33.167 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-15T12:08:33.167 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-15T12:08:33.251 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-15T12:08:33.325 INFO:teuthology.orchestra.run.smithi083.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-15T12:08:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-15T12:08:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:34.562 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-05-15T12:08:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-05-15T12:08:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T12:08:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T12:08:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.14-1.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T12:08:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T12:08:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T12:08:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T12:08:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T12:08:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T12:08:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-15T12:08:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:34.575 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-05-15T12:08:35.009 DEBUG:teuthology.parallel:result is None 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-2:19.0.0-3687.g9b638668.el9.x86_64 1/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 2/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 3/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 4/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3687.g9b638 5/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 6/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 7/164 2024-05-15T12:08:39.100 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 8/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 9/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 10/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 11/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-test-2:19.0.0-3687.g9b638668.el9.x86_64 12/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 13/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-shell-2:19.0.0-3687.g9b638668.el9.x86_64 14/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs-devel-2:19.0.0-3687.g9b638668.el9.x86_ 15/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 16/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 17/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados-devel-2:19.0.0-3687.g9b638668.el9.x86_6 18/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86 19/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 20/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3687.g9b638668.el 21/164 2024-05-15T12:08:39.101 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ceph-common-2:19.0.0-3687.g9b638668.el9. 22/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cephfs-2:19.0.0-3687.g9b638668.el9.x86_6 23/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rados-2:19.0.0-3687.g9b638668.el9.x86_64 24/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rbd-2:19.0.0-3687.g9b638668.el9.x86_64 25/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rgw-2:19.0.0-3687.g9b638668.el9.x86_64 26/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 27/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 28/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : rbd-nbd-2:19.0.0-3687.g9b638668.el9.x86_64 29/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3687.g9b638668. 30/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noa 31/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.n 32/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b6 33/164 2024-05-15T12:08:39.102 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3687.g9b638668.el 34/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 35/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3687.g9b638668.e 36/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 37/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephadm-2:19.0.0-3687.g9b638668.el9.noarch 38/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : cephfs-top-2:19.0.0-3687.g9b638668.el9.noarch 39/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-15T12:08:39.103 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-15T12:08:39.104 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-15T12:08:39.105 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-15T12:08:39.106 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-15T12:08:39.107 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-15T12:08:39.108 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-15T12:08:39.109 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-15T12:08:39.110 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:19.0.0-3687.g9b638668.el9.x86_64 149/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 151/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-15T12:08:39.111 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-15T12:08:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-15T12:08:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-15T12:08:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-15T12:08:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-15T12:08:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-15T12:08:39.112 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-15T12:08:41.664 INFO:teuthology.orchestra.run.smithi083.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-15T12:08:41.664 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:41.664 INFO:teuthology.orchestra.run.smithi083.stdout:Upgraded: 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: librados2-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: librbd1-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout:Installed: 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: automake-1.16.2-8.el9.noarch 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: bison-3.7.4-5.el9.x86_64 2024-05-15T12:08:41.665 INFO:teuthology.orchestra.run.smithi083.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-base-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-grafana-dashboards-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-immutable-object-cache-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mds-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-cephadm-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-dashboard-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.666 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-modules-core-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mgr-rook-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-mon-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-osd-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-prometheus-alerts-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-radosgw-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-selinux-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-test-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: ceph-volume-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: cephadm-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.667 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-shell-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: cephfs-top-2:19.0.0-3687.g9b638668.el9.noarch 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: flex-2.6.4-9.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-15T12:08:41.668 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs-devel-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libcephfs2-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libcephsqlite-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: librados-devel-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libradosstriper1-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: librgw2-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.669 INFO:teuthology.orchestra.run.smithi083.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: lua-5.4.4-4.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-15T12:08:41.670 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-13.14-1.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-argparse-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.671 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ceph-common-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cephfs-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-15T12:08:41.672 INFO:teuthology.orchestra.run.smithi083.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-15T12:08:41.673 INFO:teuthology.orchestra.run.smithi083.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-15T12:08:41.674 INFO:teuthology.orchestra.run.smithi083.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-ply-3.11-14.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-15T12:08:41.675 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rados-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rbd-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-15T12:08:41.676 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rgw-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-15T12:08:41.677 INFO:teuthology.orchestra.run.smithi083.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-fuse-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-mirror-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: rbd-nbd-2:19.0.0-3687.g9b638668.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: re2-1:20211101-3.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-15T12:08:41.678 INFO:teuthology.orchestra.run.smithi083.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-15T12:08:41.679 INFO:teuthology.orchestra.run.smithi083.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-15T12:08:41.679 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:41.679 INFO:teuthology.orchestra.run.smithi083.stdout:Complete! 2024-05-15T12:08:42.120 DEBUG:teuthology.parallel:result is None 2024-05-15T12:08:42.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9b63866860f0b71216b2c0a73aedd2e0a8a5c98b 2024-05-15T12:08:42.376 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T12:08:42.403 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-3687.g9b638668.el9 2024-05-15T12:08:42.403 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3687.g9b638668.el9 2024-05-15T12:08:42.404 INFO:teuthology.task.install:The correct ceph version 19.0.0-3687.g9b638668 is installed. 2024-05-15T12:08:42.405 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9b63866860f0b71216b2c0a73aedd2e0a8a5c98b 2024-05-15T12:08:42.544 DEBUG:teuthology.orchestra.run.smithi083:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-15T12:08:42.570 INFO:teuthology.orchestra.run.smithi083.stdout:19.0.0-3687.g9b638668.el9 2024-05-15T12:08:42.570 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3687.g9b638668.el9 2024-05-15T12:08:42.570 INFO:teuthology.task.install:The correct ceph version 19.0.0-3687.g9b638668 is installed. 2024-05-15T12:08:42.572 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-15T12:08:42.572 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:42.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T12:08:42.604 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:42.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-15T12:08:42.641 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-15T12:08:42.641 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:42.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T12:08:42.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T12:08:42.742 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:42.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/daemon-helper 2024-05-15T12:08:42.772 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-15T12:08:42.840 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-15T12:08:42.841 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:42.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T12:08:42.868 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T12:08:42.936 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:42.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-15T12:08:42.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-15T12:08:43.032 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-15T12:08:43.033 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:43.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T12:08:43.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T12:08:43.127 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:43.127 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/usr/bin/stdin-killer 2024-05-15T12:08:43.155 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-15T12:08:43.224 INFO:teuthology.run_tasks:Running task ceph... 2024-05-15T12:08:43.302 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-15T12:08:43.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-05-15T12:08:43.305 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 777 /var/log/ceph 2024-05-15T12:08:43.332 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-15T12:08:43.333 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T12:08:43.372 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-15T12:08:43.399 INFO:tasks.ceph:Creating extra log directories... 2024-05-15T12:08:43.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T12:08:43.440 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-15T12:08:43.470 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-15T12:08:43.471 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-15T12:08:43.471 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-15T12:08:43.471 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:43.471 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-15T12:08:43.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-15T12:08:43.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-15T12:08:43.655 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:43.656 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-15T12:08:43.672 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-15T12:08:43.785 DEBUG:teuthology.orchestra.run.smithi083:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-15T12:08:43.815 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-15T12:08:43.815 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-15T12:08:43.815 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992', 'branch': 'wip-lusov-quiesce', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7706992', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiesce'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiesce', 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 413, 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiesce', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBET1uHmh3L1CxDQtkWV7J4GKRHZfra2AJVv3EStswvyv4KlEyWeCPNN/jYGkyms8+xg0apcb69x8CqYYtvRBMes=', 'smithi083.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxS/v0ZUCE+U5ZcfaMmdavL5WrSvFZLQzNkRfhFpxVTHPxEOD72uINkJ9Om6u24iH9nuMM/HBvCQLiLN1RGTkU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '9b63866860f0b71216b2c0a73aedd2e0a8a5c98b', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-15_11:41:37', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-15T12:08:43.816 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T12:08:43.818 DEBUG:teuthology.orchestra.run.smithi083:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-15T12:08:43.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T12:08:43.874 DEBUG:teuthology.orchestra.run.smithi083:> sudo install -d -m0777 -- /var/run/ceph 2024-05-15T12:08:43.931 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:43.931 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T12:08:43.954 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T12:08:43.954 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-05-15T12:08:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T12:08:44.010 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:44.010 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-15T12:08:44.010 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:44.010 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:44.010 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-05-15 12:08:26.933901327 +0000 2024-05-15T12:08:44.011 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-05-15 12:06:12.097483208 +0000 2024-05-15T12:08:44.011 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-05-15 12:06:12.097483208 +0000 2024-05-15T12:08:44.011 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-05-15 12:06:12.097483208 +0000 2024-05-15T12:08:44.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T12:08:44.073 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-05-15T12:08:44.074 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-05-15T12:08:44.074 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000276905 s, 1.8 MB/s 2024-05-15T12:08:44.075 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T12:08:44.131 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-05-15T12:08:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T12:08:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:44.187 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-05-15T12:08:44.187 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:44.187 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:44.187 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-05-15 12:08:26.933901327 +0000 2024-05-15T12:08:44.188 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-05-15 12:06:12.461476143 +0000 2024-05-15T12:08:44.188 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-05-15 12:06:12.461476143 +0000 2024-05-15T12:08:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-05-15 12:06:12.461476143 +0000 2024-05-15T12:08:44.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T12:08:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-05-15T12:08:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-05-15T12:08:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000227474 s, 2.3 MB/s 2024-05-15T12:08:44.251 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T12:08:44.308 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-05-15 12:08:26.934901308 +0000 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-05-15 12:06:12.794469681 +0000 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-05-15 12:06:12.794469681 +0000 2024-05-15T12:08:44.364 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-05-15 12:06:12.794469681 +0000 2024-05-15T12:08:44.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T12:08:44.427 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-05-15T12:08:44.427 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-05-15T12:08:44.427 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000221905 s, 2.3 MB/s 2024-05-15T12:08:44.428 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T12:08:44.485 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-05-15 12:08:26.934901308 +0000 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-05-15 12:06:13.141462947 +0000 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-05-15 12:06:13.141462947 +0000 2024-05-15T12:08:44.541 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-05-15 12:06:13.141462947 +0000 2024-05-15T12:08:44.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T12:08:44.604 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-05-15T12:08:44.604 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-05-15T12:08:44.604 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000182792 s, 2.8 MB/s 2024-05-15T12:08:44.605 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T12:08:44.662 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T12:08:44.662 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:44.663 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/scratch_devs of=/dev/stdout 2024-05-15T12:08:44.682 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-15T12:08:44.682 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_1 2024-05-15T12:08:44.742 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-15T12:08:44.743 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:44.743 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-15T12:08:44.743 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:44.743 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:44.743 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-05-15 12:08:33.692677475 +0000 2024-05-15T12:08:44.744 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-05-15 12:06:12.156410064 +0000 2024-05-15T12:08:44.744 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-05-15 12:06:12.156410064 +0000 2024-05-15T12:08:44.744 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-05-15 12:06:12.156410064 +0000 2024-05-15T12:08:44.744 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-15T12:08:44.811 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-05-15T12:08:44.811 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-05-15T12:08:44.811 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000356189 s, 1.4 MB/s 2024-05-15T12:08:44.812 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-15T12:08:44.872 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_2 2024-05-15T12:08:44.929 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-05-15 12:08:33.692677475 +0000 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-05-15 12:06:12.508401226 +0000 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-05-15 12:06:12.508401226 +0000 2024-05-15T12:08:44.930 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-05-15 12:06:12.508401226 +0000 2024-05-15T12:08:44.931 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-15T12:08:44.996 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-05-15T12:08:44.996 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-05-15T12:08:44.996 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000183534 s, 2.8 MB/s 2024-05-15T12:08:44.998 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-15T12:08:45.056 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_3 2024-05-15T12:08:45.113 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-15T12:08:45.113 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-05-15 12:08:33.692677475 +0000 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-05-15 12:06:12.839392915 +0000 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-05-15 12:06:12.839392915 +0000 2024-05-15T12:08:45.114 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-05-15 12:06:12.839392915 +0000 2024-05-15T12:08:45.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-15T12:08:45.180 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-05-15T12:08:45.180 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-05-15T12:08:45.180 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000200544 s, 2.6 MB/s 2024-05-15T12:08:45.182 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-15T12:08:45.240 DEBUG:teuthology.orchestra.run.smithi083:> stat /dev/vg_nvme/lv_4 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:Context: system_u:object_r:device_t:s0 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:Access: 2024-05-15 12:08:33.692677475 +0000 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:Modify: 2024-05-15 12:06:13.226383198 +0000 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout:Change: 2024-05-15 12:06:13.226383198 +0000 2024-05-15T12:08:45.297 INFO:teuthology.orchestra.run.smithi083.stdout: Birth: 2024-05-15 12:06:13.226383198 +0000 2024-05-15T12:08:45.297 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-15T12:08:45.363 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records in 2024-05-15T12:08:45.363 INFO:teuthology.orchestra.run.smithi083.stderr:1+0 records out 2024-05-15T12:08:45.363 INFO:teuthology.orchestra.run.smithi083.stderr:512 bytes copied, 0.000207141 s, 2.5 MB/s 2024-05-15T12:08:45.365 DEBUG:teuthology.orchestra.run.smithi083:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-15T12:08:45.423 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T12:08:45.423 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-15T12:08:45.423 INFO:tasks.ceph:Generating config... 2024-05-15T12:08:45.424 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-15T12:08:45.424 INFO:tasks.ceph:[client] debug client = 20 2024-05-15T12:08:45.425 INFO:tasks.ceph:[client] debug ms = 1 2024-05-15T12:08:45.425 INFO:tasks.ceph:[client] pid file = 2024-05-15T12:08:45.425 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-15T12:08:45.425 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-15T12:08:45.425 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-15T12:08:45.425 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-15T12:08:45.425 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-15T12:08:45.425 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-15T12:08:45.425 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-15T12:08:45.425 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-15T12:08:45.426 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-15T12:08:45.426 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-15T12:08:45.427 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-15T12:08:45.428 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-15T12:08:45.428 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-15T12:08:45.428 INFO:tasks.ceph:Setting up mon.a... 2024-05-15T12:08:45.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-15T12:08:45.485 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2024-05-15T12:08:45.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-15T12:08:45.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T12:08:45.560 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.83'), ('mon.c', '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]')] 2024-05-15T12:08:45.560 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-15T12:08:45.561 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:45.561 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T12:08:45.616 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.83 --addv c '[v2:172.21.15.83:3301,v1:172.21.15.83:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 80026697-69b5-4668-adbe-f40fd7cb21f7 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 80026697-69b5-4668-adbe-f40fd7cb21f7 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2024-05-15T12:08:45.710898+0000 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-05-15T12:08:45.710898+0000 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 17 (quincy) 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] mon.b 2024-05-15T12:08:45.705 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] mon.c 2024-05-15T12:08:45.706 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-15T12:08:45.707 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-15T12:08:45.722 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 80026697-69b5-4668-adbe-f40fd7cb21f7... 2024-05-15T12:08:45.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T12:08:45.764 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.805 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-05-15T12:08:45.806 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.807 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 80026697-69b5-4668-adbe-f40fd7cb21f7 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-05-15T12:08:45.808 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.809 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-05-15T12:08:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-05-15T12:08:45.811 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-05-15T12:08:45.812 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: mon down mkfs grace = 300 2024-05-15T12:08:45.813 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-05-15T12:08:45.814 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2024-05-15T12:08:45.815 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi083.stdout:[global] 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi083.stdout: chdir = "" 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi083.stdout: auth supported = cephx 2024-05-15T12:08:45.816 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: filestore xattr use omap = true 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: mon clock drift allowed = 1.000 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: osd crush chooseleaf type = 0 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: auth debug = true 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on old message = true 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: ms die on bug = true 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: mon pg warn max object skew = 0 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.817 INFO:teuthology.orchestra.run.smithi083.stdout: # disable pg_autoscaler by default for new pools 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default size = 2 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow primary affinity = true 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd allow pg remap = true 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on legacy crush tunables = false 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on crush straw calc version zero = false 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on no sortbitwise = false 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on osd down out interval zero = false 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon warn on too few osds = false 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-15T12:08:45.818 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: mon_allow_pool_size_one = true 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: osd default data pool replay window = 5 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: mon allow pool delete = true 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: mon cluster log file level = debug 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: debug asserts on shutdown = true 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: mon health detail to clog = false 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: mon host = "172.21.15.77,172.21.15.83,[v2:172.21.15.83:3301,v1:172.21.15.83:6790]" 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: fsid = 80026697-69b5-4668-adbe-f40fd7cb21f7 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.819 INFO:teuthology.orchestra.run.smithi083.stdout:[osd] 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd journal size = 100 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub load threshold = 5.0 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd scrub max interval = 600 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd mclock profile = high_recovery_ops 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd recover clone overlap = true 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd recovery max chunk = 1048576 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug shutdown = true 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug op order = true 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug verify stray on activate = true 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug trim objects = true 2024-05-15T12:08:45.820 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: osd open classes on start = true 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug pg log writeout = true 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: osd deep scrub update digest min age = 30 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: osd map max advance = 10 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: journal zero on create = true 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: filestore ondisk finisher threads = 3 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: filestore apply finisher threads = 3 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: bdev debug aio = true 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: osd debug misdirected ops = true 2024-05-15T12:08:45.821 INFO:teuthology.orchestra.run.smithi083.stdout: bdev async discard = True 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: bdev enable discard = True 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore allocator = bitmap 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore block size = 96636764160 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: bluestore fsck on mount = True 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluefs = 1/20 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: debug bluestore = 1/20 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: debug osd = 20 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: debug rocksdb = 4/10 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd backfillfull_ratio = 0.85 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd full ratio = 0.9 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd nearfull ratio = 0.8 2024-05-15T12:08:45.822 INFO:teuthology.orchestra.run.smithi083.stdout: osd failsafe full ratio = 0.95 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: osd objectstore = bluestore 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr] 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: debug mgr = 20 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: mgr/telemetry/nag = false 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout:[mon] 2024-05-15T12:08:45.823 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: debug mon = 20 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: debug paxos = 20 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: debug auth = 20 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: mon data avail warn = 5 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: mon mgr mkfs grace = 240 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min pgs per osd = 4 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd reporter subtree level = osd 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: mon osd prime pg temp = true 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: mon reweight min bytes per osd = 10 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: auth mon ticket ttl = 660 # 11m 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: auth service ticket ttl = 240 # 4m 2024-05-15T12:08:45.824 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: # don't complain about insecure global_id in the test suite 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: # 1m isn't quite enough 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: mon_down_mkfs_grace = 2m 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: mon_warn_on_filestore_osds = false 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: mon down mkfs grace = 300 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: mon op complaint time = 120 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout:[client] 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: rgw cache enabled = true 2024-05-15T12:08:45.825 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable ops log = true 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: rgw enable usage log = true 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: client mount timeout = 600 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: debug client = 20 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: pid file = "" 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.a] 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.b] 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout:[mon.c] 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2024-05-15T12:08:45.826 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout:[mds] 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds = 20 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: debug mds balancer = 20 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: debug ms = 1 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug frag = True 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: mds debug scatterstat = True 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: mds op complaint time = 180 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: mds verify scatter = True 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: osd op complaint time = 180 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: rados mon op timeout = 900 2024-05-15T12:08:45.827 INFO:teuthology.orchestra.run.smithi083.stdout: rados osd op timeout = 900 2024-05-15T12:08:45.829 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-15T12:08:45.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-15T12:08:45.923 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-15T12:08:45.923 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:45.923 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-15T12:08:45.938 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:45.939 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-15T12:08:45.994 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:08:45.994 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:45.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T12:08:45.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T12:08:46.068 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:08:46.068 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:46.123 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:08:46.123 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:46.123 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-15T12:08:46.123 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-15T12:08:46.165 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:08:46.165 DEBUG:teuthology.orchestra.run.smithi083:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:46.223 INFO:tasks.ceph:Setting up mon nodes... 2024-05-15T12:08:46.224 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-15T12:08:46.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-15T12:08:46.275 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-15T12:08:46.277 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T12:08:46.352 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-15T12:08:46.355 INFO:tasks.ceph:Setting up mds nodes... 2024-05-15T12:08:46.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-15T12:08:46.407 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-15T12:08:46.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-15T12:08:46.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-15T12:08:46.525 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-15T12:08:46.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-15T12:08:46.553 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-15T12:08:46.612 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-15T12:08:46.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-15T12:08:46.642 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-15T12:08:46.735 INFO:teuthology.orchestra.run.smithi083.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-15T12:08:46.737 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-15T12:08:46.761 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-15T12:08:46.762 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-15T12:08:46.802 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-15T12:08:46.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-15T12:08:46.896 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-15T12:08:46.908 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-15T12:08:46.949 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-15T12:08:46.962 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-15T12:08:47.042 INFO:teuthology.orchestra.run.smithi083.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-15T12:08:47.055 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-15T12:08:47.055 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi083.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-15T12:08:47.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-15T12:08:47.080 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T12:08:47.081 INFO:tasks.ceph:role: osd.0 2024-05-15T12:08:47.081 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:08:47.081 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T12:08:47.153 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:08:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:08:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:08:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:08:47.153 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:08:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:08:47.154 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:08:47.154 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:08:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:08:47.154 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:08:47.638 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-05-15T12:08:47.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-05-15T12:08:47.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-15T12:08:47.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-15T12:08:47.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-15T12:08:47.843 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T12:08:47.843 INFO:tasks.ceph:role: osd.1 2024-05-15T12:08:47.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:08:47.844 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T12:08:47.916 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:08:47.917 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:08:48.375 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-05-15T12:08:48.377 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-05-15T12:08:48.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-15T12:08:48.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-15T12:08:48.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-15T12:08:48.584 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T12:08:48.584 INFO:tasks.ceph:role: osd.2 2024-05-15T12:08:48.584 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:08:48.585 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:08:48.657 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:08:48.658 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:08:48.658 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:08:48.658 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:08:49.145 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-05-15T12:08:49.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-05-15T12:08:49.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-15T12:08:49.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-15T12:08:49.270 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-15T12:08:49.336 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-15T12:08:49.336 INFO:tasks.ceph:role: osd.3 2024-05-15T12:08:49.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:08:49.336 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-15T12:08:49.408 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:08:49.408 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:08:49.408 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:08:49.408 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:08:49.409 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:08:49.409 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:08:49.409 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:08:49.409 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:08:49.409 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:08:49.409 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:08:49.921 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-05-15T12:08:49.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-05-15T12:08:49.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-15T12:08:50.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-15T12:08:50.095 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:50.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:50.197+0000 7fa1f6029640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-15T12:08:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:50.203+0000 7fa1f6029640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-15T12:08:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:50.203+0000 7fa1f6029640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T12:08:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:50.203+0000 7fa1f6029640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T12:08:50.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:50.203+0000 7fa1f6029640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-15T12:08:50.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:50.204+0000 7fa1f6029640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-15T12:08:53.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-15T12:08:53.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:53.187+0000 7f9b0ca0d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-15T12:08:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:53.187+0000 7f9b0ca0d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-15T12:08:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:53.187+0000 7f9b0ca0d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T12:08:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:53.187+0000 7f9b0ca0d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T12:08:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:53.187+0000 7f9b0ca0d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-15T12:08:53.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:53.188+0000 7f9b0ca0d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-15T12:08:56.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-15T12:08:56.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:56.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:56.161+0000 7f6a5d93e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-15T12:08:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:56.161+0000 7f6a5d93e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-15T12:08:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:56.161+0000 7f6a5d93e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T12:08:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:56.161+0000 7f6a5d93e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T12:08:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:56.161+0000 7f6a5d93e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-15T12:08:56.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:56.162+0000 7f6a5d93e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-15T12:08:59.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-15T12:08:59.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:08:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:59.123+0000 7fef78f01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-15T12:08:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:59.123+0000 7fef78f01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-15T12:08:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:59.123+0000 7fef78f01640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T12:08:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:59.123+0000 7fef78f01640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T12:08:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:59.123+0000 7fef78f01640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-15T12:08:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:08:59.124+0000 7fef78f01640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-15T12:09:01.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-15T12:09:01.995 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-15T12:09:02.028 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T12:09:02.028 INFO:tasks.ceph:role: osd.4 2024-05-15T12:09:02.028 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:09:02.028 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-15T12:09:02.104 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:09:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:09:02.104 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:09:02.105 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:09:02.608 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-05-15T12:09:02.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-05-15T12:09:02.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-15T12:09:02.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-15T12:09:02.757 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-15T12:09:02.824 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T12:09:02.825 INFO:tasks.ceph:role: osd.5 2024-05-15T12:09:02.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:09:02.825 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-15T12:09:02.902 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:09:02.902 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:09:02.902 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:09:02.902 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:09:02.902 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:09:02.902 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:09:02.903 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:09:02.903 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:09:02.903 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:09:02.903 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:09:03.360 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-05-15T12:09:03.362 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-05-15T12:09:03.363 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-15T12:09:03.457 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-15T12:09:03.485 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-15T12:09:03.551 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T12:09:03.551 INFO:tasks.ceph:role: osd.6 2024-05-15T12:09:03.551 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:09:03.551 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:09:03.622 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:09:04.109 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-05-15T12:09:04.111 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-05-15T12:09:04.111 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-15T12:09:04.243 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-15T12:09:04.272 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-15T12:09:04.337 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-15T12:09:04.337 INFO:tasks.ceph:role: osd.7 2024-05-15T12:09:04.337 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:09:04.337 DEBUG:teuthology.orchestra.run.smithi083:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-15T12:09:04.409 INFO:teuthology.orchestra.run.smithi083.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout: = sunit=0 swidth=0 blks 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-15T12:09:04.410 INFO:teuthology.orchestra.run.smithi083.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-15T12:09:04.913 INFO:teuthology.orchestra.run.smithi083.stdout:Discarding blocks...Done. 2024-05-15T12:09:04.915 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi083.front.sepia.ceph.com -o noatime 2024-05-15T12:09:04.916 DEBUG:teuthology.orchestra.run.smithi083:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-15T12:09:05.059 DEBUG:teuthology.orchestra.run.smithi083:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-15T12:09:05.092 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:05.193+0000 7f62a0533640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-15T12:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:05.193+0000 7f62a0533640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-15T12:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:05.193+0000 7f62a0533640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T12:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:05.193+0000 7f62a0533640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T12:09:05.189 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:05.193+0000 7f62a0533640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-15T12:09:05.190 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:05.193+0000 7f62a0533640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-15T12:09:08.041 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-15T12:09:08.070 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:09:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:08.166+0000 7fc596c1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-15T12:09:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:08.166+0000 7fc596c1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-15T12:09:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:08.166+0000 7fc596c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T12:09:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:08.166+0000 7fc596c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T12:09:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:08.166+0000 7fc596c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-15T12:09:08.162 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:08.167+0000 7fc596c1c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-15T12:09:11.027 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-15T12:09:11.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:11.150+0000 7ffb4c7fc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-15T12:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:11.150+0000 7ffb4c7fc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-15T12:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:11.150+0000 7ffb4c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T12:09:11.145 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:11.150+0000 7ffb4c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T12:09:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:11.150+0000 7ffb4c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-15T12:09:11.146 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:11.150+0000 7ffb4c7fc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-15T12:09:13.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:09:13.820 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:09:13.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-15T12:09:14.024 DEBUG:teuthology.orchestra.run.smithi083:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:09:14.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:14.126+0000 7f83cc1c2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-15T12:09:14.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:14.127+0000 7f83cc1c2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-15T12:09:14.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:14.127+0000 7f83cc1c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T12:09:14.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:14.127+0000 7f83cc1c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T12:09:14.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:14.127+0000 7f83cc1c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-15T12:09:14.122 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:14.127+0000 7f83cc1c2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-15T12:09:16.984 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-15T12:09:17.013 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-15T12:09:17.013 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-15T12:09:17.044 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-15T12:09:17.113 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-15T12:09:17.181 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-15T12:09:17.248 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-15T12:09:17.314 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-15T12:09:17.380 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-15T12:09:17.445 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-15T12:09:17.475 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.476 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-15T12:09:17.543 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.544 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-15T12:09:17.610 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.629 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-15T12:09:17.677 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.677 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-15T12:09:17.743 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.743 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-15T12:09:17.809 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.809 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-15T12:09:17.873 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.873 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-15T12:09:17.889 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:17.889 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-15T12:09:17.944 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.944 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-15T12:09:17.960 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:17.960 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-15T12:09:18.015 INFO:tasks.ceph:Adding keys to all mons... 2024-05-15T12:09:18.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T12:09:18.018 DEBUG:teuthology.orchestra.run.smithi083:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmZUbBEBAAz0B5Um5iI/QibgapEVk2pQ== 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmPQWfGBAAHSoWA6UXefSjVeas6BpRlQ== 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURm71exHxAAfmsDUiC+f5gctJQhvYpH7Q== 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDSpURmU87XCxAAk7dypTDoAL4sTsDM7EZFMg== 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDVpURmesM9CxAACPShZdNm7pYxsLx95/uJ1A== 2024-05-15T12:09:18.060 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDYpURmWc6uCRAAPxJixhd4YDWrS29JTGhmJg== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDbpURmqv1oBxAAQmkHFkdd8oZ6v1VHqOyMoQ== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmAqZiFRAA4et0Z7YLaaT11fP5+vdY/Q== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmRLjdJBAA2fzt9Z8l066728ZHrXWA0A== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmhmUpLBAAZvmSvkRacIMJ/1cAlKbsOA== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDhpURm7qaeCxAA8H5STPDYUWloZ0tAVjW4Gg== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDkpURmvST8CRAAm007+uyr69XNOPSLJVmPyw== 2024-05-15T12:09:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDnpURmjO4BCRAAknmlO6FeYzkuNd/BG2kuPw== 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDqpURm4Q2cBxAAfLgYSw6SymfSLB5oOL0WUw== 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmdXQ6MBAAk41w2IfO9gjcJKGZ1RHHGw== 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmd4TJNRAAOsMdxg2YpGWm5MQKi5S33A== 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURm4YD3OBAAgy0xc2R1JVhjP10MHnCC3Q== 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2024-05-15T12:09:18.062 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDPpURmGOPoAhAAeKJT2McM5wGpHs3DdWsf4w== 2024-05-15T12:09:18.079 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.y] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmZUbBEBAAz0B5Um5iI/QibgapEVk2pQ== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.a] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmPQWfGBAAHSoWA6UXefSjVeas6BpRlQ== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.c] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURm71exHxAAfmsDUiC+f5gctJQhvYpH7Q== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.0] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDSpURmU87XCxAAk7dypTDoAL4sTsDM7EZFMg== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.1] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDVpURmesM9CxAACPShZdNm7pYxsLx95/uJ1A== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.2] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDYpURmWc6uCRAAPxJixhd4YDWrS29JTGhmJg== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.3] 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDbpURmqv1oBxAAQmkHFkdd8oZ6v1VHqOyMoQ== 2024-05-15T12:09:18.080 INFO:teuthology.orchestra.run.smithi083.stdout:[mgr.x] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmAqZiFRAA4et0Z7YLaaT11fP5+vdY/Q== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.b] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmRLjdJBAA2fzt9Z8l066728ZHrXWA0A== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[mds.d] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmhmUpLBAAZvmSvkRacIMJ/1cAlKbsOA== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.4] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDhpURm7qaeCxAA8H5STPDYUWloZ0tAVjW4Gg== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.5] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDkpURmvST8CRAAm007+uyr69XNOPSLJVmPyw== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.6] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDnpURmjO4BCRAAknmlO6FeYzkuNd/BG2kuPw== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[osd.7] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDqpURm4Q2cBxAAfLgYSw6SymfSLB5oOL0WUw== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[client.0] 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmdXQ6MBAAk41w2IfO9gjcJKGZ1RHHGw== 2024-05-15T12:09:18.081 INFO:teuthology.orchestra.run.smithi083.stdout:[client.2] 2024-05-15T12:09:18.082 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURmd4TJNRAAOsMdxg2YpGWm5MQKi5S33A== 2024-05-15T12:09:18.082 INFO:teuthology.orchestra.run.smithi083.stdout:[client.1] 2024-05-15T12:09:18.082 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDOpURm4YD3OBAAgy0xc2R1JVhjP10MHnCC3Q== 2024-05-15T12:09:18.082 INFO:teuthology.orchestra.run.smithi083.stdout:[client.3] 2024-05-15T12:09:18.082 INFO:teuthology.orchestra.run.smithi083.stdout: key = AQDPpURmGOPoAhAAeKJT2McM5wGpHs3DdWsf4w== 2024-05-15T12:09:18.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T12:09:18.106 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T12:09:18.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.230 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.284 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.286 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.339 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T12:09:18.496 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-15T12:09:18.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.602 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.604 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-15T12:09:18.658 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.714 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.819 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-15T12:09:18.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:18.874 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:18.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:18.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:18.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:18.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:19.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:19.043 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-15T12:09:19.099 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-15T12:09:19.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-15T12:09:19.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T12:09:19.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-15T12:09:19.245 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-15T12:09:19.270 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T12:09:19.366 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-15T12:09:19.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-15T12:09:19.455 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-15T12:09:19.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-15T12:09:19.577 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:09:19.580 DEBUG:teuthology.orchestra.run.smithi083:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-15T12:09:19.632 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-15T12:09:19.632 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-15T12:09:19.632 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-15T12:09:19.636 INFO:tasks.ceph.mon.a:Started 2024-05-15T12:09:19.636 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-15T12:09:19.636 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-15T12:09:19.675 INFO:tasks.ceph.mon.b:Started 2024-05-15T12:09:19.675 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-15T12:09:19.675 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-15T12:09:19.677 INFO:tasks.ceph.mon.c:Started 2024-05-15T12:09:19.677 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-15T12:09:19.678 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-15T12:09:19.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-15T12:09:19.682 INFO:tasks.ceph.mgr.y:Started 2024-05-15T12:09:19.682 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-15T12:09:19.682 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-15T12:09:19.684 INFO:tasks.ceph.mgr.x:Started 2024-05-15T12:09:19.684 INFO:tasks.ceph:Setting crush tunables to default 2024-05-15T12:09:19.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2024-05-15T12:09:19.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.789+0000 7fb016b89640 1 Processor -- start 2024-05-15T12:09:19.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.789+0000 7fb016b89640 1 -- start start 2024-05-15T12:09:19.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb016b89640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 0x7fb0100700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb016b89640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 0x7fb01015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb016b89640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01006f050 con 0x7fb010070630 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb016b89640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb01006f330 con 0x7fb01015bff0 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb016b89640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb01006f610 con 0x7fb01006db10 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 0x7fb0100700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 0x7fb0100700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36480/0 (socket says 172.21.15.77:36480) 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 -- 172.21.15.77:0/2324317729 learned_addr learned my addr 172.21.15.77:0/2324317729 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb015126640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 0x7fb01015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 -- 172.21.15.77:0/2324317729 >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 msgr2=0x7fb0100700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 -- 172.21.15.77:0/2324317729 >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 msgr2=0x7fb0100700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 0x7fb0100700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb014925640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 0x7fb0100700f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb015126640 1 -- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 msgr2=0x7fb01015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb015126640 1 -- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 msgr2=0x7fb01015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb015126640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 0x7fb01015c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-15T12:09:19.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.790+0000 7fb015126640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 0x7fb01015c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-15T12:09:19.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844572202 0 0) 0x7fb01006f050 con 0x7fb010070630 2024-05-15T12:09:19.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb000003520 con 0x7fb010070630 2024-05-15T12:09:19.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1886569198 0 0) 0x7fb000003520 con 0x7fb010070630 2024-05-15T12:09:19.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 msgr2=0x7fb01015c3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T12:09:19.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.83:3300/0 conn(0x7fb01006db10 0x7fb01015c3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 msgr2=0x7fb0100700f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 --2- 172.21.15.77:0/2324317729 >> v2:172.21.15.77:3300/0 conn(0x7fb01015bff0 0x7fb0100700f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01006f8f0 con 0x7fb010070630 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7faffc0016f0 con 0x7fb010070630 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.945+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 >> v1:172.21.15.83:6789/0 conn(0x7fb010070630 legacy=0x7fb01006d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00f7fe640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000003aa0 0x7fb000003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00f7fe640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb000004800 0x7fb000004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00f7fe640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000005310 0x7fb00000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb01006f330 con 0x7fb000003aa0 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb01006f610 con 0x7fb000005310 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb00000c2d0 con 0x7fb000004800 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb014925640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000003aa0 0x7fb000003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00ffff640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb000004800 0x7fb000004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb015126640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000005310 0x7fb00000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb014925640 1 -- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb000004800 msgr2=0x7fb000004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb014925640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb000004800 0x7fb000004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb014925640 1 -- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000005310 msgr2=0x7fb00000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb014925640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000005310 0x7fb00000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb014925640 1 -- 172.21.15.77:0/2324317729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb000003520 con 0x7fb000003aa0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb00ffff640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb000004800 0x7fb000004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.946+0000 7fb015126640 1 -- 172.21.15.77:0/2324317729 reap_dead start 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.947+0000 7fb014925640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000003aa0 0x7fb000003ec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb00400bd40 tx=0x7fb000005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a901783f1af7b9c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.948+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00403a070 con 0x7fb000003aa0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.948+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00402d9e0 con 0x7fb000003aa0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.948+0000 7fb00f7fe640 1 -- 172.21.15.77:0/2324317729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00400b940 con 0x7fb000003aa0 2024-05-15T12:09:19.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.948+0000 7fb016b89640 1 -- 172.21.15.77:0/2324317729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000003aa0 msgr2=0x7fb000003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.948+0000 7fb016b89640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000003aa0 0x7fb000003ec0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb00400bd40 tx=0x7fb000005830 comp rx=0 tx=0).stop 2024-05-15T12:09:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.949+0000 7fb016b89640 1 -- 172.21.15.77:0/2324317729 shutdown_connections 2024-05-15T12:09:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.949+0000 7fb016b89640 1 --2- 172.21.15.77:0/2324317729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb000003aa0 0x7fb000003ec0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.949+0000 7fb016b89640 1 -- 172.21.15.77:0/2324317729 >> 172.21.15.77:0/2324317729 conn(0x7fb010072a50 msgr2=0x7fb010072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.949+0000 7fb016b89640 1 -- 172.21.15.77:0/2324317729 shutdown_connections 2024-05-15T12:09:19.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.949+0000 7fb016b89640 1 -- 172.21.15.77:0/2324317729 wait complete. 2024-05-15T12:09:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.950+0000 7fb016b89640 1 Processor -- start 2024-05-15T12:09:19.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.950+0000 7fb016b89640 1 -- start start 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.951+0000 7fb016b89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 0x7fb01015dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.951+0000 7fb016b89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 0x7fb0101482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.951+0000 7fb016b89640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb010151a80 0x7fb010151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb016b89640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb0100700f0 con 0x7fb0101541c0 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb016b89640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb01006ecc0 con 0x7fb000003aa0 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb016b89640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb010070270 con 0x7fb010151a80 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb014925640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 0x7fb01015dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 0x7fb0101482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 0x7fb0101482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36532/0 (socket says 172.21.15.77:36532) 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb014925640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 0x7fb01015dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:42636/0 (socket says 172.21.15.77:42636) 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 -- 172.21.15.77:0/462644588 learned_addr learned my addr 172.21.15.77:0/462644588 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb015126640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb010151a80 0x7fb010151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:19.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 -- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb010151a80 msgr2=0x7fb010151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb010151a80 0x7fb010151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 -- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 msgr2=0x7fb01015dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 0x7fb01015dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 -- 172.21.15.77:0/462644588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb010153120 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb014925640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 0x7fb01015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00ffff640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 0x7fb0101482f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e7b0 tx=0x7faffc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc00ee60 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc018070 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc00c6c0 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb010153400 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0101539c0 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.952+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faffc00c860 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.953+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faffc003d60 con 0x7fb0101541c0 2024-05-15T12:09:19.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.954+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb010152440 con 0x7fb0101541c0 2024-05-15T12:09:19.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:19.956+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7faffc00cce0 con 0x7fb0101541c0 2024-05-15T12:09:20.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.021+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fb0100694d0 con 0x7fb0101541c0 2024-05-15T12:09:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.023+0000 7fb00d7fa640 1 -- 172.21.15.77:0/462644588 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7faffc0035f0 con 0x7fb0101541c0 2024-05-15T12:09:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-05-15T12:09:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 msgr2=0x7fb0101482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 0x7fb0101482f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faffc00e7b0 tx=0x7faffc00ec70 comp rx=0 tx=0).stop 2024-05-15T12:09:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 shutdown_connections 2024-05-15T12:09:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb010151a80 0x7fb010151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0101541c0 0x7fb0101482f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 --2- 172.21.15.77:0/462644588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb000003aa0 0x7fb01015dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 >> 172.21.15.77:0/462644588 conn(0x7fb010072a50 msgr2=0x7fb010159750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:20.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 shutdown_connections 2024-05-15T12:09:20.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:20.024+0000 7fb016b89640 1 -- 172.21.15.77:0/462644588 wait complete. 2024-05-15T12:09:20.033 INFO:tasks.ceph:check_enable_crimson: False 2024-05-15T12:09:20.033 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-15T12:09:20.033 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:20.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-15T12:09:20.047 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:20.052+0000 7fd5e0a93040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T12:09:20.056 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:20.061+0000 7f0a69120040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-15T12:09:20.059 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:20.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-15T12:09:20.125 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:20.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-15T12:09:20.190 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:09:20.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-15T12:09:20.201 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:20.207+0000 7fd5e0a93040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T12:09:20.240 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:20.245+0000 7f0a69120040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-15T12:09:20.254 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:20.259+0000 7fd5e0a93040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T12:09:20.256 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:20.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-15T12:09:20.281 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:20.281 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-15T12:09:20.296 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:20.301+0000 7f0a69120040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-15T12:09:20.347 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:20.347 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-15T12:09:20.413 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:09:20.413 DEBUG:teuthology.orchestra.run.smithi083:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-15T12:09:20.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 59dc97f1-ec1e-4bd1-9bea-277ec6925d4e 0 2024-05-15T12:09:20.509 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:20.514+0000 7fd5e0a93040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T12:09:20.546 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:20.551+0000 7f0a69120040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-15T12:09:20.557 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:20.562+0000 7fd5e0a93040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T12:09:20.590 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:20.595+0000 7f0a69120040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-15T12:09:20.607 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.612+0000 7f1890779640 1 Processor -- start 2024-05-15T12:09:20.608 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.613+0000 7f1890779640 1 -- start start 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f1890779640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f188806d400 0x7f188806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f1890779640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18880b0b30 con 0x7f188815e180 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f1890779640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18880b10b0 con 0x7f1888154180 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f1890779640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f188806ddb0 con 0x7f188806d400 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188e515640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1888154180 0x7f1888073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36490/0 (socket says 172.21.15.83:36490) 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188e515640 1 -- 172.21.15.83:0/83217195 learned_addr learned my addr 172.21.15.83:0/83217195 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188ed16640 1 --2- 172.21.15.83:0/83217195 >> v2:172.21.15.77:3300/0 conn(0x7f188806d400 0x7f188806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 456732990 0 0) 0x7f18880b10b0 con 0x7f1888154180 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1874003520 con 0x7f1888154180 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077608581 0 0) 0x7f18880b0b30 con 0x7f188815e180 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18880b10b0 con 0x7f188815e180 2024-05-15T12:09:20.612 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 528987940 0 0) 0x7f1874003520 con 0x7f1888154180 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 >> v2:172.21.15.77:3300/0 conn(0x7f188806d400 msgr2=0x7f188806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 --2- 172.21.15.83:0/83217195 >> v2:172.21.15.77:3300/0 conn(0x7f188806d400 0x7f188806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 >> v1:172.21.15.77:6789/0 conn(0x7f188815e180 legacy=0x7f18880b4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18880b0dd0 con 0x7f1888154180 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f18780016f0 con 0x7f1888154180 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 >> v1:172.21.15.83:6789/0 conn(0x7f1888154180 legacy=0x7f1888073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1874003c80 0x7f1874004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1874004800 0x7f1874004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f187400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f188806ddb0 con 0x7f1874003c80 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f187400c190 con 0x7f1874005230 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f187400c390 con 0x7f1874004800 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188ed16640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f187400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.613 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188dd14640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1874004800 0x7f1874004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.614+0000 7f188e515640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1874003c80 0x7f1874004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 -- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1874004800 msgr2=0x7f1874004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1874004800 0x7f1874004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 -- 172.21.15.83:0/83217195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1874003c80 msgr2=0x7f1874004080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1874003c80 0x7f1874004080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 -- 172.21.15.83:0/83217195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1874003520 con 0x7f1874005230 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 -- 172.21.15.83:0/83217195 reap_dead start 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188ed16640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f187400b9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1880009fc0 tx=0x7f1874005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=721c7b430f50a7a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880035020 con 0x7f1874005230 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880003bd0 con 0x7f1874005230 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.615+0000 7f188d513640 1 -- 172.21.15.83:0/83217195 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880009c10 con 0x7f1874005230 2024-05-15T12:09:20.614 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.616+0000 7f1890779640 1 -- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 msgr2=0x7f187400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.616+0000 7f1890779640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f187400b9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1880009fc0 tx=0x7f1874005830 comp rx=0 tx=0).stop 2024-05-15T12:09:20.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.616+0000 7f1890779640 1 -- 172.21.15.83:0/83217195 shutdown_connections 2024-05-15T12:09:20.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.616+0000 7f1890779640 1 --2- 172.21.15.83:0/83217195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f187400b9c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.616+0000 7f1890779640 1 -- 172.21.15.83:0/83217195 >> 172.21.15.83:0/83217195 conn(0x7f1888072b20 msgr2=0x7f1888072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:20.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.617+0000 7f1890779640 1 -- 172.21.15.83:0/83217195 shutdown_connections 2024-05-15T12:09:20.615 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.617+0000 7f1890779640 1 -- 172.21.15.83:0/83217195 wait complete. 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.618+0000 7f1890779640 1 Processor -- start 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.618+0000 7f1890779640 1 -- start start 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f18881566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1888157be0 0x7f1888147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18880b58a0 0x7f18880b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f188806d870 con 0x7f18880b58a0 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f18880d0410 con 0x7f1874005230 2024-05-15T12:09:20.618 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f188806d9f0 con 0x7f1888157be0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188e515640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f18881566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1888157be0 0x7f1888147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188e515640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f18881566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37344/0 (socket says 172.21.15.83:37344) 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188e515640 1 -- 172.21.15.83:0/3521216073 learned_addr learned my addr 172.21.15.83:0/3521216073 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188ed16640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18880b58a0 0x7f18880b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 -- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 msgr2=0x7f18881566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f18881566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 -- 172.21.15.83:0/3521216073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18880b58a0 msgr2=0x7f18880b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18880b58a0 0x7f18880b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 -- 172.21.15.83:0/3521216073 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1888158150 con 0x7f1888157be0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f188dd14640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1888157be0 0x7f1888147f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f188400f5e0 tx=0x7f188400faa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f188401a070 con 0x7f1888157be0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18840053e0 con 0x7f1888157be0 2024-05-15T12:09:20.619 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1884007250 con 0x7f1888157be0 2024-05-15T12:09:20.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.620+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1888158430 con 0x7f1888157be0 2024-05-15T12:09:20.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.621+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f18881589f0 con 0x7f1888157be0 2024-05-15T12:09:20.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.621+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f188401d070 con 0x7f1888157be0 2024-05-15T12:09:20.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.621+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1884003a20 con 0x7f1888157be0 2024-05-15T12:09:20.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.622+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18880694d0 con 0x7f1888157be0 2024-05-15T12:09:20.620 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.624+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f1884024020 con 0x7f1888157be0 2024-05-15T12:09:20.690 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.695+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "59dc97f1-ec1e-4bd1-9bea-277ec6925d4e", "id": 0} v 0) -- 0x7f18880cf3c0 con 0x7f1888157be0 2024-05-15T12:09:20.692 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.698+0000 7f187effd640 1 -- 172.21.15.83:0/3521216073 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59dc97f1-ec1e-4bd1-9bea-277ec6925d4e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1884003cf0 con 0x7f1888157be0 2024-05-15T12:09:20.693 INFO:teuthology.orchestra.run.smithi083.stdout:0 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1888157be0 msgr2=0x7f1888147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1888157be0 0x7f1888147f20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f188400f5e0 tx=0x7f188400faa0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 shutdown_connections 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1888157be0 0x7f1888147f20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18880b58a0 0x7f18880b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 --2- 172.21.15.83:0/3521216073 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1874005230 0x7f18881566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 >> 172.21.15.83:0/3521216073 conn(0x7f1888072b20 msgr2=0x7f188815e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 shutdown_connections 2024-05-15T12:09:20.694 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.699+0000 7f1890779640 1 -- 172.21.15.83:0/3521216073 wait complete. 2024-05-15T12:09:20.704 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 283debc2-c7a2-4c35-927b-2fe20fe90876 1 2024-05-15T12:09:20.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.808+0000 7f601ad51640 1 Processor -- start 2024-05-15T12:09:20.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.808+0000 7f601ad51640 1 -- start start 2024-05-15T12:09:20.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f601ad51640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f601415f560 0x7f60140ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f601ad51640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f60140aede0 0x7f60140b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f601ad51640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60140b5c10 con 0x7f60140b57f0 2024-05-15T12:09:20.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f601ad51640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f60140b13f0 con 0x7f601415f560 2024-05-15T12:09:20.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f601ad51640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f601415f940 con 0x7f60140aede0 2024-05-15T12:09:20.811 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f6013fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f60140aede0 0x7f60140b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f6013fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f60140aede0 0x7f60140b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37346/0 (socket says 172.21.15.83:37346) 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f6013fff640 1 -- 172.21.15.83:0/4214496713 learned_addr learned my addr 172.21.15.83:0/4214496713 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.809+0000 7f6018aed640 1 --2- 172.21.15.83:0/4214496713 >> v2:172.21.15.77:3300/0 conn(0x7f601415f560 0x7f60140ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f6013fff640 1 -- 172.21.15.83:0/4214496713 >> v2:172.21.15.77:3300/0 conn(0x7f601415f560 msgr2=0x7f60140ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f6013fff640 1 --2- 172.21.15.83:0/4214496713 >> v2:172.21.15.77:3300/0 conn(0x7f601415f560 0x7f60140ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f6013fff640 1 -- 172.21.15.83:0/4214496713 >> v1:172.21.15.77:6789/0 conn(0x7f60140b57f0 legacy=0x7f60140713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f6013fff640 1 -- 172.21.15.83:0/4214496713 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60140b1110 con 0x7f60140aede0 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f6013fff640 1 --2- 172.21.15.83:0/4214496713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140aede0 0x7f60140b52b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60140b64c0 tx=0x7f600002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0eddc945ca4831a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f60137fe640 1 -- 172.21.15.83:0/4214496713 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000037070 con 0x7f60140aede0 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f60137fe640 1 -- 172.21.15.83:0/4214496713 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000032440 con 0x7f60140aede0 2024-05-15T12:09:20.812 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.810+0000 7f60137fe640 1 -- 172.21.15.83:0/4214496713 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000032810 con 0x7f60140aede0 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 -- 172.21.15.83:0/4214496713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140aede0 msgr2=0x7f60140b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 --2- 172.21.15.83:0/4214496713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140aede0 0x7f60140b52b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f60140b64c0 tx=0x7f600002a1e0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 -- 172.21.15.83:0/4214496713 shutdown_connections 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 --2- 172.21.15.83:0/4214496713 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140aede0 0x7f60140b52b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 --2- 172.21.15.83:0/4214496713 >> v2:172.21.15.77:3300/0 conn(0x7f601415f560 0x7f60140ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 -- 172.21.15.83:0/4214496713 >> 172.21.15.83:0/4214496713 conn(0x7f60140b3ca0 msgr2=0x7f60140b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 -- 172.21.15.83:0/4214496713 shutdown_connections 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.811+0000 7f601ad51640 1 -- 172.21.15.83:0/4214496713 wait complete. 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.812+0000 7f601ad51640 1 Processor -- start 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.812+0000 7f601ad51640 1 -- start start 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f601ad51640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 0x7f601415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f601ad51640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f601415f560 0x7f6014156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f601ad51640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601414f7a0 0x7f60140d0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f601ad51640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f601406cae0 con 0x7f601414f7a0 2024-05-15T12:09:20.813 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f601ad51640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f601406c800 con 0x7f60140b57f0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f601ad51640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f60140d1c30 con 0x7f601415f560 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f6018aed640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 0x7f601415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f6018aed640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 0x7f601415e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37354/0 (socket says 172.21.15.83:37354) 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f6018aed640 1 -- 172.21.15.83:0/3637519894 learned_addr learned my addr 172.21.15.83:0/3637519894 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f6013fff640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f601415f560 0x7f6014156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.813+0000 7f60192ee640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601414f7a0 0x7f60140d0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f6018aed640 1 -- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f601415f560 msgr2=0x7f6014156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f6018aed640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f601415f560 0x7f6014156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f6018aed640 1 -- 172.21.15.83:0/3637519894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601414f7a0 msgr2=0x7f60140d0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f6018aed640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601414f7a0 0x7f60140d0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f6018aed640 1 -- 172.21.15.83:0/3637519894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6014156660 con 0x7f60140b57f0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f6018aed640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 0x7f601415e1d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f600800d830 tx=0x7f600800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600800b6c0 con 0x7f60140b57f0 2024-05-15T12:09:20.814 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6008019070 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600800ba80 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6014156900 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6014156ec0 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f600801e460 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.814+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6008014b50 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.815+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60140b0f30 con 0x7f60140b57f0 2024-05-15T12:09:20.815 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.817+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f60140b0f30 con 0x7f60140b57f0 2024-05-15T12:09:20.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.887+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "283debc2-c7a2-4c35-927b-2fe20fe90876", "id": 1} v 0) -- 0x7f60140694d0 con 0x7f60140b57f0 2024-05-15T12:09:20.885 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.890+0000 7f60117fa640 1 -- 172.21.15.83:0/3637519894 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "283debc2-c7a2-4c35-927b-2fe20fe90876", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6008014da0 con 0x7f60140b57f0 2024-05-15T12:09:20.885 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 msgr2=0x7f601415e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 0x7f601415e1d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f600800d830 tx=0x7f600800dcf0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 shutdown_connections 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f601415f560 0x7f6014156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f601414f7a0 0x7f60140d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 --2- 172.21.15.83:0/3637519894 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60140b57f0 0x7f601415e1d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.891+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 >> 172.21.15.83:0/3637519894 conn(0x7f60140b3ca0 msgr2=0x7f60140b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.892+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 shutdown_connections 2024-05-15T12:09:20.887 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:20.892+0000 7f601ad51640 1 -- 172.21.15.83:0/3637519894 wait complete. 2024-05-15T12:09:20.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new a6c86551-eeab-4d74-bf49-db221ec4bbd4 2 2024-05-15T12:09:20.998 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.003+0000 7f9000f46640 1 Processor -- start 2024-05-15T12:09:20.999 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.003+0000 7f9000f46640 1 -- start start 2024-05-15T12:09:21.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f9000f46640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ffc15f3d0 0x7f8ffc0bae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f9000f46640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0d4b10 0x7f8ffc0d0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.005 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f9000f46640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ffc0d4f80 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f9000f46640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f8ffc0d3d50 con 0x7f8ffc15f3d0 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f9000f46640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0d4030 con 0x7f8ffc0d4b10 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f8ff9d9b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0d4b10 0x7f8ffc0d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f8ffad9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f8ffc0b6c40 0x7f8ffc06d3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36498/0 (socket says 172.21.15.83:36498) 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.004+0000 7f8ffad9d640 1 -- 172.21.15.83:0/949942529 learned_addr learned my addr 172.21.15.83:0/949942529 (peer_addr_for_me v1:172.21.15.83:0/0) 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ffa59c640 1 --2- 172.21.15.83:0/949942529 >> v2:172.21.15.77:3300/0 conn(0x7f8ffc15f3d0 0x7f8ffc0bae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff9d9b640 1 -- 172.21.15.83:0/949942529 >> v2:172.21.15.77:3300/0 conn(0x7f8ffc15f3d0 msgr2=0x7f8ffc0bae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:21.006 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff9d9b640 1 --2- 172.21.15.83:0/949942529 >> v2:172.21.15.77:3300/0 conn(0x7f8ffc15f3d0 0x7f8ffc0bae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff959a640 1 -- 172.21.15.83:0/949942529 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850680569 0 0) 0x7f8ffc0d4f80 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff9d9b640 1 -- 172.21.15.83:0/949942529 >> v1:172.21.15.83:6789/0 conn(0x7f8ffc0b6c40 legacy=0x7f8ffc06d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff9d9b640 1 -- 172.21.15.83:0/949942529 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0d4310 con 0x7f8ffc0d4b10 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ffa59c640 1 --2- 172.21.15.83:0/949942529 >> v2:172.21.15.77:3300/0 conn(0x7f8ffc15f3d0 0x7f8ffc0bae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff9d9b640 1 --2- 172.21.15.83:0/949942529 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0d4b10 0x7f8ffc0d0000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40097a0 tx=0x7f8fe402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bc2caf15429f517 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff959a640 1 -- 172.21.15.83:0/949942529 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4037070 con 0x7f8ffc0d4b10 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff959a640 1 -- 172.21.15.83:0/949942529 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe402ae50 con 0x7f8ffc0d4b10 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.005+0000 7f8ff959a640 1 -- 172.21.15.83:0/949942529 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4032660 con 0x7f8ffc0d4b10 2024-05-15T12:09:21.007 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 -- 172.21.15.83:0/949942529 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0d4b10 msgr2=0x7f8ffc0d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 --2- 172.21.15.83:0/949942529 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0d4b10 0x7f8ffc0d0000 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40097a0 tx=0x7f8fe402a100 comp rx=0 tx=0).stop 2024-05-15T12:09:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 -- 172.21.15.83:0/949942529 shutdown_connections 2024-05-15T12:09:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 --2- 172.21.15.83:0/949942529 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0d4b10 0x7f8ffc0d0000 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 --2- 172.21.15.83:0/949942529 >> v2:172.21.15.77:3300/0 conn(0x7f8ffc15f3d0 0x7f8ffc0bae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.008 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 -- 172.21.15.83:0/949942529 >> 172.21.15.83:0/949942529 conn(0x7f8ffc074150 msgr2=0x7f8ffc0d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 -- 172.21.15.83:0/949942529 shutdown_connections 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.006+0000 7f9000f46640 1 -- 172.21.15.83:0/949942529 wait complete. 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.007+0000 7f9000f46640 1 Processor -- start 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.007+0000 7f9000f46640 1 -- start start 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f9000f46640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 0x7f8ffc0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f9000f46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ffc0d4b10 0x7f8ffc0cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f9000f46640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ffc15f3d0 0x7f8ffc0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f9000f46640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc15f7b0 con 0x7f8ffc0d4b10 2024-05-15T12:09:21.009 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f9000f46640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc0d0540 con 0x7f8ffc15f3d0 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f9000f46640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f8ffc0b7090 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 0x7f8ffc0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 0x7f8ffc0ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:35268/0 (socket says 172.21.15.83:35268) 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 -- 172.21.15.83:0/1458261706 learned_addr learned my addr 172.21.15.83:0/1458261706 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffad9d640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ffc15f3d0 0x7f8ffc0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ff9d9b640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ffc0d4b10 0x7f8ffc0cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.010 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 -- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ffc15f3d0 msgr2=0x7f8ffc0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ffc15f3d0 0x7f8ffc0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 -- 172.21.15.83:0/1458261706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ffc0d4b10 msgr2=0x7f8ffc0cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ffc0d4b10 0x7f8ffc0cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.008+0000 7f8ffa59c640 1 -- 172.21.15.83:0/1458261706 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc0ce720 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f8ffa59c640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 0x7f8ffc0ce1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c7f0 tx=0x7f8fec00ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec015070 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec007820 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.011 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc1f4b70 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec007bd0 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc1f5130 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8fec018070 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.009+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f8fec0119a0 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.012 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.010+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc06a640 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.012+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8fec011c80 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.078 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.083+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a6c86551-eeab-4d74-bf49-db221ec4bbd4", "id": 2} v 0) -- 0x7f8ffc0c8870 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.081 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.086+0000 7f8ff2ffd640 1 -- 172.21.15.83:0/1458261706 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6c86551-eeab-4d74-bf49-db221ec4bbd4", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f8fec011650 con 0x7f8ffc0b6c40 2024-05-15T12:09:21.081 INFO:teuthology.orchestra.run.smithi083.stdout:2 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 msgr2=0x7f8ffc0ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 0x7f8ffc0ce1e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00c7f0 tx=0x7f8fec00ccb0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 shutdown_connections 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8ffc15f3d0 0x7f8ffc0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ffc0d4b10 0x7f8ffc0cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 --2- 172.21.15.83:0/1458261706 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8ffc0b6c40 0x7f8ffc0ce1e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.082 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 >> 172.21.15.83:0/1458261706 conn(0x7f8ffc074150 msgr2=0x7f8ffc0b47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 shutdown_connections 2024-05-15T12:09:21.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.087+0000 7f9000f46640 1 -- 172.21.15.83:0/1458261706 wait complete. 2024-05-15T12:09:21.092 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 2c9ea503-e247-4b68-889d-2602fa53a867 3 2024-05-15T12:09:21.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.199+0000 7f8e56846640 1 Processor -- start 2024-05-15T12:09:21.194 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.199+0000 7f8e56846640 1 -- start start 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e56846640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 0x7f8e500b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e56846640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e50161c50 con 0x7f8e501615e0 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e56846640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e500b30f0 con 0x7f8e5009ba30 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e56846640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f8e500b33d0 con 0x7f8e5015d1d0 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 0x7f8e500b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 0x7f8e500b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:35274/0 (socket says 172.21.15.83:35274) 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e4ffff640 1 -- 172.21.15.83:0/400886508 learned_addr learned my addr 172.21.15.83:0/400886508 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.200+0000 7f8e4f7fe640 1 --1- 172.21.15.83:0/400886508 >> v1:172.21.15.83:6789/0 conn(0x7f8e5009ba30 0x7f8e50160ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.83:36512/0 (socket says 172.21.15.83:36512) 2024-05-15T12:09:21.196 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.201+0000 7f8e4effd640 1 -- 172.21.15.83:0/400886508 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102359124 0 0) 0x7f8e500b30f0 con 0x7f8e5009ba30 2024-05-15T12:09:21.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.201+0000 7f8e4ffff640 1 -- 172.21.15.83:0/400886508 >> v1:172.21.15.83:6789/0 conn(0x7f8e5009ba30 legacy=0x7f8e50160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.201+0000 7f8e4ffff640 1 -- 172.21.15.83:0/400886508 >> v1:172.21.15.77:6789/0 conn(0x7f8e501615e0 legacy=0x7f8e500d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.201+0000 7f8e4ffff640 1 -- 172.21.15.83:0/400886508 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e500b36b0 con 0x7f8e5015d1d0 2024-05-15T12:09:21.197 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.201+0000 7f8e4ffff640 1 --2- 172.21.15.83:0/400886508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 0x7f8e500b3bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098a0 tx=0x7f8e4002a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fc2a131c6bf90af server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e4effd640 1 -- 172.21.15.83:0/400886508 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40037070 con 0x7f8e5015d1d0 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e4effd640 1 -- 172.21.15.83:0/400886508 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e40032640 con 0x7f8e5015d1d0 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e4effd640 1 -- 172.21.15.83:0/400886508 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40032a10 con 0x7f8e5015d1d0 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 -- 172.21.15.83:0/400886508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 msgr2=0x7f8e500b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 --2- 172.21.15.83:0/400886508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 0x7f8e500b3bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e400098a0 tx=0x7f8e4002a2e0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 -- 172.21.15.83:0/400886508 shutdown_connections 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 --2- 172.21.15.83:0/400886508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e5015d1d0 0x7f8e500b3bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 -- 172.21.15.83:0/400886508 >> 172.21.15.83:0/400886508 conn(0x7f8e500d3050 msgr2=0x7f8e500d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 -- 172.21.15.83:0/400886508 shutdown_connections 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.202+0000 7f8e56846640 1 -- 172.21.15.83:0/400886508 wait complete. 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.204+0000 7f8e56846640 1 Processor -- start 2024-05-15T12:09:21.199 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.204+0000 7f8e56846640 1 -- start start 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.204+0000 7f8e56846640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 0x7f8e500afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.204+0000 7f8e56846640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e5015d1d0 0x7f8e50156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e56846640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e501615e0 0x7f8e500b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e56846640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5015d5b0 con 0x7f8e5015d1d0 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e56846640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f8e5009beb0 con 0x7f8e5009ba30 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e56846640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f8e500b0420 con 0x7f8e501615e0 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 0x7f8e500afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e54de3640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e501615e0 0x7f8e500b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 0x7f8e500afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37360/0 (socket says 172.21.15.83:37360) 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 -- 172.21.15.83:0/468393195 learned_addr learned my addr 172.21.15.83:0/468393195 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4f7fe640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e5015d1d0 0x7f8e50156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 -- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e501615e0 msgr2=0x7f8e500b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.202 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e501615e0 0x7f8e500b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 -- 172.21.15.83:0/468393195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e5015d1d0 msgr2=0x7f8e50156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e5015d1d0 0x7f8e50156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 -- 172.21.15.83:0/468393195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e500b0700 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4ffff640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 0x7f8e500afd80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e40000c00 tx=0x7f8e400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40041020 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e40030970 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e40037040 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e500b09e0 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.205+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e500b0fa0 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.206+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8e40044020 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.206+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8e400325a0 con 0x7f8e5009ba30 2024-05-15T12:09:21.203 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.206+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e500694d0 con 0x7f8e5009ba30 2024-05-15T12:09:21.204 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.208+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8e500694d0 con 0x7f8e5009ba30 2024-05-15T12:09:21.276 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.281+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c9ea503-e247-4b68-889d-2602fa53a867", "id": 3} v 0) -- 0x7f8e500c6970 con 0x7f8e5009ba30 2024-05-15T12:09:21.279 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.284+0000 7f8e4cff9640 1 -- 172.21.15.83:0/468393195 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c9ea503-e247-4b68-889d-2602fa53a867", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8e500c6970 con 0x7f8e5009ba30 2024-05-15T12:09:21.279 INFO:teuthology.orchestra.run.smithi083.stdout:3 2024-05-15T12:09:21.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 msgr2=0x7f8e500afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.280 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 0x7f8e500afd80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8e40000c00 tx=0x7f8e400046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 shutdown_connections 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8e501615e0 0x7f8e500b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e5015d1d0 0x7f8e50156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 --2- 172.21.15.83:0/468393195 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8e5009ba30 0x7f8e500afd80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 >> 172.21.15.83:0/468393195 conn(0x7f8e500d3050 msgr2=0x7f8e500b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 shutdown_connections 2024-05-15T12:09:21.281 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.285+0000 7f8e56846640 1 -- 172.21.15.83:0/468393195 wait complete. 2024-05-15T12:09:21.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab 4 2024-05-15T12:09:21.300 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.305+0000 7f0a69120040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T12:09:21.355 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.361+0000 7fd5e0a93040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-15T12:09:21.387 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.392+0000 7f0a69120040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T12:09:21.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.400+0000 7f1282946640 1 Processor -- start 2024-05-15T12:09:21.395 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.400+0000 7f1282946640 1 -- start start 2024-05-15T12:09:21.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f1282946640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f127c15d530 0x7f127c0cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f1282946640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f127c0d1610 0x7f127c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f1282946640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f127c0cea30 con 0x7f127c0ce580 2024-05-15T12:09:21.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f1282946640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f127c0afd10 con 0x7f127c0d1610 2024-05-15T12:09:21.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f1282946640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f127c0b02d0 con 0x7f127c15d530 2024-05-15T12:09:21.397 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f127bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f127c15d530 0x7f127c0cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f127bfff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f127c15d530 0x7f127c0cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37374/0 (socket says 172.21.15.83:37374) 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f127bfff640 1 -- 172.21.15.83:0/1642394856 learned_addr learned my addr 172.21.15.83:0/1642394856 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.401+0000 7f127b7fe640 1 --2- 172.21.15.83:0/1642394856 >> v2:172.21.15.77:3300/0 conn(0x7f127c0d1610 0x7f127c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127bfff640 1 -- 172.21.15.83:0/1642394856 >> v2:172.21.15.77:3300/0 conn(0x7f127c0d1610 msgr2=0x7f127c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127bfff640 1 --2- 172.21.15.83:0/1642394856 >> v2:172.21.15.77:3300/0 conn(0x7f127c0d1610 0x7f127c0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127bfff640 1 -- 172.21.15.83:0/1642394856 >> v1:172.21.15.77:6789/0 conn(0x7f127c0ce580 legacy=0x7f127c09ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127bfff640 1 -- 172.21.15.83:0/1642394856 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c0d1ad0 con 0x7f127c15d530 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127bfff640 1 --2- 172.21.15.83:0/1642394856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c0cdb00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f127c072d60 tx=0x7f126c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40bd3fa48e46dc0e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127affd640 1 -- 172.21.15.83:0/1642394856 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c037070 con 0x7f127c15d530 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.402+0000 7f127affd640 1 -- 172.21.15.83:0/1642394856 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c032440 con 0x7f127c15d530 2024-05-15T12:09:21.398 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f127affd640 1 -- 172.21.15.83:0/1642394856 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f126c032810 con 0x7f127c15d530 2024-05-15T12:09:21.399 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 -- 172.21.15.83:0/1642394856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 msgr2=0x7f127c0cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 --2- 172.21.15.83:0/1642394856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c0cdb00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f127c072d60 tx=0x7f126c02a270 comp rx=0 tx=0).stop 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 -- 172.21.15.83:0/1642394856 shutdown_connections 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 --2- 172.21.15.83:0/1642394856 >> v2:172.21.15.77:3300/0 conn(0x7f127c0d1610 0x7f127c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 --2- 172.21.15.83:0/1642394856 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c0cdb00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 -- 172.21.15.83:0/1642394856 >> 172.21.15.83:0/1642394856 conn(0x7f127c0b4b50 msgr2=0x7f127c0b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 -- 172.21.15.83:0/1642394856 shutdown_connections 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.403+0000 7f1282946640 1 -- 172.21.15.83:0/1642394856 wait complete. 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.405+0000 7f1282946640 1 Processor -- start 2024-05-15T12:09:21.400 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.405+0000 7f1282946640 1 -- start start 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.406+0000 7f1282946640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f127c0ce580 0x7f127c145650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0d1610 0x7f127c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0b5830 con 0x7f127c0d1610 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0aff60 con 0x7f127c15d530 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f127c0b59b0 con 0x7f127c0ce580 2024-05-15T12:09:21.403 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f127bfff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f127c0ce580 0x7f127c145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c1522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:37384/0 (socket says 172.21.15.83:37384) 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 -- 172.21.15.83:0/3781441019 learned_addr learned my addr 172.21.15.83:0/3781441019 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f127b7fe640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0d1610 0x7f127c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 -- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f127c0ce580 msgr2=0x7f127c145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f127c0ce580 0x7f127c145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 -- 172.21.15.83:0/3781441019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0d1610 msgr2=0x7f127c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0d1610 0x7f127c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 -- 172.21.15.83:0/3781441019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c0b7630 con 0x7f127c15d530 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f127bfff640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f127c0ce580 0x7f127c145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1280ee3640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c1522c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f127400c730 tx=0x7f127400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274003b70 con 0x7f127c15d530 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1274003d10 con 0x7f127c15d530 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c0b78d0 con 0x7f127c15d530 2024-05-15T12:09:21.404 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127400aa70 con 0x7f127c15d530 2024-05-15T12:09:21.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.407+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c0b7e90 con 0x7f127c15d530 2024-05-15T12:09:21.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.408+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f127400ac10 con 0x7f127c15d530 2024-05-15T12:09:21.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.408+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1274012a20 con 0x7f127c15d530 2024-05-15T12:09:21.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.408+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127c0694d0 con 0x7f127c15d530 2024-05-15T12:09:21.405 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.410+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f127c0cea30 con 0x7f127c15d530 2024-05-15T12:09:21.430 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.435+0000 7f0a69120040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T12:09:21.449 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.454+0000 7fd5e0a93040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-15T12:09:21.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.483+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab", "id": 4} v 0) -- 0x7f127c071470 con 0x7f127c15d530 2024-05-15T12:09:21.483 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.489+0000 7f1278ff9640 1 -- 172.21.15.83:0/3781441019 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f1274012cc0 con 0x7f127c15d530 2024-05-15T12:09:21.484 INFO:teuthology.orchestra.run.smithi083.stdout:4 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.489+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 msgr2=0x7f127c1522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.489+0000 7f1282946640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c1522c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f127400c730 tx=0x7f127400cbf0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 shutdown_connections 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f127c15d530 0x7f127c1522c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f127c0d1610 0x7f127c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 --2- 172.21.15.83:0/3781441019 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f127c0ce580 0x7f127c145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 >> 172.21.15.83:0/3781441019 conn(0x7f127c0b4b50 msgr2=0x7f127c0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 shutdown_connections 2024-05-15T12:09:21.485 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.490+0000 7f1282946640 1 -- 172.21.15.83:0/3781441019 wait complete. 2024-05-15T12:09:21.495 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new b5e4c411-9357-4134-b26b-63d1f218ce12 5 2024-05-15T12:09:21.496 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.500+0000 7fd5e0a93040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-15T12:09:21.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.600+0000 7f3379f87640 1 Processor -- start 2024-05-15T12:09:21.595 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.600+0000 7f3379f87640 1 -- start start 2024-05-15T12:09:21.596 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.601+0000 7f0a69120040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T12:09:21.598 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3379f87640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f337415f560 0x7f33740af280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3379f87640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 0x7f33740af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3379f87640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33740b4780 con 0x7f337415f180 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3379f87640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f33740b4a60 con 0x7f337415f560 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3379f87640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f33740b4d40 con 0x7f33740ae8a0 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3373fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 0x7f33740af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3373fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 0x7f33740af7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:45756/0 (socket says 172.21.15.83:45756) 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f3373fff640 1 -- 172.21.15.83:0/3246924287 learned_addr learned my addr 172.21.15.83:0/3246924287 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f336bfff640 1 --2- 172.21.15.83:0/3246924287 >> v2:172.21.15.77:3300/0 conn(0x7f337415f560 0x7f33740af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.601+0000 7f33737fe640 1 --1- 172.21.15.83:0/3246924287 >> v1:172.21.15.77:6789/0 conn(0x7f337415f180 0x7f33740681b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.83:59496/0 (socket says 172.21.15.83:59496) 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3373fff640 1 -- 172.21.15.83:0/3246924287 >> v2:172.21.15.77:3300/0 conn(0x7f337415f560 msgr2=0x7f33740af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3373fff640 1 --2- 172.21.15.83:0/3246924287 >> v2:172.21.15.77:3300/0 conn(0x7f337415f560 0x7f33740af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3373fff640 1 -- 172.21.15.83:0/3246924287 >> v1:172.21.15.77:6789/0 conn(0x7f337415f180 legacy=0x7f33740681b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.599 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3373fff640 1 -- 172.21.15.83:0/3246924287 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33740b5020 con 0x7f33740ae8a0 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3373fff640 1 --2- 172.21.15.83:0/3246924287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 0x7f33740af7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f336c009e50 tx=0x7f336c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08eb13c8df4f9e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3372ffd640 1 -- 172.21.15.83:0/3246924287 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c036070 con 0x7f33740ae8a0 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3372ffd640 1 -- 172.21.15.83:0/3246924287 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f336c031600 con 0x7f33740ae8a0 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.602+0000 7f3372ffd640 1 -- 172.21.15.83:0/3246924287 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f336c0319d0 con 0x7f33740ae8a0 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 -- 172.21.15.83:0/3246924287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 msgr2=0x7f33740af7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 --2- 172.21.15.83:0/3246924287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 0x7f33740af7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f336c009e50 tx=0x7f336c02a710 comp rx=0 tx=0).stop 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 -- 172.21.15.83:0/3246924287 shutdown_connections 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 --2- 172.21.15.83:0/3246924287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f33740ae8a0 0x7f33740af7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 --2- 172.21.15.83:0/3246924287 >> v2:172.21.15.77:3300/0 conn(0x7f337415f560 0x7f33740af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 -- 172.21.15.83:0/3246924287 >> 172.21.15.83:0/3246924287 conn(0x7f3374072a50 msgr2=0x7f3374072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.600 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 -- 172.21.15.83:0/3246924287 shutdown_connections 2024-05-15T12:09:21.601 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.603+0000 7f3379f87640 1 -- 172.21.15.83:0/3246924287 wait complete. 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.604+0000 7f3379f87640 1 Processor -- start 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.604+0000 7f3379f87640 1 -- start start 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3379f87640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33740ae8a0 0x7f337415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3379f87640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f337415f180 0x7f337415df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3379f87640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 0x7f3374145d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3379f87640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f33740b59a0 con 0x7f337415f180 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3379f87640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f33740b5820 con 0x7f33740ae8a0 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3379f87640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f33740b5b20 con 0x7f337415f560 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f33737fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33740ae8a0 0x7f337415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.604 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3373fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 0x7f3374145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3373fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 0x7f3374145d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.83:45768/0 (socket says 172.21.15.83:45768) 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f3373fff640 1 -- 172.21.15.83:0/1476252647 learned_addr learned my addr 172.21.15.83:0/1476252647 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.605+0000 7f336bfff640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f337415f180 0x7f337415df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f33737fe640 1 -- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 msgr2=0x7f3374145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f33737fe640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 0x7f3374145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f33737fe640 1 -- 172.21.15.83:0/1476252647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f337415f180 msgr2=0x7f337415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f33737fe640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f337415f180 0x7f337415df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f33737fe640 1 -- 172.21.15.83:0/1476252647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3374162810 con 0x7f33740ae8a0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3373fff640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 0x7f3374145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f33737fe640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33740ae8a0 0x7f337415b9d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f336400c3c0 tx=0x7f336400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640074e0 con 0x7f33740ae8a0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3364007680 con 0x7f33740ae8a0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33640049e0 con 0x7f33740ae8a0 2024-05-15T12:09:21.605 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f337415ac50 con 0x7f33740ae8a0 2024-05-15T12:09:21.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f337415b4b0 con 0x7f33740ae8a0 2024-05-15T12:09:21.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3364004b80 con 0x7f33740ae8a0 2024-05-15T12:09:21.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.606+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f3364012970 con 0x7f33740ae8a0 2024-05-15T12:09:21.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.607+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33740694d0 con 0x7f33740ae8a0 2024-05-15T12:09:21.606 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.609+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3364012c90 con 0x7f33740ae8a0 2024-05-15T12:09:21.661 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.667+0000 7f0a69120040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T12:09:21.668 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.673+0000 7fd5e0a93040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-15T12:09:21.676 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.681+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5e4c411-9357-4134-b26b-63d1f218ce12", "id": 5} v 0) -- 0x7f3374073d00 con 0x7f33740ae8a0 2024-05-15T12:09:21.681 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.687+0000 7f3370ff9640 1 -- 172.21.15.83:0/1476252647 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5e4c411-9357-4134-b26b-63d1f218ce12", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f33640123f0 con 0x7f33740ae8a0 2024-05-15T12:09:21.682 INFO:teuthology.orchestra.run.smithi083.stdout:5 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33740ae8a0 msgr2=0x7f337415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33740ae8a0 0x7f337415b9d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f336400c3c0 tx=0x7f336400c880 comp rx=0 tx=0).stop 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 shutdown_connections 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f337415f560 0x7f3374145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f337415f180 0x7f337415df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 --2- 172.21.15.83:0/1476252647 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f33740ae8a0 0x7f337415b9d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 >> 172.21.15.83:0/1476252647 conn(0x7f3374072a50 msgr2=0x7f33740af180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 shutdown_connections 2024-05-15T12:09:21.683 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.688+0000 7f3379f87640 1 -- 172.21.15.83:0/1476252647 wait complete. 2024-05-15T12:09:21.694 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 06b7dd78-d345-4a6f-b118-1f3a640c59e4 6 2024-05-15T12:09:21.714 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.719+0000 7f0a69120040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T12:09:21.728 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.734+0000 7fd5e0a93040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-15T12:09:21.784 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.789+0000 7fd5e0a93040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-15T12:09:21.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.798+0000 7f6b76d9e640 1 Processor -- start 2024-05-15T12:09:21.793 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.798+0000 7f6b76d9e640 1 -- start start 2024-05-15T12:09:21.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b76d9e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6b7006d400 0x7f6b700b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.797 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b76d9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b7015d740 0x7f6b7015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b76d9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b700b1000 con 0x7f6b70160580 2024-05-15T12:09:21.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b76d9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7015c690 con 0x7f6b7015d740 2024-05-15T12:09:21.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b76d9e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7015c970 con 0x7f6b7006d400 2024-05-15T12:09:21.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b75d9c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6b7006d400 0x7f6b700b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b75d9c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6b7006d400 0x7f6b700b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48182/0 (socket says 172.21.15.83:48182) 2024-05-15T12:09:21.798 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b75d9c640 1 -- 172.21.15.83:0/4155010451 learned_addr learned my addr 172.21.15.83:0/4155010451 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b7659d640 1 --2- 172.21.15.83:0/4155010451 >> v2:172.21.15.77:3300/0 conn(0x7f6b7015d740 0x7f6b7015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b75d9c640 1 -- 172.21.15.83:0/4155010451 >> v2:172.21.15.77:3300/0 conn(0x7f6b7015d740 msgr2=0x7f6b7015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:21.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.799+0000 7f6b75d9c640 1 --2- 172.21.15.83:0/4155010451 >> v2:172.21.15.77:3300/0 conn(0x7f6b7015d740 0x7f6b7015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.800+0000 7f6b75d9c640 1 -- 172.21.15.83:0/4155010451 >> v1:172.21.15.77:6789/0 conn(0x7f6b70160580 legacy=0x7f6b7006d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.800+0000 7f6b75d9c640 1 -- 172.21.15.83:0/4155010451 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7015cc50 con 0x7f6b7006d400 2024-05-15T12:09:21.799 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.800+0000 7f6b75d9c640 1 --2- 172.21.15.83:0/4155010451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7006d400 0x7f6b700b0a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b700762a0 tx=0x7f6b6402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9e118dfeb080de server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.800+0000 7f6b74d9a640 1 -- 172.21.15.83:0/4155010451 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64037070 con 0x7f6b7006d400 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.800+0000 7f6b74d9a640 1 -- 172.21.15.83:0/4155010451 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b64032440 con 0x7f6b7006d400 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.800+0000 7f6b74d9a640 1 -- 172.21.15.83:0/4155010451 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64032810 con 0x7f6b7006d400 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 -- 172.21.15.83:0/4155010451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7006d400 msgr2=0x7f6b700b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/4155010451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7006d400 0x7f6b700b0a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6b700762a0 tx=0x7f6b6402a270 comp rx=0 tx=0).stop 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 -- 172.21.15.83:0/4155010451 shutdown_connections 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/4155010451 >> v2:172.21.15.77:3300/0 conn(0x7f6b7015d740 0x7f6b7015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/4155010451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7006d400 0x7f6b700b0a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 -- 172.21.15.83:0/4155010451 >> 172.21.15.83:0/4155010451 conn(0x7f6b70072a10 msgr2=0x7f6b70072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.800 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 -- 172.21.15.83:0/4155010451 shutdown_connections 2024-05-15T12:09:21.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.801+0000 7f6b76d9e640 1 -- 172.21.15.83:0/4155010451 wait complete. 2024-05-15T12:09:21.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.802+0000 7f6b76d9e640 1 Processor -- start 2024-05-15T12:09:21.801 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.802+0000 7f6b76d9e640 1 -- start start 2024-05-15T12:09:21.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b76d9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b7006d400 0x7f6b701501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b76d9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 0x7f6b7013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b76d9e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b70160580 0x7f6b7015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:21.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b76d9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7015d450 con 0x7f6b7006d400 2024-05-15T12:09:21.803 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b76d9e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70153440 con 0x7f6b7015d740 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b76d9e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f6b70160a00 con 0x7f6b70160580 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b7559b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 0x7f6b7013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b7659d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b70160580 0x7f6b7015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b7559b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 0x7f6b7013f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48184/0 (socket says 172.21.15.83:48184) 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b7559b640 1 -- 172.21.15.83:0/2614573137 learned_addr learned my addr 172.21.15.83:0/2614573137 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.803+0000 7f6b75d9c640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b7006d400 0x7f6b701501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b7559b640 1 -- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b70160580 msgr2=0x7f6b7015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b7559b640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b70160580 0x7f6b7015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b7559b640 1 -- 172.21.15.83:0/2614573137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b7006d400 msgr2=0x7f6b701501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b7559b640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b7006d400 0x7f6b701501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b7559b640 1 -- 172.21.15.83:0/2614573137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7013fdc0 con 0x7f6b7015d740 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b7559b640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 0x7f6b7013f880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c3a0 tx=0x7f6b6c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c017070 con 0x7f6b7015d740 2024-05-15T12:09:21.804 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6c0052d0 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c003830 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b701507f0 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b70150db0 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6b6c01a070 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.804+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f6b6c011b30 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.805+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b700768e0 con 0x7f6b7015d740 2024-05-15T12:09:21.805 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.807+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6b6c021020 con 0x7f6b7015d740 2024-05-15T12:09:21.827 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:21.832+0000 7f0a69120040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T12:09:21.875 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.880+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "06b7dd78-d345-4a6f-b118-1f3a640c59e4", "id": 6} v 0) -- 0x7f6b700737e0 con 0x7f6b7015d740 2024-05-15T12:09:21.880 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.885+0000 7f6b627fc640 1 -- 172.21.15.83:0/2614573137 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "06b7dd78-d345-4a6f-b118-1f3a640c59e4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f6b7013fdc0 con 0x7f6b7015d740 2024-05-15T12:09:21.881 INFO:teuthology.orchestra.run.smithi083.stdout:6 2024-05-15T12:09:21.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 msgr2=0x7f6b7013f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:21.882 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 0x7f6b7013f880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00c3a0 tx=0x7f6b6c00c860 comp rx=0 tx=0).stop 2024-05-15T12:09:21.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 shutdown_connections 2024-05-15T12:09:21.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b70160580 0x7f6b7015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b7015d740 0x7f6b7013f880 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 --2- 172.21.15.83:0/2614573137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b7006d400 0x7f6b701501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:21.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 >> 172.21.15.83:0/2614573137 conn(0x7f6b70072a10 msgr2=0x7f6b700d0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:21.883 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 shutdown_connections 2024-05-15T12:09:21.884 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:21.886+0000 7f6b76d9e640 1 -- 172.21.15.83:0/2614573137 wait complete. 2024-05-15T12:09:21.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --cluster ceph osd new 5c8b4206-3b10-4eb0-a459-a06f62505354 7 2024-05-15T12:09:21.902 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:21.907+0000 7fd5e0a93040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-15T12:09:22.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.007+0000 7f3484846640 1 Processor -- start 2024-05-15T12:09:22.002 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.007+0000 7f3484846640 1 -- start start 2024-05-15T12:09:22.013 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f3484846640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3480148210 0x7f34800b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f3484846640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3480148ce0 0x7f3480074110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f3484846640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34801489e0 con 0x7f348006c3f0 2024-05-15T12:09:22.014 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f3484846640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f34801485f0 con 0x7f3480148210 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f3484846640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f3480148790 con 0x7f3480148ce0 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3480148ce0 0x7f3480074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f3480148ce0 0x7f3480074110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48194/0 (socket says 172.21.15.83:48194) 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 -- 172.21.15.83:0/2341456261 learned_addr learned my addr 172.21.15.83:0/2341456261 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347e59c640 1 --2- 172.21.15.83:0/2341456261 >> v2:172.21.15.77:3300/0 conn(0x7f3480148210 0x7f34800b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 -- 172.21.15.83:0/2341456261 >> v2:172.21.15.77:3300/0 conn(0x7f3480148210 msgr2=0x7f34800b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:22.015 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 --2- 172.21.15.83:0/2341456261 >> v2:172.21.15.77:3300/0 conn(0x7f3480148210 0x7f34800b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 -- 172.21.15.83:0/2341456261 >> v1:172.21.15.77:6789/0 conn(0x7f348006c3f0 legacy=0x7f34800707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347dd9b640 1 -- 172.21.15.83:0/2341456261 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3480073350 con 0x7f3480148ce0 2024-05-15T12:09:22.016 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.008+0000 7f347e59c640 1 --2- 172.21.15.83:0/2341456261 >> v2:172.21.15.77:3300/0 conn(0x7f3480148210 0x7f34800b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:22.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.009+0000 7f347dd9b640 1 --2- 172.21.15.83:0/2341456261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148ce0 0x7f3480074110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f348006ef60 tx=0x7f347002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=862d2280e1b60fd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:22.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.009+0000 7f347d59a640 1 -- 172.21.15.83:0/2341456261 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470037070 con 0x7f3480148ce0 2024-05-15T12:09:22.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.009+0000 7f347d59a640 1 -- 172.21.15.83:0/2341456261 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3470032440 con 0x7f3480148ce0 2024-05-15T12:09:22.017 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.009+0000 7f347d59a640 1 -- 172.21.15.83:0/2341456261 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470032810 con 0x7f3480148ce0 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 -- 172.21.15.83:0/2341456261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148ce0 msgr2=0x7f3480074110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 --2- 172.21.15.83:0/2341456261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148ce0 0x7f3480074110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f348006ef60 tx=0x7f347002a270 comp rx=0 tx=0).stop 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 -- 172.21.15.83:0/2341456261 shutdown_connections 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 --2- 172.21.15.83:0/2341456261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148ce0 0x7f3480074110 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 --2- 172.21.15.83:0/2341456261 >> v2:172.21.15.77:3300/0 conn(0x7f3480148210 0x7f34800b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 -- 172.21.15.83:0/2341456261 >> 172.21.15.83:0/2341456261 conn(0x7f34800d1f30 msgr2=0x7f34800d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 -- 172.21.15.83:0/2341456261 shutdown_connections 2024-05-15T12:09:22.018 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.010+0000 7f3484846640 1 -- 172.21.15.83:0/2341456261 wait complete. 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.011+0000 7f3484846640 1 Processor -- start 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.011+0000 7f3484846640 1 -- start start 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f3484846640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006c3f0 0x7f348015ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f3484846640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 0x7f348015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f3484846640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480148ce0 0x7f3480161fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f3484846640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3480073bf0 con 0x7f348006c3f0 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f3484846640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3480073910 con 0x7f3480148210 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f3484846640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f34800b5c40 con 0x7f3480148ce0 2024-05-15T12:09:22.019 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 0x7f348015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 0x7f348015fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.83:48200/0 (socket says 172.21.15.83:48200) 2024-05-15T12:09:22.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 -- 172.21.15.83:0/497500771 learned_addr learned my addr 172.21.15.83:0/497500771 (peer_addr_for_me v2:172.21.15.83:0/0) 2024-05-15T12:09:22.020 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347ed9d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480148ce0 0x7f3480161fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347e59c640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006c3f0 0x7f348015ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 -- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480148ce0 msgr2=0x7f3480161fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480148ce0 0x7f3480161fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 -- 172.21.15.83:0/497500771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006c3f0 msgr2=0x7f348015ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.021 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006c3f0 0x7f348015ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347dd9b640 1 -- 172.21.15.83:0/497500771 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34800b05e0 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.012+0000 7f347ed9d640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480148ce0 0x7f3480161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f347dd9b640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 0x7f348015fac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f347002a2b0 tx=0x7f34700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470041020 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34700306c0 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34800b08c0 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3470037040 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34800b0e80 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3470044020 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.013+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f347003dcd0 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.014+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34800b2ec0 con 0x7f3480148210 2024-05-15T12:09:22.022 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.016+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f34800b2ec0 con 0x7f3480148210 2024-05-15T12:09:22.083 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.089+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5c8b4206-3b10-4eb0-a459-a06f62505354", "id": 7} v 0) -- 0x7f34800694d0 con 0x7f3480148210 2024-05-15T12:09:22.089 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.094+0000 7f3476ffd640 1 -- 172.21.15.83:0/497500771 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5c8b4206-3b10-4eb0-a459-a06f62505354", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f347004b030 con 0x7f3480148210 2024-05-15T12:09:22.089 INFO:teuthology.orchestra.run.smithi083.stdout:7 2024-05-15T12:09:22.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 msgr2=0x7f348015fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 0x7f348015fac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f347002a2b0 tx=0x7f34700046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 shutdown_connections 2024-05-15T12:09:22.091 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3480148ce0 0x7f3480161fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3480148210 0x7f348015fac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 --2- 172.21.15.83:0/497500771 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f348006c3f0 0x7f348015ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 >> 172.21.15.83:0/497500771 conn(0x7f34800d1f30 msgr2=0x7f34800b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 shutdown_connections 2024-05-15T12:09:22.092 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:09:22.095+0000 7f3484846640 1 -- 172.21.15.83:0/497500771 wait complete. 2024-05-15T12:09:22.101 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-15T12:09:22.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-15T12:09:22.104 INFO:tasks.ceph.osd.0:Started 2024-05-15T12:09:22.104 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-15T12:09:22.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-15T12:09:22.107 INFO:tasks.ceph.osd.1:Started 2024-05-15T12:09:22.107 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-15T12:09:22.107 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-15T12:09:22.109 INFO:tasks.ceph.osd.2:Started 2024-05-15T12:09:22.109 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-15T12:09:22.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-15T12:09:22.111 INFO:tasks.ceph.osd.3:Started 2024-05-15T12:09:22.112 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-15T12:09:22.112 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-15T12:09:22.114 INFO:tasks.ceph.osd.4:Started 2024-05-15T12:09:22.114 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-15T12:09:22.114 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-15T12:09:22.117 INFO:tasks.ceph.osd.5:Started 2024-05-15T12:09:22.117 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-15T12:09:22.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-15T12:09:22.120 INFO:tasks.ceph.osd.6:Started 2024-05-15T12:09:22.121 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-15T12:09:22.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-15T12:09:22.124 INFO:tasks.ceph.osd.7:Started 2024-05-15T12:09:22.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:22.244 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:22.249+0000 7f0a69120040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T12:09:22.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.253+0000 7f983e14e640 1 Processor -- start 2024-05-15T12:09:22.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.253+0000 7f983e14e640 1 -- start start 2024-05-15T12:09:22.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f983e14e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f98380b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f983e14e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98381600a0 con 0x7f9838145cd0 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f983e14e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9838160380 con 0x7f9838145100 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f983e14e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f9838160cb0 con 0x7f9838145780 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f9837fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9838145cd0 0x7f98380b5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56390/0 (socket says 172.21.15.77:56390) 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f9837fff640 1 -- 172.21.15.77:0/2742788969 learned_addr learned my addr 172.21.15.77:0/2742788969 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f9836ffd640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f98380b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634092927 0 0) 0x7f98381600a0 con 0x7f9838145cd0 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.254+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9820003520 con 0x7f9838145cd0 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065211601 0 0) 0x7f9838160380 con 0x7f9838145100 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98381600a0 con 0x7f9838145100 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2280307707 0 0) 0x7f9820003520 con 0x7f9838145cd0 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 msgr2=0x7f98380b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f98380b62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 >> v1:172.21.15.83:6789/0 conn(0x7f9838145100 legacy=0x7f98380cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9838160660 con 0x7f9838145cd0 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f98300019f0 con 0x7f9838145cd0 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f9836ffd640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f98380b62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 >> v1:172.21.15.77:6789/0 conn(0x7f9838145cd0 legacy=0x7f98380b5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9820003cd0 0x7f98200040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9820004800 0x7f9820004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f982000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9820005560 con 0x7f9820003cd0 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f982000bf00 con 0x7f9820004800 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f982000c080 con 0x7f9838145780 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98377fe640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9820003cd0 0x7f98200040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f9837fff640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f982000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f9836ffd640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9820004800 0x7f9820004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98377fe640 1 -- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 msgr2=0x7f982000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:22.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98377fe640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9838145780 0x7f982000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98377fe640 1 -- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9820004800 msgr2=0x7f9820004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98377fe640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9820004800 0x7f9820004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.255+0000 7f98377fe640 1 -- 172.21.15.77:0/2742788969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9820003520 con 0x7f9820003cd0 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.256+0000 7f98377fe640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9820003cd0 0x7f98200040d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f982c001900 tx=0x7f9820005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40c70370907ee7c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.256+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c001520 con 0x7f9820003cd0 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.256+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f982c02acd0 con 0x7f9820003cd0 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.256+0000 7f98367fc640 1 -- 172.21.15.77:0/2742788969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c005310 con 0x7f9820003cd0 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f983e14e640 1 -- 172.21.15.77:0/2742788969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9820003cd0 msgr2=0x7f98200040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f983e14e640 1 --2- 172.21.15.77:0/2742788969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9820003cd0 0x7f98200040d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f982c001900 tx=0x7f9820005830 comp rx=0 tx=0).stop 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f9837fff640 1 -- 172.21.15.77:0/2742788969 reap_dead start 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f983e14e640 1 -- 172.21.15.77:0/2742788969 shutdown_connections 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f983e14e640 1 -- 172.21.15.77:0/2742788969 >> 172.21.15.77:0/2742788969 conn(0x7f98380b3ca0 msgr2=0x7f98380b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f983e14e640 1 -- 172.21.15.77:0/2742788969 shutdown_connections 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.257+0000 7f983e14e640 1 -- 172.21.15.77:0/2742788969 wait complete. 2024-05-15T12:09:22.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.258+0000 7f983e14e640 1 Processor -- start 2024-05-15T12:09:22.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.258+0000 7f983e14e640 1 -- start start 2024-05-15T12:09:22.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f983e14e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9820003cd0 0x7f983813be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f983e14e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98380cb7f0 0x7f98380d0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f983e14e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 0x7f9838070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f983e14e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f983815fd30 con 0x7f98380707f0 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f983e14e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f98381454e0 con 0x7f98380cb7f0 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f983e14e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f98380b5990 con 0x7f9820003cd0 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 0x7f9838070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 0x7f9838070c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36556/0 (socket says 172.21.15.77:36556) 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 -- 172.21.15.77:0/3316880516 learned_addr learned my addr 172.21.15.77:0/3316880516 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9836ffd640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98380cb7f0 0x7f98380d0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f98377fe640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9820003cd0 0x7f983813be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 -- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9820003cd0 msgr2=0x7f983813be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9820003cd0 0x7f983813be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 -- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98380cb7f0 msgr2=0x7f98380d0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98380cb7f0 0x7f98380d0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 -- 172.21.15.77:0/3316880516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98380cd6a0 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.259+0000 7f9837fff640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 0x7f9838070c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98380b1be0 tx=0x7f9830007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.260+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983000aa90 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.260+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9830019070 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.260+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300133f0 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.260+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98380cd940 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.260+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983815e370 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.261+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9830013590 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.261+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f983001e460 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.261+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98380694d0 con 0x7f98380707f0 2024-05-15T12:09:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.263+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9830013880 con 0x7f98380707f0 2024-05-15T12:09:22.313 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:22.318+0000 7fd5e0a93040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-15T12:09:22.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.324+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9838071d10 con 0x7f98380707f0 2024-05-15T12:09:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.325+0000 7f981ffff640 1 -- 172.21.15.77:0/3316880516 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9830013a60 con 0x7f98380707f0 2024-05-15T12:09:22.321 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:22.321 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:22.090762+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:22.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 msgr2=0x7f9838070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:22.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 0x7f9838070c70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98380b1be0 tx=0x7f9830007b00 comp rx=0 tx=0).stop 2024-05-15T12:09:22.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 shutdown_connections 2024-05-15T12:09:22.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98380707f0 0x7f9838070c70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f98380cb7f0 0x7f98380d0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 --2- 172.21.15.77:0/3316880516 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9820003cd0 0x7f983813be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:22.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 >> 172.21.15.77:0/3316880516 conn(0x7f98380b3ca0 msgr2=0x7f983806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:22.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 shutdown_connections 2024-05-15T12:09:22.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:22.326+0000 7f983e14e640 1 -- 172.21.15.77:0/3316880516 wait complete. 2024-05-15T12:09:22.332 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-15T12:09:22.333 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-15T12:09:22.390 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:22.394+0000 7f0a69120040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-15T12:09:22.453 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:22.458+0000 7fd5e0a93040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-15T12:09:22.648 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:22.653+0000 7f0a69120040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T12:09:22.699 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:22.704+0000 7f0a69120040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T12:09:22.711 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T12:09:22.716+0000 7fba5e2ad640 -1 Falling back to public interface 2024-05-15T12:09:22.714 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:22.719+0000 7fd5e0a93040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-15T12:09:22.714 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T12:09:22.719+0000 7f64703c4640 -1 Falling back to public interface 2024-05-15T12:09:22.722 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:09:22.727+0000 7fc28ea12640 -1 Falling back to public interface 2024-05-15T12:09:22.722 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T12:09:22.727+0000 7f09ac014640 -1 Falling back to public interface 2024-05-15T12:09:22.722 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T12:09:22.727+0000 7f09aaa00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2024-05-15T12:09:22.723 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:09:22.728+0000 7fc28d3f8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2024-05-15T12:09:22.730 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T12:09:22.735+0000 7f16a341a640 -1 Falling back to public interface 2024-05-15T12:09:22.736 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T12:09:22.741+0000 7f71a061a640 -1 Falling back to public interface 2024-05-15T12:09:22.736 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T12:09:22.741+0000 7fbbac7a5640 -1 Falling back to public interface 2024-05-15T12:09:22.744 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T12:09:22.749+0000 7fc8f1030640 -1 Falling back to public interface 2024-05-15T12:09:22.769 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:22.774+0000 7fd5e0a93040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-15T12:09:22.820 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:22.826+0000 7f0a69120040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T12:09:22.885 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:22.890+0000 7fd5e0a93040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-15T12:09:23.119 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.124+0000 7f0a69120040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T12:09:23.138 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:23.168 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.174+0000 7f0a69120040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T12:09:23.182 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.187+0000 7fd5e0a93040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-15T12:09:23.230 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.235+0000 7fd5e0a93040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-15T12:09:23.230 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.235+0000 7feb9c85c640 1 Processor -- start 2024-05-15T12:09:23.231 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.235+0000 7feb9c85c640 1 -- start start 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9c85c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb9815e8d0 0x7feb9815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9c85c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb980cc980 con 0x7feb9815f680 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9c85c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb980ccc60 con 0x7feb980cc480 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9c85c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7feb98074590 con 0x7feb9815e8d0 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb96d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb9815e8d0 0x7feb9815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feb9815f680 0x7feb98073e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42506/0 (socket says 172.21.15.77:42506) 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9659c640 1 -- 172.21.15.77:0/3914975189 learned_addr learned my addr 172.21.15.77:0/3914975189 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.236+0000 7feb9559a640 1 -- 172.21.15.77:0/3914975189 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172488635 0 0) 0x7feb980cc980 con 0x7feb9815f680 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb9559a640 1 -- 172.21.15.77:0/3914975189 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb84003520 con 0x7feb9815f680 2024-05-15T12:09:23.232 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb9559a640 1 -- 172.21.15.77:0/3914975189 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038412354 0 0) 0x7feb980ccc60 con 0x7feb980cc480 2024-05-15T12:09:23.233 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb96d9d640 1 -- 172.21.15.77:0/3914975189 >> v1:172.21.15.83:6789/0 conn(0x7feb980cc480 legacy=0x7feb9815c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:23.233 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb96d9d640 1 -- 172.21.15.77:0/3914975189 >> v1:172.21.15.77:6789/0 conn(0x7feb9815f680 legacy=0x7feb98073e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:23.233 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb96d9d640 1 -- 172.21.15.77:0/3914975189 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb980ccf40 con 0x7feb9815e8d0 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb96d9d640 1 --2- 172.21.15.77:0/3914975189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815e8d0 0x7feb9815ccb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb90009d90 tx=0x7feb9002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361b8d2c3d354f2a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.237+0000 7feb9559a640 1 -- 172.21.15.77:0/3914975189 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90007740 con 0x7feb9815e8d0 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9559a640 1 -- 172.21.15.77:0/3914975189 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb900078e0 con 0x7feb9815e8d0 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9559a640 1 -- 172.21.15.77:0/3914975189 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90007cb0 con 0x7feb9815e8d0 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 -- 172.21.15.77:0/3914975189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815e8d0 msgr2=0x7feb9815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 --2- 172.21.15.77:0/3914975189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815e8d0 0x7feb9815ccb0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feb90009d90 tx=0x7feb9002a6f0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.234 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 -- 172.21.15.77:0/3914975189 shutdown_connections 2024-05-15T12:09:23.235 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 --2- 172.21.15.77:0/3914975189 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815e8d0 0x7feb9815ccb0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.235 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 -- 172.21.15.77:0/3914975189 >> 172.21.15.77:0/3914975189 conn(0x7feb980ce8b0 msgr2=0x7feb980cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:23.235 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 -- 172.21.15.77:0/3914975189 shutdown_connections 2024-05-15T12:09:23.235 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.238+0000 7feb9c85c640 1 -- 172.21.15.77:0/3914975189 wait complete. 2024-05-15T12:09:23.237 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 Processor -- start 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 -- start start 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb980cc480 0x7feb981f4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb9815e8d0 0x7feb9806c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 0x7feb9806c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feb98166fa0 con 0x7feb9815f680 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feb980cd590 con 0x7feb980cc480 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9c85c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7feb98167120 con 0x7feb9815e8d0 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 0x7feb9806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 0x7feb9806c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51054/0 (socket says 172.21.15.77:51054) 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb96d9d640 1 -- 172.21.15.77:0/3872106587 learned_addr learned my addr 172.21.15.77:0/3872106587 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:23.238 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.240+0000 7feb9659c640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb980cc480 0x7feb981f4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb95d9b640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb9815e8d0 0x7feb9806c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb96d9d640 1 -- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb9815e8d0 msgr2=0x7feb9806c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb96d9d640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb9815e8d0 0x7feb9806c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb96d9d640 1 -- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb980cc480 msgr2=0x7feb981f4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb96d9d640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb980cc480 0x7feb981f4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb96d9d640 1 -- 172.21.15.77:0/3872106587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb98164030 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb96d9d640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 0x7feb9806c950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb90009eb0 tx=0x7feb90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90040070 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb90031bc0 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90009450 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb98164310 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb981648d0 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feb90039040 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.241+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7feb90004620 con 0x7feb9815f680 2024-05-15T12:09:23.239 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.242+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb98050850 con 0x7feb9815f680 2024-05-15T12:09:23.240 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.244+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7feb90007840 con 0x7feb9815f680 2024-05-15T12:09:23.301 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.306+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb98070dd0 con 0x7feb9815f680 2024-05-15T12:09:23.302 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.307+0000 7feb8effd640 1 -- 172.21.15.77:0/3872106587 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7feb90004030 con 0x7feb9815f680 2024-05-15T12:09:23.302 INFO:teuthology.misc.health.smithi077.stdout: 2024-05-15T12:09:23.302 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:22.090762+0000","last_up_change":"0.000000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.307+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 msgr2=0x7feb9806c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 0x7feb9806c950 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feb90009eb0 tx=0x7feb90004a40 comp rx=0 tx=0).stop 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 shutdown_connections 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feb9815e8d0 0x7feb9806c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb9815f680 0x7feb9806c950 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 --2- 172.21.15.77:0/3872106587 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feb980cc480 0x7feb981f4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:23.303 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 >> 172.21.15.77:0/3872106587 conn(0x7feb980ce8b0 msgr2=0x7feb9815bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:23.304 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 shutdown_connections 2024-05-15T12:09:23.304 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:23.308+0000 7feb9c85c640 1 -- 172.21.15.77:0/3872106587 wait complete. 2024-05-15T12:09:23.312 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-15T12:09:23.334 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.339+0000 7f0a69120040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T12:09:23.390 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.395+0000 7fd5e0a93040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-15T12:09:23.470 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.475+0000 7f0a69120040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T12:09:23.520 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.525+0000 7f0a69120040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T12:09:23.525 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.531+0000 7fd5e0a93040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-15T12:09:23.576 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.581+0000 7fd5e0a93040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-15T12:09:23.591 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.596+0000 7f0a69120040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T12:09:23.636 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:23.641+0000 7f0a69120040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T12:09:23.647 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.652+0000 7fd5e0a93040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-15T12:09:23.692 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:23.697+0000 7fd5e0a93040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-15T12:09:24.114 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:24.119+0000 7f0a69120040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T12:09:24.174 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:24.180+0000 7fd5e0a93040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-15T12:09:24.228 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:24.233+0000 7f0a69120040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T12:09:24.294 INFO:tasks.ceph.mgr.x.smithi083.stderr:2024-05-15T12:09:24.299+0000 7fd5e0a93040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-15T12:09:25.242 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:25.247+0000 7f0a08bae640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-15T12:09:25.242 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-05-15T12:09:25.247+0000 7f0a08bae640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-15T12:09:26.171 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T12:09:26.176+0000 7fba5e2ad640 -1 osd.4 0 log_to_monitors true 2024-05-15T12:09:26.189 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T12:09:26.194+0000 7f64703c4640 -1 osd.0 0 log_to_monitors true 2024-05-15T12:09:26.251 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:09:26.255+0000 7fc28ea12640 -1 osd.2 0 log_to_monitors true 2024-05-15T12:09:26.257 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T12:09:26.262+0000 7f71a061a640 -1 osd.5 0 log_to_monitors true 2024-05-15T12:09:26.259 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T12:09:26.264+0000 7f16a341a640 -1 osd.3 0 log_to_monitors true 2024-05-15T12:09:26.259 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T12:09:26.264+0000 7f09ac014640 -1 osd.1 0 log_to_monitors true 2024-05-15T12:09:26.273 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T12:09:26.279+0000 7fc8f1030640 -1 osd.7 0 log_to_monitors true 2024-05-15T12:09:26.283 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T12:09:26.289+0000 7fbbac7a5640 -1 osd.6 0 log_to_monitors true 2024-05-15T12:09:28.096 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T12:09:28.101+0000 7f646c35a640 -1 osd.0 0 waiting for initial osdmap 2024-05-15T12:09:28.112 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T12:09:28.117+0000 7f646417a640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:28.764 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T12:09:28.769+0000 7fba5a243640 -1 osd.4 0 waiting for initial osdmap 2024-05-15T12:09:28.877 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T12:09:28.883+0000 7fba52063640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:29.807 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T12:09:29.812+0000 7f09a81fb640 -1 osd.1 0 waiting for initial osdmap 2024-05-15T12:09:29.824 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T12:09:29.830+0000 7f099f807640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:29.827 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T12:09:29.832+0000 7f169eda0640 -1 osd.3 0 waiting for initial osdmap 2024-05-15T12:09:29.835 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T12:09:29.840+0000 7fc8ecfc6640 -1 osd.7 0 waiting for initial osdmap 2024-05-15T12:09:29.847 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T12:09:29.853+0000 7fc8e4de6640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:29.863 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T12:09:29.869+0000 7f1696bc0640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:29.936 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T12:09:29.941+0000 7fbba873b640 -1 osd.6 0 waiting for initial osdmap 2024-05-15T12:09:29.945 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T12:09:29.951+0000 7f719bfe7640 -1 osd.5 0 waiting for initial osdmap 2024-05-15T12:09:29.947 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T12:09:29.953+0000 7fbba055b640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:29.957 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T12:09:29.963+0000 7f7193e07640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:30.119 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:30.211 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.216+0000 7fedbfd58640 1 Processor -- start 2024-05-15T12:09:30.211 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.216+0000 7fedbfd58640 1 -- start start 2024-05-15T12:09:30.212 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbfd58640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb80b3ee0 0x7fedb80b4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbfd58640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb815c4f0 con 0x7fedb80d07a0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbfd58640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb815c7d0 con 0x7fedb80b5390 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbfd58640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fedb8072220 con 0x7fedb80b3ee0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbe2f5640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb80b3ee0 0x7fedb80b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbdaf4640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fedb80d07a0 0x7fedb815bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:42516/0 (socket says 172.21.15.77:42516) 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbdaf4640 1 -- 172.21.15.77:0/168590299 learned_addr learned my addr 172.21.15.77:0/168590299 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbe2f5640 1 -- 172.21.15.77:0/168590299 >> v1:172.21.15.83:6789/0 conn(0x7fedb80b5390 legacy=0x7fedb8072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbe2f5640 1 -- 172.21.15.77:0/168590299 >> v1:172.21.15.77:6789/0 conn(0x7fedb80d07a0 legacy=0x7fedb815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbe2f5640 1 -- 172.21.15.77:0/168590299 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb815cab0 con 0x7fedb80b3ee0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.217+0000 7fedbcaf2640 1 -- 172.21.15.77:0/168590299 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865786762 0 0) 0x7fedb815c4f0 con 0x7fedb80d07a0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbe2f5640 1 --2- 172.21.15.77:0/168590299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b3ee0 0x7fedb80b4330 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedb80723a0 tx=0x7fedb002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a2a533e39028a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbcaf2640 1 -- 172.21.15.77:0/168590299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0008640 con 0x7fedb80b3ee0 2024-05-15T12:09:30.213 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbcaf2640 1 -- 172.21.15.77:0/168590299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb00087e0 con 0x7fedb80b3ee0 2024-05-15T12:09:30.214 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbcaf2640 1 -- 172.21.15.77:0/168590299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb0008bb0 con 0x7fedb80b3ee0 2024-05-15T12:09:30.216 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbfd58640 1 -- 172.21.15.77:0/168590299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b3ee0 msgr2=0x7fedb80b4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbfd58640 1 --2- 172.21.15.77:0/168590299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b3ee0 0x7fedb80b4330 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fedb80723a0 tx=0x7fedb002b7f0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbfd58640 1 -- 172.21.15.77:0/168590299 shutdown_connections 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbfd58640 1 --2- 172.21.15.77:0/168590299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b3ee0 0x7fedb80b4330 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.218+0000 7fedbfd58640 1 -- 172.21.15.77:0/168590299 >> 172.21.15.77:0/168590299 conn(0x7fedb806c830 msgr2=0x7fedb806cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.219+0000 7fedbfd58640 1 -- 172.21.15.77:0/168590299 shutdown_connections 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.219+0000 7fedbfd58640 1 -- 172.21.15.77:0/168590299 wait complete. 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 Processor -- start 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 -- start start 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80b3ee0 0x7fedb814d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 0x7fedb814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb80d07a0 0x7fedb815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fedb80730a0 con 0x7fedb80b5390 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fedb8072500 con 0x7fedb80d07a0 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbfd58640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fedb806e800 con 0x7fedb80b3ee0 2024-05-15T12:09:30.217 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbd2f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 0x7fedb814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.220+0000 7fedbd2f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 0x7fedb814f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51186/0 (socket says 172.21.15.77:51186) 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 -- 172.21.15.77:0/1419959262 learned_addr learned my addr 172.21.15.77:0/1419959262 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbe2f5640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb80d07a0 0x7fedb815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbdaf4640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80b3ee0 0x7fedb814d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 -- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80b3ee0 msgr2=0x7fedb814d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80b3ee0 0x7fedb814d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 -- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb80d07a0 msgr2=0x7fedb815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb80d07a0 0x7fedb815ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 -- 172.21.15.77:0/1419959262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb814f5f0 con 0x7fedb80b5390 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbd2f3640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 0x7fedb814f0b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feda800c500 tx=0x7feda800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda80052d0 con 0x7fedb80b5390 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda8005470 con 0x7fedb80b5390 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda8012830 con 0x7fedb80b5390 2024-05-15T12:09:30.218 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb815a940 con 0x7fedb80b5390 2024-05-15T12:09:30.219 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.221+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb814e8b0 con 0x7fedb80b5390 2024-05-15T12:09:30.219 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.222+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb8050850 con 0x7fedb80b5390 2024-05-15T12:09:30.219 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.223+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7feda80129d0 con 0x7fedb80b5390 2024-05-15T12:09:30.219 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.223+0000 7fedae7fc640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed9c076270 0x7fed9c078730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:30.220 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.223+0000 7fedbdaf4640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed9c076270 0x7fed9c078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:30.220 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.223+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3631+0+0 (secure 0 0 0) 0x7feda8096720 con 0x7fedb80b5390 2024-05-15T12:09:30.220 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.224+0000 7fedbdaf4640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed9c076270 0x7fed9c078730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedb4007f30 tx=0x7fedb4007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:30.223 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.228+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feda8060340 con 0x7fedb80b5390 2024-05-15T12:09:30.412 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.417+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fedb8073a00 con 0x7fedb80b5390 2024-05-15T12:09:30.413 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.418+0000 7fedae7fc640 1 -- 172.21.15.77:0/1419959262 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9462 (secure 0 0 0) 0x7feda8064640 con 0x7fedb80b5390 2024-05-15T12:09:30.413 INFO:teuthology.misc.health.smithi077.stdout: 2024-05-15T12:09:30.413 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":14,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:29.891342+0000","last_up_change":"2024-05-15T12:09:29.891342+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed9c076270 msgr2=0x7fed9c078730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed9c076270 0x7fed9c078730 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fedb4007f30 tx=0x7fedb4007ec0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 msgr2=0x7fedb814f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 0x7fedb814f0b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feda800c500 tx=0x7feda800c9c0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 shutdown_connections 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed9c076270 0x7fed9c078730 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.415 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fedb80d07a0 0x7fedb815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.416 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb80b5390 0x7fedb814f0b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.416 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 --2- 172.21.15.77:0/1419959262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fedb80b3ee0 0x7fedb814d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:30.416 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 >> 172.21.15.77:0/1419959262 conn(0x7fedb806c830 msgr2=0x7fedb80b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:30.416 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 shutdown_connections 2024-05-15T12:09:30.416 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:30.420+0000 7fedbfd58640 1 -- 172.21.15.77:0/1419959262 wait complete. 2024-05-15T12:09:30.425 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-05-15T12:09:31.337 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:09:31.342+0000 7fc28a3df640 -1 osd.2 0 waiting for initial osdmap 2024-05-15T12:09:31.350 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:09:31.356+0000 7fc2821ff640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-15T12:09:37.232 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:37.335 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.340+0000 7fd784fc8640 1 Processor -- start 2024-05-15T12:09:37.335 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.340+0000 7fd784fc8640 1 -- start start 2024-05-15T12:09:37.335 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd784fc8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7800d1190 0x7fd780163940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.336 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd784fc8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800d1630 con 0x7fd78006e260 2024-05-15T12:09:37.336 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd784fc8640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7800d1910 con 0x7fd7800cf360 2024-05-15T12:09:37.336 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd784fc8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd780163e80 con 0x7fd7800d1190 2024-05-15T12:09:37.336 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd775d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7800d1190 0x7fd780163940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.336 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd77ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd78006e260 0x7fd7800cd5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41598/0 (socket says 172.21.15.77:41598) 2024-05-15T12:09:37.336 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd77ed9d640 1 -- 172.21.15.77:0/3973334122 learned_addr learned my addr 172.21.15.77:0/3973334122 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd775d9b640 1 -- 172.21.15.77:0/3973334122 >> v1:172.21.15.83:6789/0 conn(0x7fd7800cf360 legacy=0x7fd78006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd775d9b640 1 -- 172.21.15.77:0/3973334122 >> v1:172.21.15.77:6789/0 conn(0x7fd78006e260 legacy=0x7fd7800cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd775d9b640 1 -- 172.21.15.77:0/3973334122 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7800d1bf0 con 0x7fd7800d1190 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.341+0000 7fd77dd9b640 1 -- 172.21.15.77:0/3973334122 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576873207 0 0) 0x7fd7800d1630 con 0x7fd78006e260 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.342+0000 7fd775d9b640 1 --2- 172.21.15.77:0/3973334122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800d1190 0x7fd780163940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7680097a0 tx=0x7fd76802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4c70b297c7098 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.342+0000 7fd77dd9b640 1 -- 172.21.15.77:0/3973334122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768037070 con 0x7fd7800d1190 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.342+0000 7fd77dd9b640 1 -- 172.21.15.77:0/3973334122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd768032440 con 0x7fd7800d1190 2024-05-15T12:09:37.337 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.342+0000 7fd77dd9b640 1 -- 172.21.15.77:0/3973334122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768032810 con 0x7fd7800d1190 2024-05-15T12:09:37.338 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 -- 172.21.15.77:0/3973334122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800d1190 msgr2=0x7fd780163940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.338 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 --2- 172.21.15.77:0/3973334122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800d1190 0x7fd780163940 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7680097a0 tx=0x7fd76802a230 comp rx=0 tx=0).stop 2024-05-15T12:09:37.338 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 -- 172.21.15.77:0/3973334122 shutdown_connections 2024-05-15T12:09:37.338 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 --2- 172.21.15.77:0/3973334122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800d1190 0x7fd780163940 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.338 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 -- 172.21.15.77:0/3973334122 >> 172.21.15.77:0/3973334122 conn(0x7fd7800b4a60 msgr2=0x7fd7800b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:37.339 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 -- 172.21.15.77:0/3973334122 shutdown_connections 2024-05-15T12:09:37.339 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.343+0000 7fd784fc8640 1 -- 172.21.15.77:0/3973334122 wait complete. 2024-05-15T12:09:37.339 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.344+0000 7fd784fc8640 1 Processor -- start 2024-05-15T12:09:37.339 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.344+0000 7fd784fc8640 1 -- start start 2024-05-15T12:09:37.341 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd784fc8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd78006e260 0x7fd7800c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd784fc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 0x7fd7801f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd784fc8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7800d1190 0x7fd78009f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd784fc8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800cf740 con 0x7fd7800cf360 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd784fc8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd7800d2240 con 0x7fd7800d1190 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd784fc8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd78006d740 con 0x7fd78006e260 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd775d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 0x7fd7801f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd775d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 0x7fd7801f8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56210/0 (socket says 172.21.15.77:56210) 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd775d9b640 1 -- 172.21.15.77:0/757297885 learned_addr learned my addr 172.21.15.77:0/757297885 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd77e59c640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd78006e260 0x7fd7800c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.345+0000 7fd77ed9d640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7800d1190 0x7fd78009f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd775d9b640 1 -- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd78006e260 msgr2=0x7fd7800c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd775d9b640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd78006e260 0x7fd7800c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd775d9b640 1 -- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7800d1190 msgr2=0x7fd78009f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.342 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd775d9b640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7800d1190 0x7fd78009f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd775d9b640 1 -- 172.21.15.77:0/757297885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7800c6f10 con 0x7fd7800cf360 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd77e59c640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd78006e260 0x7fd7800c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd77ed9d640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7800d1190 0x7fd78009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd775d9b640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 0x7fd7801f8f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd768000c00 tx=0x7fd7680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768037040 con 0x7fd7800cf360 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd768042070 con 0x7fd7800cf360 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7800c71f0 con 0x7fd7800cf360 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd768030a70 con 0x7fd7800cf360 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.346+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7800c77b0 con 0x7fd7800cf360 2024-05-15T12:09:37.343 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.347+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd780050850 con 0x7fd7800cf360 2024-05-15T12:09:37.344 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.348+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd768030c10 con 0x7fd7800cf360 2024-05-15T12:09:37.344 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.348+0000 7fd7777fe640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd7600762d0 0x7fd760078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.344 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.348+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd7680b7d30 con 0x7fd7800cf360 2024-05-15T12:09:37.344 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.348+0000 7fd77e59c640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd7600762d0 0x7fd760078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.344 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.348+0000 7fd77e59c640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd7600762d0 0x7fd760078790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd770007fd0 tx=0x7fd770009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:37.348 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.353+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7680819e0 con 0x7fd7800cf360 2024-05-15T12:09:37.529 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.534+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd78006d520 con 0x7fd7800cf360 2024-05-15T12:09:37.530 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.535+0000 7fd7777fe640 1 -- 172.21.15.77:0/757297885 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12812 (secure 0 0 0) 0x7fd7680812e0 con 0x7fd7800cf360 2024-05-15T12:09:37.530 INFO:teuthology.misc.health.smithi077.stdout: 2024-05-15T12:09:37.530 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":17,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:32.959838+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:37.532 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd7600762d0 msgr2=0x7fd760078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd7600762d0 0x7fd760078790 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd770007fd0 tx=0x7fd770009040 comp rx=0 tx=0).stop 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 msgr2=0x7fd7801f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 0x7fd7801f8f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd768000c00 tx=0x7fd7680046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 shutdown_connections 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd7600762d0 0x7fd760078790 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7800d1190 0x7fd78009f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7800cf360 0x7fd7801f8f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 --2- 172.21.15.77:0/757297885 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd78006e260 0x7fd7800c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 >> 172.21.15.77:0/757297885 conn(0x7fd7800b4a60 msgr2=0x7fd7800b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 shutdown_connections 2024-05-15T12:09:37.533 INFO:teuthology.misc.health.smithi077.stderr:2024-05-15T12:09:37.537+0000 7fd784fc8640 1 -- 172.21.15.77:0/757297885 wait complete. 2024-05-15T12:09:37.542 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-15T12:09:37.543 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-15T12:09:37.543 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-15T12:09:37.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-15T12:09:37.545 INFO:tasks.ceph.mds.a:Started 2024-05-15T12:09:37.546 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-15T12:09:37.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-15T12:09:37.548 INFO:tasks.ceph.mds.c:Started 2024-05-15T12:09:37.548 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-15T12:09:37.548 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-15T12:09:37.551 INFO:tasks.ceph.mds.b:Started 2024-05-15T12:09:37.551 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-15T12:09:37.551 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-15T12:09:37.553 INFO:tasks.ceph.mds.d:Started 2024-05-15T12:09:37.553 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-15T12:09:37.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:09:37.622 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2024-05-15T12:09:37.622 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-05-15T12:09:37.638 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2024-05-15T12:09:37.639 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2024-05-15T12:09:37.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.664+0000 7f7d6e77f640 1 Processor -- start 2024-05-15T12:09:37.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.665+0000 7f7d6e77f640 1 -- start start 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.665+0000 7f7d6e77f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 0x7f7d680d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.665+0000 7f7d6e77f640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d680d0770 0x7f7d680d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.665+0000 7f7d6e77f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d680d0dd0 con 0x7f7d6815f840 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.665+0000 7f7d6e77f640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7d680d19e0 con 0x7f7d680d0770 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.665+0000 7f7d6e77f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7d680d10b0 con 0x7f7d6815f460 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d6cd1c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d680d0770 0x7f7d680d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d67fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 0x7f7d680d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d6cd1c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d680d0770 0x7f7d680d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:54398/0 (socket says 172.21.15.77:54398) 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d67fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 0x7f7d680d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:34682/0 (socket says 172.21.15.77:34682) 2024-05-15T12:09:37.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d6cd1c640 1 -- 172.21.15.77:0/3541009508 learned_addr learned my addr 172.21.15.77:0/3541009508 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d67fff640 1 -- 172.21.15.77:0/3541009508 >> v2:172.21.15.83:3300/0 conn(0x7f7d680d0770 msgr2=0x7f7d680d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d67fff640 1 --2- 172.21.15.77:0/3541009508 >> v2:172.21.15.83:3300/0 conn(0x7f7d680d0770 0x7f7d680d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d67fff640 1 -- 172.21.15.77:0/3541009508 >> v1:172.21.15.83:6789/0 conn(0x7f7d6815f840 legacy=0x7f7d680d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.666+0000 7f7d67fff640 1 -- 172.21.15.77:0/3541009508 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d680d1390 con 0x7f7d6815f460 2024-05-15T12:09:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d67fff640 1 --2- 172.21.15.77:0/3541009508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 0x7f7d680d38c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d580097a0 tx=0x7f7d5802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6278139368bb8ebd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d677fe640 1 -- 172.21.15.77:0/3541009508 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58037070 con 0x7f7d6815f460 2024-05-15T12:09:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d677fe640 1 -- 172.21.15.77:0/3541009508 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d5802ae50 con 0x7f7d6815f460 2024-05-15T12:09:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d677fe640 1 -- 172.21.15.77:0/3541009508 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58032660 con 0x7f7d6815f460 2024-05-15T12:09:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d6e77f640 1 -- 172.21.15.77:0/3541009508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 msgr2=0x7f7d680d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/3541009508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 0x7f7d680d38c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7d580097a0 tx=0x7f7d5802a100 comp rx=0 tx=0).stop 2024-05-15T12:09:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d6e77f640 1 -- 172.21.15.77:0/3541009508 shutdown_connections 2024-05-15T12:09:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/3541009508 >> v2:172.21.15.83:3300/0 conn(0x7f7d680d0770 0x7f7d680d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/3541009508 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d6815f460 0x7f7d680d38c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.667+0000 7f7d6e77f640 1 -- 172.21.15.77:0/3541009508 >> 172.21.15.77:0/3541009508 conn(0x7f7d6808ec10 msgr2=0x7f7d6809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.668+0000 7f7d6e77f640 1 -- 172.21.15.77:0/3541009508 shutdown_connections 2024-05-15T12:09:37.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.668+0000 7f7d6e77f640 1 -- 172.21.15.77:0/3541009508 wait complete. 2024-05-15T12:09:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.669+0000 7f7d6e77f640 1 Processor -- start 2024-05-15T12:09:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.669+0000 7f7d6e77f640 1 -- start start 2024-05-15T12:09:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6e77f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d680d0770 0x7f7d68162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6e77f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 0x7f7d680ba590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6e77f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6815f840 0x7f7d680d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6e77f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d680b4b80 con 0x7f7d6815f460 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6e77f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d680b4a00 con 0x7f7d6815f840 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6e77f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7d680b4d00 con 0x7f7d680d0770 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 0x7f7d680ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 0x7f7d680ba590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56268/0 (socket says 172.21.15.77:56268) 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 -- 172.21.15.77:0/2454946425 learned_addr learned my addr 172.21.15.77:0/2454946425 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d6cd1c640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6815f840 0x7f7d680d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d67fff640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d680d0770 0x7f7d68162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 -- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d680d0770 msgr2=0x7f7d68162640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d680d0770 0x7f7d68162640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 -- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6815f840 msgr2=0x7f7d680d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6815f840 0x7f7d680d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 -- 172.21.15.77:0/2454946425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d681615a0 con 0x7f7d6815f460 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.670+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 0x7f7d680ba590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c400 tx=0x7f7d5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.671+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50017070 con 0x7f7d6815f460 2024-05-15T12:09:37.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.671+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d500052d0 con 0x7f7d6815f460 2024-05-15T12:09:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.671+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d68161880 con 0x7f7d6815f460 2024-05-15T12:09:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.671+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50003830 con 0x7f7d6815f460 2024-05-15T12:09:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.671+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d68161e40 con 0x7f7d6815f460 2024-05-15T12:09:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.672+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d68162330 con 0x7f7d6815f460 2024-05-15T12:09:37.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.672+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d5001a070 con 0x7f7d6815f460 2024-05-15T12:09:37.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.673+0000 7f7d657fa640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d480762d0 0x7f7d48078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:37.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.673+0000 7f7d67fff640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d480762d0 0x7f7d48078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:37.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.673+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7d500965d0 con 0x7f7d6815f460 2024-05-15T12:09:37.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.673+0000 7f7d67fff640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d480762d0 0x7f7d48078790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7d58034000 tx=0x7f7d5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:37.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.677+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d5005fc40 con 0x7f7d6815f460 2024-05-15T12:09:37.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.892+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d6806a640 con 0x7f7d6815f460 2024-05-15T12:09:37.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.893+0000 7f7d657fa640 1 -- 172.21.15.77:0/2454946425 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f7d50068280 con 0x7f7d6815f460 2024-05-15T12:09:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:37.888 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-15T12:09:37.888 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d480762d0 msgr2=0x7f7d48078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d480762d0 0x7f7d48078790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7d58034000 tx=0x7f7d5802e000 comp rx=0 tx=0).stop 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 msgr2=0x7f7d680ba590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 0x7f7d680ba590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c400 tx=0x7f7d5000c8c0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 shutdown_connections 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d480762d0 0x7f7d48078790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d6815f840 0x7f7d680d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d6815f460 0x7f7d680ba590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 --2- 172.21.15.77:0/2454946425 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d680d0770 0x7f7d68162640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:37.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 >> 172.21.15.77:0/2454946425 conn(0x7f7d6808ec10 msgr2=0x7f7d6806d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:37.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 shutdown_connections 2024-05-15T12:09:37.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:37.895+0000 7f7d6e77f640 1 -- 172.21.15.77:0/2454946425 wait complete. 2024-05-15T12:09:39.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:09:40.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.018+0000 7fa28f445640 1 Processor -- start 2024-05-15T12:09:40.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.018+0000 7fa28f445640 1 -- start start 2024-05-15T12:09:40.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28f445640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa28813ee10 0x7fa288141730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28f445640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880cff90 0x7fa288072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28f445640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2880d0640 con 0x7fa288141c70 2024-05-15T12:09:40.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28f445640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa2880d0420 con 0x7fa28813ee10 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28f445640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa2880d0920 con 0x7fa2880cff90 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28d1e1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa28813ee10 0x7fa288141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28d1e1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa28813ee10 0x7fa288141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56274/0 (socket says 172.21.15.77:56274) 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28d1e1640 1 -- 172.21.15.77:0/1912803513 learned_addr learned my addr 172.21.15.77:0/1912803513 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28c9e0640 1 --1- 172.21.15.77:0/1912803513 >> v1:172.21.15.77:6789/0 conn(0x7fa288141c70 0x7fa2880cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41618/0 (socket says 172.21.15.77:41618) 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28d1e1640 1 -- 172.21.15.77:0/1912803513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880cff90 msgr2=0x7fa288072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.019+0000 7fa28d9e2640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880cff90 0x7fa288072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.020+0000 7fa28d1e1640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880cff90 0x7fa288072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.020+0000 7fa28d1e1640 1 -- 172.21.15.77:0/1912803513 >> v1:172.21.15.77:6789/0 conn(0x7fa288141c70 legacy=0x7fa2880cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.020+0000 7fa28d1e1640 1 -- 172.21.15.77:0/1912803513 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2880d0c00 con 0x7fa28813ee10 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.020+0000 7fa28d9e2640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880cff90 0x7fa288072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.020+0000 7fa28d1e1640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28813ee10 0x7fa288141730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa28400bb10 tx=0x7fa28402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01fb295a18fe828 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.020+0000 7fa27ffff640 1 -- 172.21.15.77:0/1912803513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284036020 con 0x7fa28813ee10 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa27ffff640 1 -- 172.21.15.77:0/1912803513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa284032820 con 0x7fa28813ee10 2024-05-15T12:09:40.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa27ffff640 1 -- 172.21.15.77:0/1912803513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284032bf0 con 0x7fa28813ee10 2024-05-15T12:09:40.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 -- 172.21.15.77:0/1912803513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28813ee10 msgr2=0x7fa288141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28813ee10 0x7fa288141730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa28400bb10 tx=0x7fa28402c920 comp rx=0 tx=0).stop 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 -- 172.21.15.77:0/1912803513 shutdown_connections 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa2880cff90 0x7fa288072aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 --2- 172.21.15.77:0/1912803513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa28813ee10 0x7fa288141730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 -- 172.21.15.77:0/1912803513 >> 172.21.15.77:0/1912803513 conn(0x7fa28806c810 msgr2=0x7fa28806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 -- 172.21.15.77:0/1912803513 shutdown_connections 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.021+0000 7fa28f445640 1 -- 172.21.15.77:0/1912803513 wait complete. 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.022+0000 7fa28f445640 1 Processor -- start 2024-05-15T12:09:40.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 -- start start 2024-05-15T12:09:40.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880cff90 0x7fa288157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa28813ee10 0x7fa2881f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 0x7fa28813d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa28813f1f0 con 0x7fa288141c70 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa288072580 con 0x7fa2880cff90 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28f445640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa28813f370 con 0x7fa28813ee10 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28d9e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 0x7fa28813d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28d9e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 0x7fa28813d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56280/0 (socket says 172.21.15.77:56280) 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.023+0000 7fa28d9e2640 1 -- 172.21.15.77:0/2441042281 learned_addr learned my addr 172.21.15.77:0/2441042281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d1e1640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880cff90 0x7fa288157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28c9e0640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa28813ee10 0x7fa2881f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d9e2640 1 -- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa28813ee10 msgr2=0x7fa2881f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d9e2640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa28813ee10 0x7fa2881f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d9e2640 1 -- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880cff90 msgr2=0x7fa288157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d9e2640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880cff90 0x7fa288157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d9e2640 1 -- 172.21.15.77:0/2441042281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2880b3e90 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d1e1640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880cff90 0x7fa288157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28c9e0640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa28813ee10 0x7fa2881f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28d9e2640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 0x7fa28813d940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa28000cd50 tx=0x7fa28000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28000f680 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28000f840 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2881f9070 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28000fc30 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.024+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2881f9630 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.025+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28806a640 con 0x7fa288141c70 2024-05-15T12:09:40.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.026+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa2800213f0 con 0x7fa288141c70 2024-05-15T12:09:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.026+0000 7fa27dffb640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa26c0762d0 0x7fa26c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.027+0000 7fa28d1e1640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa26c0762d0 0x7fa26c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.027+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa280097fe0 con 0x7fa288141c70 2024-05-15T12:09:40.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.027+0000 7fa28d1e1640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa26c0762d0 0x7fa26c078790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa284037000 tx=0x7fa284008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.031+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa280014030 con 0x7fa288141c70 2024-05-15T12:09:40.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.247+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa28806cbf0 con 0x7fa288141c70 2024-05-15T12:09:40.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.247+0000 7fa27dffb640 1 -- 172.21.15.77:0/2441042281 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3861 (secure 0 0 0) 0x7fa280061c90 con 0x7fa288141c70 2024-05-15T12:09:40.242 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:40.242 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4302,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-15T12:09:40.243 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa26c0762d0 msgr2=0x7fa26c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa26c0762d0 0x7fa26c078790 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa284037000 tx=0x7fa284008040 comp rx=0 tx=0).stop 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 msgr2=0x7fa28813d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 0x7fa28813d940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa28000cd50 tx=0x7fa28000a650 comp rx=0 tx=0).stop 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 shutdown_connections 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa26c0762d0 0x7fa26c078790 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa28813ee10 0x7fa2881f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa288141c70 0x7fa28813d940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 --2- 172.21.15.77:0/2441042281 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa2880cff90 0x7fa288157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.249+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 >> 172.21.15.77:0/2441042281 conn(0x7fa28806c810 msgr2=0x7fa28813fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.250+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 shutdown_connections 2024-05-15T12:09:40.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.250+0000 7fa28f445640 1 -- 172.21.15.77:0/2441042281 wait complete. 2024-05-15T12:09:40.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-15T12:09:40.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.361+0000 7fecd8075640 1 Processor -- start 2024-05-15T12:09:40.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.361+0000 7fecd8075640 1 -- start start 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd8075640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 0x7fecd00d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd8075640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fecd00d28c0 0x7fecd00d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd8075640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecd01631d0 con 0x7fecd00d57e0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd8075640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fecd0162f80 con 0x7fecd00d28c0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd8075640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fecd00d0970 con 0x7fecd015f1d0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd6612640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fecd00d57e0 0x7fecd00d3580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41632/0 (socket says 172.21.15.77:41632) 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd6612640 1 -- 172.21.15.77:0/4238112265 learned_addr learned my addr 172.21.15.77:0/4238112265 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469151927 0 0) 0x7fecd01631d0 con 0x7fecd00d57e0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd5e11640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 0x7fecd00d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd5610640 1 --2- 172.21.15.77:0/4238112265 >> v2:172.21.15.83:3300/0 conn(0x7fecd00d28c0 0x7fecd00d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.362+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecbc003520 con 0x7fecd00d57e0 2024-05-15T12:09:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 511632583 0 0) 0x7fecbc003520 con 0x7fecd00d57e0 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 msgr2=0x7fecd00d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 0x7fecd00d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 >> v2:172.21.15.83:3300/0 conn(0x7fecd00d28c0 msgr2=0x7fecd00d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 --2- 172.21.15.77:0/4238112265 >> v2:172.21.15.83:3300/0 conn(0x7fecd00d28c0 0x7fecd00d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd01634b0 con 0x7fecd00d57e0 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fecc8001a70 con 0x7fecd00d57e0 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd5610640 1 --2- 172.21.15.77:0/4238112265 >> v2:172.21.15.83:3300/0 conn(0x7fecd00d28c0 0x7fecd00d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 >> v1:172.21.15.77:6789/0 conn(0x7fecd00d57e0 legacy=0x7fecd00d3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 0x7fecbc003ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecbc004090 0x7fecbc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecbc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecd0162f80 con 0x7fecbc004d40 2024-05-15T12:09:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00d0970 con 0x7fecbc004090 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fecbc00bc10 con 0x7fecd015f1d0 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd6612640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecbc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd5e11640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 0x7fecbc003ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd5610640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecbc004090 0x7fecbc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd6612640 1 -- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 msgr2=0x7fecbc003ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd6612640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd015f1d0 0x7fecbc003ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd6612640 1 -- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecbc004090 msgr2=0x7fecbc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd6612640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecbc004090 0x7fecbc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.363+0000 7fecd6612640 1 -- 172.21.15.77:0/4238112265 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecbc003520 con 0x7fecbc004d40 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd6612640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecbc0051c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecc800a850 tx=0x7fecbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5ed4f884682ce4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc800a4a0 con 0x7fecbc004d40 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecc802f070 con 0x7fecbc004d40 2024-05-15T12:09:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd4e0f640 1 -- 172.21.15.77:0/4238112265 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecc802bc30 con 0x7fecbc004d40 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd8075640 1 -- 172.21.15.77:0/4238112265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 msgr2=0x7fecbc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd8075640 1 --2- 172.21.15.77:0/4238112265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecbc0051c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fecc800a850 tx=0x7fecbc005830 comp rx=0 tx=0).stop 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.364+0000 7fecd6612640 1 -- 172.21.15.77:0/4238112265 reap_dead start 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.365+0000 7fecd8075640 1 -- 172.21.15.77:0/4238112265 shutdown_connections 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.365+0000 7fecd8075640 1 -- 172.21.15.77:0/4238112265 >> 172.21.15.77:0/4238112265 conn(0x7fecd0073f10 msgr2=0x7fecd0074320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.365+0000 7fecd8075640 1 -- 172.21.15.77:0/4238112265 shutdown_connections 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.365+0000 7fecd8075640 1 -- 172.21.15.77:0/4238112265 wait complete. 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.366+0000 7fecd8075640 1 Processor -- start 2024-05-15T12:09:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.366+0000 7fecd8075640 1 -- start start 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecd0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd00ced90 0x7fecd015f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd00cd9d0 0x7fecd015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fecd00d47e0 con 0x7fecbc004d40 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fecd0163a70 con 0x7fecd00cd9d0 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fecd00d4960 con 0x7fecd00ced90 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecd0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecd0158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56300/0 (socket says 172.21.15.77:56300) 2024-05-15T12:09:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 -- 172.21.15.77:0/343526980 learned_addr learned my addr 172.21.15.77:0/343526980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5610640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd00ced90 0x7fecd015f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd6612640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd00cd9d0 0x7fecd015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 -- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd00ced90 msgr2=0x7fecd015f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd00ced90 0x7fecd015f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 -- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd00cd9d0 msgr2=0x7fecd015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd00cd9d0 0x7fecd015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 -- 172.21.15.77:0/343526980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd00cf210 con 0x7fecbc004d40 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd5e11640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecd0158500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feccc0119a0 tx=0x7feccc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc00faf0 con 0x7fecbc004d40 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feccc00fc90 con 0x7fecbc004d40 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc014440 con 0x7fecbc004d40 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd015a340 con 0x7fecbc004d40 2024-05-15T12:09:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.367+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd00ce420 con 0x7fecbc004d40 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.368+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd006a640 con 0x7fecbc004d40 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.369+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feccc012040 con 0x7fecbc004d40 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.369+0000 7fecc67fc640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fecb40762d0 0x7fecb4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.369+0000 7fecd5610640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fecb40762d0 0x7fecb4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.370+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7feccc097850 con 0x7fecbc004d40 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.370+0000 7fecd5610640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fecb40762d0 0x7fecb4078790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fecd00cbb20 tx=0x7fecc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.374+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7feccc019030 con 0x7fecbc004d40 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.558+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fecd00ce660 con 0x7fecbc004d40 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.558+0000 7fecc67fc640 1 -- 172.21.15.77:0/343526980 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7feccc060eb0 con 0x7fecbc004d40 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-05-15T12:09:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:09:40.554 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-05-15T12:09:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fecb40762d0 msgr2=0x7fecb4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fecb40762d0 0x7fecb4078790 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fecd00cbb20 tx=0x7fecc0008040 comp rx=0 tx=0).stop 2024-05-15T12:09:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 msgr2=0x7fecd0158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecd0158500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feccc0119a0 tx=0x7feccc011e60 comp rx=0 tx=0).stop 2024-05-15T12:09:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 shutdown_connections 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fecb40762d0 0x7fecb4078790 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fecd00ced90 0x7fecd015f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fecd00cd9d0 0x7fecd015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 --2- 172.21.15.77:0/343526980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecbc004d40 0x7fecd0158500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 >> 172.21.15.77:0/343526980 conn(0x7fecd0073f10 msgr2=0x7fecd00ba400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 shutdown_connections 2024-05-15T12:09:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.560+0000 7fecd8075640 1 -- 172.21.15.77:0/343526980 wait complete. 2024-05-15T12:09:40.566 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-15T12:09:40.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-15T12:09:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.678+0000 7f91523c1640 1 Processor -- start 2024-05-15T12:09:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.678+0000 7f91523c1640 1 -- start start 2024-05-15T12:09:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f91523c1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0d4d40 0x7f914c0bad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f91523c1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914c0d3ca0 con 0x7f914c15f470 2024-05-15T12:09:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f91523c1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f914c0d3f80 con 0x7f914c0b6be0 2024-05-15T12:09:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f91523c1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f914c0d4260 con 0x7f914c0d4d40 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f914bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f914c15f470 0x7f914c0d34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41638/0 (socket says 172.21.15.77:41638) 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f914bfff640 1 -- 172.21.15.77:0/4050464623 learned_addr learned my addr 172.21.15.77:0/4050464623 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f9143fff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0d4d40 0x7f914c0bad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373755660 0 0) 0x7f914c0d3ca0 con 0x7f914c15f470 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.679+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9138003520 con 0x7f914c15f470 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2167735619 0 0) 0x7f914c0d3f80 con 0x7f914c0b6be0 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f914c0d3ca0 con 0x7f914c0b6be0 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1797321412 0 0) 0x7f9138003520 con 0x7f914c15f470 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0d4d40 msgr2=0x7f914c0bad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0d4d40 0x7f914c0bad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 >> v1:172.21.15.83:6789/0 conn(0x7f914c0b6be0 legacy=0x7f914c0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914c0d4540 con 0x7f914c15f470 2024-05-15T12:09:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f913c0016f0 con 0x7f914c15f470 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 >> v1:172.21.15.77:6789/0 conn(0x7f914c15f470 legacy=0x7f914c0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138003c10 0x7f9138004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9138004800 0x7f9138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91380051c0 0x7f913800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f914c0d4260 con 0x7f9138003c10 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f913800c090 con 0x7f91380051c0 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f913800c290 con 0x7f9138004800 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f9143fff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0d4d40 0x7f914c0bad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914bfff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138003c10 0x7f9138004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f915095e640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91380051c0 0x7f913800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f9143fff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9138004800 0x7f9138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914bfff640 1 -- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9138004800 msgr2=0x7f9138004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914bfff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9138004800 0x7f9138004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914bfff640 1 -- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91380051c0 msgr2=0x7f913800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914bfff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91380051c0 0x7f913800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f914bfff640 1 -- 172.21.15.77:0/4050464623 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9138003520 con 0x7f9138003c10 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.680+0000 7f915095e640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91380051c0 0x7f913800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f914bfff640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138003c10 0x7f9138004010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c160 tx=0x7f9138005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106add3a6e1934e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c007ca0 con 0x7f9138003c10 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f913c005af0 con 0x7f9138003c10 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f914b7fe640 1 -- 172.21.15.77:0/4050464623 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913c007070 con 0x7f9138003c10 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f91523c1640 1 -- 172.21.15.77:0/4050464623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138003c10 msgr2=0x7f9138004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f91523c1640 1 --2- 172.21.15.77:0/4050464623 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9138003c10 0x7f9138004010 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c160 tx=0x7f9138005830 comp rx=0 tx=0).stop 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.681+0000 7f915095e640 1 -- 172.21.15.77:0/4050464623 reap_dead start 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.682+0000 7f91523c1640 1 -- 172.21.15.77:0/4050464623 shutdown_connections 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.682+0000 7f91523c1640 1 -- 172.21.15.77:0/4050464623 >> 172.21.15.77:0/4050464623 conn(0x7f914c074150 msgr2=0x7f914c0d1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.682+0000 7f91523c1640 1 -- 172.21.15.77:0/4050464623 shutdown_connections 2024-05-15T12:09:40.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.682+0000 7f91523c1640 1 -- 172.21.15.77:0/4050464623 wait complete. 2024-05-15T12:09:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 Processor -- start 2024-05-15T12:09:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 -- start start 2024-05-15T12:09:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9138003c10 0x7f914c150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0cd330 0x7f914c1ead40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 0x7f914c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f914c0bae90 con 0x7f914c1eb280 2024-05-15T12:09:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f914c0bad10 con 0x7f9138003c10 2024-05-15T12:09:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.683+0000 7f91523c1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f914c0bb010 con 0x7f914c0cd330 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 0x7f914c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 0x7f914c0cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56314/0 (socket says 172.21.15.77:56314) 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 -- 172.21.15.77:0/2507013132 learned_addr learned my addr 172.21.15.77:0/2507013132 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f9143fff640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0cd330 0x7f914c1ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f914bfff640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9138003c10 0x7f914c150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 -- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0cd330 msgr2=0x7f914c1ead40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0cd330 0x7f914c1ead40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 -- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9138003c10 msgr2=0x7f914c150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9138003c10 0x7f914c150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 -- 172.21.15.77:0/2507013132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914c0cc2d0 con 0x7f914c1eb280 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f914bfff640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9138003c10 0x7f914c150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f915095e640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 0x7f914c0cd830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9144001330 tx=0x7f914400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144003b80 con 0x7f914c1eb280 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9144003d20 con 0x7f914c1eb280 2024-05-15T12:09:40.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914c0cc570 con 0x7f914c1eb280 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9144006b50 con 0x7f914c1eb280 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.684+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914c0ccb30 con 0x7f914c1eb280 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.685+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914c06a640 con 0x7f914c1eb280 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.686+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f914401a020 con 0x7f914c1eb280 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.686+0000 7f91497fa640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f912c076300 0x7f912c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.686+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9144096870 con 0x7f914c1eb280 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.686+0000 7f914bfff640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f912c076300 0x7f912c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.687+0000 7f914bfff640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f912c076300 0x7f912c0787c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c160 tx=0x7f913c009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:40.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.691+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91440605b0 con 0x7f914c1eb280 2024-05-15T12:09:40.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:40.870+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f914c0d5ca0 con 0x7f914c1eb280 2024-05-15T12:09:41.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.653+0000 7f91497fa640 1 -- 172.21.15.77:0/2507013132 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f914405feb0 con 0x7f914c1eb280 2024-05-15T12:09:41.648 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2024-05-15T12:09:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f912c076300 msgr2=0x7f912c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f912c076300 0x7f912c0787c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f913c00c160 tx=0x7f913c009030 comp rx=0 tx=0).stop 2024-05-15T12:09:41.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 msgr2=0x7f914c0cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 0x7f914c0cd830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9144001330 tx=0x7f914400ead0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 shutdown_connections 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f912c076300 0x7f912c0787c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f914c0cd330 0x7f914c1ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f914c1eb280 0x7f914c0cd830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 --2- 172.21.15.77:0/2507013132 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9138003c10 0x7f914c150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 >> 172.21.15.77:0/2507013132 conn(0x7f914c074150 msgr2=0x7f914c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 shutdown_connections 2024-05-15T12:09:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.655+0000 7f91523c1640 1 -- 172.21.15.77:0/2507013132 wait complete. 2024-05-15T12:09:41.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-15T12:09:41.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.783+0000 7f41e6786640 1 Processor -- start 2024-05-15T12:09:41.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.783+0000 7f41e6786640 1 -- start start 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41e6786640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 0x7f41e00badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41e6786640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e00d3cb0 con 0x7f41e00d4d50 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41e6786640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e00d3f90 con 0x7f41e00b73d0 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41e6786640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f41e00d4270 con 0x7f41e015f450 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41df7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f41e00d4d50 0x7f41e00b6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:41646/0 (socket says 172.21.15.77:41646) 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41df7fe640 1 -- 172.21.15.77:0/3200643166 learned_addr learned my addr 172.21.15.77:0/3200643166 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41dffff640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 0x7f41e00badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391694265 0 0) 0x7f41e00d3cb0 con 0x7f41e00d4d50 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c8003520 con 0x7f41e00d4d50 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4234917245 0 0) 0x7f41c8003520 con 0x7f41e00d4d50 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 msgr2=0x7f41e00badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 0x7f41e00badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 >> v1:172.21.15.83:6789/0 conn(0x7f41e00b73d0 legacy=0x7f41e00b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e00d4550 con 0x7f41e00d4d50 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f41d40016f0 con 0x7f41e00d4d50 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 >> v1:172.21.15.77:6789/0 conn(0x7f41e00d4d50 legacy=0x7f41e00b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.784+0000 7f41deffd640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8003a50 0x7f41c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41deffd640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c8004800 0x7f41c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41deffd640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 0x7f41c80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00d4270 con 0x7f41c8004800 2024-05-15T12:09:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f41c800bad0 con 0x7f41c8003a50 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f41c800bcd0 con 0x7f41e015f450 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41df7fe640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c8004800 0x7f41c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41dffff640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8003a50 0x7f41c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41e4d23640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 0x7f41c80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41df7fe640 1 -- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 msgr2=0x7f41c80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41df7fe640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e015f450 0x7f41c80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41df7fe640 1 -- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8003a50 msgr2=0x7f41c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41df7fe640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8003a50 0x7f41c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.785+0000 7f41df7fe640 1 -- 172.21.15.77:0/3200643166 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c8003520 con 0x7f41c8004800 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41df7fe640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c8004800 0x7f41c8004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41d400c190 tx=0x7f41c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8890585557b61d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4007c80 con 0x7f41c8004800 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d4005ad0 con 0x7f41c8004800 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41deffd640 1 -- 172.21.15.77:0/3200643166 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4007070 con 0x7f41c8004800 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e6786640 1 -- 172.21.15.77:0/3200643166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c8004800 msgr2=0x7f41c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e6786640 1 --2- 172.21.15.77:0/3200643166 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41c8004800 0x7f41c8004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41d400c190 tx=0x7f41c8005830 comp rx=0 tx=0).stop 2024-05-15T12:09:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e4d23640 1 -- 172.21.15.77:0/3200643166 reap_dead start 2024-05-15T12:09:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e6786640 1 -- 172.21.15.77:0/3200643166 shutdown_connections 2024-05-15T12:09:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e6786640 1 -- 172.21.15.77:0/3200643166 >> 172.21.15.77:0/3200643166 conn(0x7f41e0074150 msgr2=0x7f41e00d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e6786640 1 -- 172.21.15.77:0/3200643166 shutdown_connections 2024-05-15T12:09:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.786+0000 7f41e6786640 1 -- 172.21.15.77:0/3200643166 wait complete. 2024-05-15T12:09:41.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.787+0000 7f41e6786640 1 Processor -- start 2024-05-15T12:09:41.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 -- start start 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8004800 0x7f41e0156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e0162570 0x7f41e01553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 0x7f41e01f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00bb160 con 0x7f41e01579f0 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f41e00bafe0 con 0x7f41c8004800 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e6786640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f41e00d3540 con 0x7f41e0162570 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e4d23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 0x7f41e01f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e4d23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 0x7f41e01f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56328/0 (socket says 172.21.15.77:56328) 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.788+0000 7f41e4d23640 1 -- 172.21.15.77:0/2503000807 learned_addr learned my addr 172.21.15.77:0/2503000807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41df7fe640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e0162570 0x7f41e01553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41dffff640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8004800 0x7f41e0156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e4d23640 1 -- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e0162570 msgr2=0x7f41e01553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e4d23640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e0162570 0x7f41e01553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e4d23640 1 -- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8004800 msgr2=0x7f41e0156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e4d23640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8004800 0x7f41e0156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e4d23640 1 -- 172.21.15.77:0/2503000807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e01558f0 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41df7fe640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e0162570 0x7f41e01553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41dffff640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8004800 0x7f41e0156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e4d23640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 0x7f41e01f4450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41e008e700 tx=0x7f41d800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8019070 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d8006e20 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e0155ba0 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8003b70 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.789+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e0156160 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.790+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e006a640 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.791+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f41d801c070 con 0x7f41e01579f0 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.791+0000 7f41dcff9640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41cc0762d0 0x7f41cc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:41.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.791+0000 7f41dffff640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41cc0762d0 0x7f41cc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:41.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.791+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f41d80969a0 con 0x7f41e01579f0 2024-05-15T12:09:41.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.791+0000 7f41dffff640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41cc0762d0 0x7f41cc078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009b40 tx=0x7f41d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:41.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.796+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f41d8060570 con 0x7f41e01579f0 2024-05-15T12:09:41.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:41.976+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f41e00c9570 con 0x7f41e01579f0 2024-05-15T12:09:42.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.657+0000 7f41dcff9640 1 -- 172.21.15.77:0/2503000807 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7f41d805fe70 con 0x7f41e01579f0 2024-05-15T12:09:42.653 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2024-05-15T12:09:42.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41cc0762d0 msgr2=0x7f41cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41cc0762d0 0x7f41cc078790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f41d0009b40 tx=0x7f41d0008040 comp rx=0 tx=0).stop 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 msgr2=0x7f41e01f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 0x7f41e01f4450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f41e008e700 tx=0x7f41d800ff70 comp rx=0 tx=0).stop 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 shutdown_connections 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41cc0762d0 0x7f41cc078790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e0162570 0x7f41e01553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e01579f0 0x7f41e01f4450 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 --2- 172.21.15.77:0/2503000807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41c8004800 0x7f41e0156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 >> 172.21.15.77:0/2503000807 conn(0x7f41e0074150 msgr2=0x7f41e00b9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 shutdown_connections 2024-05-15T12:09:42.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.661+0000 7f41e6786640 1 -- 172.21.15.77:0/2503000807 wait complete. 2024-05-15T12:09:42.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-15T12:09:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.791+0000 7fc71fd89640 1 Processor -- start 2024-05-15T12:09:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.791+0000 7fc71fd89640 1 -- start start 2024-05-15T12:09:42.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71fd89640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 0x7fc7180d4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71fd89640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7180d3d50 con 0x7fc7180b6c40 2024-05-15T12:09:42.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71fd89640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7180d4030 con 0x7fc71815f3d0 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71fd89640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180d4310 con 0x7fc7180bae00 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71e326640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc7180b6c40 0x7fc7180b8250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49004/0 (socket says 172.21.15.77:49004) 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71e326640 1 -- 172.21.15.77:0/3128971201 learned_addr learned my addr 172.21.15.77:0/3128971201 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71d324640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 0x7fc7180d4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 379579850 0 0) 0x7fc7180d3d50 con 0x7fc7180b6c40 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc704003520 con 0x7fc7180b6c40 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286724751 0 0) 0x7fc7180d4030 con 0x7fc71815f3d0 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7180d3d50 con 0x7fc71815f3d0 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1989368699 0 0) 0x7fc704003520 con 0x7fc7180b6c40 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 msgr2=0x7fc7180d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 0x7fc7180d4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 >> v1:172.21.15.83:6789/0 conn(0x7fc71815f3d0 legacy=0x7fc7180d0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7180d45f0 con 0x7fc7180b6c40 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fc710001a70 con 0x7fc7180b6c40 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 >> v1:172.21.15.77:6789/0 conn(0x7fc7180b6c40 legacy=0x7fc7180b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704003c60 0x7fc704004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc704004800 0x7fc704004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 0x7fc70400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180d4310 con 0x7fc704004800 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc704005540 con 0x7fc704003c60 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc70400bf00 con 0x7fc7180bae00 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.792+0000 7fc71d324640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc704004800 0x7fc704004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71db25640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704003c60 0x7fc704004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71e326640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 0x7fc70400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71d324640 1 -- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 msgr2=0x7fc70400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71d324640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180bae00 0x7fc70400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71d324640 1 -- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704003c60 msgr2=0x7fc704004060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71d324640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704003c60 0x7fc704004060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71d324640 1 -- 172.21.15.77:0/3128971201 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc704003520 con 0x7fc704004800 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.793+0000 7fc71d324640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc704004800 0x7fc704004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc708009ac0 tx=0x7fc704005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df92ad64af775b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708036070 con 0x7fc704004800 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc708031400 con 0x7fc704004800 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71cb23640 1 -- 172.21.15.77:0/3128971201 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708009690 con 0x7fc704004800 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71fd89640 1 -- 172.21.15.77:0/3128971201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc704004800 msgr2=0x7fc704004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3128971201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc704004800 0x7fc704004c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc708009ac0 tx=0x7fc704005830 comp rx=0 tx=0).stop 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71e326640 1 -- 172.21.15.77:0/3128971201 reap_dead start 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71fd89640 1 -- 172.21.15.77:0/3128971201 shutdown_connections 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71fd89640 1 -- 172.21.15.77:0/3128971201 >> 172.21.15.77:0/3128971201 conn(0x7fc718074150 msgr2=0x7fc7180d1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71fd89640 1 -- 172.21.15.77:0/3128971201 shutdown_connections 2024-05-15T12:09:42.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.794+0000 7fc71fd89640 1 -- 172.21.15.77:0/3128971201 wait complete. 2024-05-15T12:09:42.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.795+0000 7fc71fd89640 1 Processor -- start 2024-05-15T12:09:42.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.795+0000 7fc71fd89640 1 -- start start 2024-05-15T12:09:42.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71fd89640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704004800 0x7fc718161890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71fd89640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 0x7fc7180c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71fd89640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180cb8a0 0x7fc7180c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71fd89640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180d4c90 con 0x7fc7180cb420 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71fd89640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc7180d4b10 con 0x7fc704004800 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71fd89640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc7180d4e10 con 0x7fc7180cb8a0 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71d324640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 0x7fc7180c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71d324640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 0x7fc7180c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57610/0 (socket says 172.21.15.77:57610) 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71d324640 1 -- 172.21.15.77:0/3109908061 learned_addr learned my addr 172.21.15.77:0/3109908061 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71db25640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704004800 0x7fc718161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71e326640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180cb8a0 0x7fc7180c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71d324640 1 -- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180cb8a0 msgr2=0x7fc7180c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71d324640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180cb8a0 0x7fc7180c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.796+0000 7fc71d324640 1 -- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704004800 msgr2=0x7fc718161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc71d324640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704004800 0x7fc718161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc71d324640 1 -- 172.21.15.77:0/3109908061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc718160790 con 0x7fc7180cb420 2024-05-15T12:09:42.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc71e326640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180cb8a0 0x7fc7180c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc71d324640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 0x7fc7180c9060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc708034040 tx=0x7fc708004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708041020 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70803c470 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc718160a70 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc708036040 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.797+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc718161030 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.798+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71806a640 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.798+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc708044020 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.799+0000 7fc70e7fc640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc6fc076300 0x7fc6fc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.799+0000 7fc71db25640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc6fc076300 0x7fc6fc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.799+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fc7080b7290 con 0x7fc7180cb420 2024-05-15T12:09:42.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.799+0000 7fc71db25640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc6fc076300 0x7fc6fc0787c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7140018d0 tx=0x7fc714009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:42.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:42.804+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc708080690 con 0x7fc7180cb420 2024-05-15T12:09:43.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.023+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc7180d1000 con 0x7fc7180cb420 2024-05-15T12:09:43.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.659+0000 7fc70e7fc640 1 -- 172.21.15.77:0/3109908061 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fc708084990 con 0x7fc7180cb420 2024-05-15T12:09:43.654 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc6fc076300 msgr2=0x7fc6fc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc6fc076300 0x7fc6fc0787c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7140018d0 tx=0x7fc714009040 comp rx=0 tx=0).stop 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 msgr2=0x7fc7180c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 0x7fc7180c9060 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc708034040 tx=0x7fc708004730 comp rx=0 tx=0).stop 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 shutdown_connections 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc6fc076300 0x7fc6fc0787c0 secure :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc7140018d0 tx=0x7fc714009040 comp rx=0 tx=0).stop 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc7180cb8a0 0x7fc7180c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7180cb420 0x7fc7180c9060 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc708034040 tx=0x7fc708004730 comp rx=0 tx=0).stop 2024-05-15T12:09:43.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.663+0000 7fc71fd89640 1 --2- 172.21.15.77:0/3109908061 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc704004800 0x7fc718161890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.664+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 >> 172.21.15.77:0/3109908061 conn(0x7fc718074150 msgr2=0x7fc7180b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:43.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.664+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 shutdown_connections 2024-05-15T12:09:43.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.665+0000 7fc71fd89640 1 -- 172.21.15.77:0/3109908061 wait complete. 2024-05-15T12:09:43.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:43.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.792+0000 7faecc664640 1 Processor -- start 2024-05-15T12:09:43.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.792+0000 7faecc664640 1 -- start start 2024-05-15T12:09:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecc664640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7faec40d28c0 0x7faec40d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecc664640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faec40d57e0 0x7faec40cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:43.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecc664640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faec41631d0 con 0x7faec415f1d0 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecc664640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7faec40d5c50 con 0x7faec40d57e0 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecc664640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7faec4162f80 con 0x7faec40d28c0 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecac01640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faec40d57e0 0x7faec40cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecac01640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faec40d57e0 0x7faec40cf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57624/0 (socket says 172.21.15.77:57624) 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faecac01640 1 -- 172.21.15.77:0/1380788432 learned_addr learned my addr 172.21.15.77:0/1380788432 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.793+0000 7faec9bff640 1 --2- 172.21.15.77:0/1380788432 >> v2:172.21.15.83:3300/0 conn(0x7faec40d28c0 0x7faec40d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faecac01640 1 -- 172.21.15.77:0/1380788432 >> v2:172.21.15.83:3300/0 conn(0x7faec40d28c0 msgr2=0x7faec40d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faecac01640 1 --2- 172.21.15.77:0/1380788432 >> v2:172.21.15.83:3300/0 conn(0x7faec40d28c0 0x7faec40d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faecac01640 1 -- 172.21.15.77:0/1380788432 >> v1:172.21.15.83:6789/0 conn(0x7faec415f1d0 legacy=0x7faec40d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faecac01640 1 -- 172.21.15.77:0/1380788432 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec41634b0 con 0x7faec40d57e0 2024-05-15T12:09:43.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faecac01640 1 --2- 172.21.15.77:0/1380788432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40cf960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faec40d51f0 tx=0x7faebc02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03941551cff19b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:43.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faec93fe640 1 -- 172.21.15.77:0/1380788432 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc037070 con 0x7faec40d57e0 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faec93fe640 1 -- 172.21.15.77:0/1380788432 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faebc02ae50 con 0x7faec40d57e0 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.794+0000 7faec93fe640 1 -- 172.21.15.77:0/1380788432 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faebc032860 con 0x7faec40d57e0 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 -- 172.21.15.77:0/1380788432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 msgr2=0x7faec40cf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 --2- 172.21.15.77:0/1380788432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40cf960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faec40d51f0 tx=0x7faebc02a300 comp rx=0 tx=0).stop 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 -- 172.21.15.77:0/1380788432 shutdown_connections 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 --2- 172.21.15.77:0/1380788432 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40cf960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 --2- 172.21.15.77:0/1380788432 >> v2:172.21.15.83:3300/0 conn(0x7faec40d28c0 0x7faec40d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 -- 172.21.15.77:0/1380788432 >> 172.21.15.77:0/1380788432 conn(0x7faec4073f10 msgr2=0x7faec4074320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 -- 172.21.15.77:0/1380788432 shutdown_connections 2024-05-15T12:09:43.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.795+0000 7faecc664640 1 -- 172.21.15.77:0/1380788432 wait complete. 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.796+0000 7faecc664640 1 Processor -- start 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.796+0000 7faecc664640 1 -- start start 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecc664640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec40d28c0 0x7faec4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecc664640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecc664640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec415f1d0 0x7faec40ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecc664640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faec4163a70 con 0x7faec40d57e0 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecc664640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7faec40d4ef0 con 0x7faec415f1d0 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecc664640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7faec40cfea0 con 0x7faec40d28c0 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faec9bff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faec9bff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57630/0 (socket says 172.21.15.77:57630) 2024-05-15T12:09:43.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faec9bff640 1 -- 172.21.15.77:0/3095268664 learned_addr learned my addr 172.21.15.77:0/3095268664 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faecac01640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec415f1d0 0x7faec40ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.797+0000 7faeca400640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec40d28c0 0x7faec4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faec9bff640 1 -- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec40d28c0 msgr2=0x7faec4154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faec9bff640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec40d28c0 0x7faec4154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faec9bff640 1 -- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec415f1d0 msgr2=0x7faec40ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faec9bff640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec415f1d0 0x7faec40ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faec9bff640 1 -- 172.21.15.77:0/3095268664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec40abdd0 con 0x7faec40d57e0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faeca400640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec40d28c0 0x7faec4154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faecac01640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec415f1d0 0x7faec40ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faec9bff640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40ae250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e9b0 tx=0x7faeb400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb4017070 con 0x7faec40d57e0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faeb400c9a0 con 0x7faec40d57e0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec40ac0b0 con 0x7faec40d57e0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb400cd90 con 0x7faec40d57e0 2024-05-15T12:09:43.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.798+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec40ac670 con 0x7faec40d57e0 2024-05-15T12:09:43.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.799+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec40d2690 con 0x7faec40d57e0 2024-05-15T12:09:43.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.800+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7faeb401a070 con 0x7faec40d57e0 2024-05-15T12:09:43.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.800+0000 7faebaffd640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faea80762d0 0x7faea8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:43.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.800+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faeb40979c0 con 0x7faec40d57e0 2024-05-15T12:09:43.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.800+0000 7faeca400640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faea80762d0 0x7faea8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:43.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.800+0000 7faeca400640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faea80762d0 0x7faea8078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faec40d3fc0 tx=0x7faec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:43.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.805+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7faec40d2690 con 0x7faec40d57e0 2024-05-15T12:09:43.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:09:43.911 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:09:43.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.989+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faec406a640 con 0x7faec40d57e0 2024-05-15T12:09:43.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.990+0000 7faebaffd640 1 -- 172.21.15.77:0/3095268664 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16550 (secure 0 0 0) 0x7faeb4099e20 con 0x7faec40d57e0 2024-05-15T12:09:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:43.985 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:43.024915+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.992+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faea80762d0 msgr2=0x7faea8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.992+0000 7faecc664640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faea80762d0 0x7faea8078790 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faec40d3fc0 tx=0x7faec0009040 comp rx=0 tx=0).stop 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.992+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 msgr2=0x7faec40ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.992+0000 7faecc664640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40ae250 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faeb400e9b0 tx=0x7faeb400ee70 comp rx=0 tx=0).stop 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 shutdown_connections 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faea80762d0 0x7faea8078790 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7faec415f1d0 0x7faec40ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faec40d57e0 0x7faec40ae250 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 --2- 172.21.15.77:0/3095268664 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7faec40d28c0 0x7faec4154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 >> 172.21.15.77:0/3095268664 conn(0x7faec4073f10 msgr2=0x7faec40babb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 shutdown_connections 2024-05-15T12:09:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:43.993+0000 7faecc664640 1 -- 172.21.15.77:0/3095268664 wait complete. 2024-05-15T12:09:43.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.143+0000 7ff120ff7640 1 Processor -- start 2024-05-15T12:09:44.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.143+0000 7ff120ff7640 1 -- start start 2024-05-15T12:09:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff120ff7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff11c15b720 0x7ff11c072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff120ff7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff11c06f0f0 0x7ff11c06f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff120ff7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff11c0b3fc0 con 0x7ff11c0b5920 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff120ff7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff11c06fa80 con 0x7ff11c06f0f0 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff120ff7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff11c0b6100 con 0x7ff11c15b720 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff11c06f0f0 0x7ff11c06f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff11c06f0f0 0x7ff11c06f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57638/0 (socket says 172.21.15.77:57638) 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 -- 172.21.15.77:0/749976538 learned_addr learned my addr 172.21.15.77:0/749976538 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11a59c640 1 --2- 172.21.15.77:0/749976538 >> v2:172.21.15.83:3300/0 conn(0x7ff11c15b720 0x7ff11c072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 -- 172.21.15.77:0/749976538 >> v2:172.21.15.83:3300/0 conn(0x7ff11c15b720 msgr2=0x7ff11c072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 --2- 172.21.15.77:0/749976538 >> v2:172.21.15.83:3300/0 conn(0x7ff11c15b720 0x7ff11c072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 -- 172.21.15.77:0/749976538 >> v1:172.21.15.83:6789/0 conn(0x7ff11c0b5920 legacy=0x7ff11c0b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11ad9d640 1 -- 172.21.15.77:0/749976538 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c0b4260 con 0x7ff11c06f0f0 2024-05-15T12:09:44.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.144+0000 7ff11a59c640 1 --2- 172.21.15.77:0/749976538 >> v2:172.21.15.83:3300/0 conn(0x7ff11c15b720 0x7ff11c072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.145+0000 7ff11ad9d640 1 --2- 172.21.15.77:0/749976538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c06f0f0 0x7ff11c06f540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0b0b40 tx=0x7ff11402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f444c832ce57c470 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.145+0000 7ff119d9b640 1 -- 172.21.15.77:0/749976538 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114036070 con 0x7ff11c06f0f0 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.145+0000 7ff119d9b640 1 -- 172.21.15.77:0/749976538 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114031400 con 0x7ff11c06f0f0 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.145+0000 7ff119d9b640 1 -- 172.21.15.77:0/749976538 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1140317d0 con 0x7ff11c06f0f0 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.145+0000 7ff120ff7640 1 -- 172.21.15.77:0/749976538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c06f0f0 msgr2=0x7ff11c06f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.145+0000 7ff120ff7640 1 --2- 172.21.15.77:0/749976538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c06f0f0 0x7ff11c06f540 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff11c0b0b40 tx=0x7ff11402a5d0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.146+0000 7ff120ff7640 1 -- 172.21.15.77:0/749976538 shutdown_connections 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.146+0000 7ff120ff7640 1 --2- 172.21.15.77:0/749976538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c06f0f0 0x7ff11c06f540 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.146+0000 7ff120ff7640 1 --2- 172.21.15.77:0/749976538 >> v2:172.21.15.83:3300/0 conn(0x7ff11c15b720 0x7ff11c072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.146+0000 7ff120ff7640 1 -- 172.21.15.77:0/749976538 >> 172.21.15.77:0/749976538 conn(0x7ff11c06c810 msgr2=0x7ff11c06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.146+0000 7ff120ff7640 1 -- 172.21.15.77:0/749976538 shutdown_connections 2024-05-15T12:09:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.146+0000 7ff120ff7640 1 -- 172.21.15.77:0/749976538 wait complete. 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.147+0000 7ff120ff7640 1 Processor -- start 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.147+0000 7ff120ff7640 1 -- start start 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff11c06f0f0 0x7ff11c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff11c0b5920 0x7ff11c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 0x7ff11c1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c15bb00 con 0x7ff11c15b720 2024-05-15T12:09:44.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff11c0b63e0 con 0x7ff11c0b5920 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff11c0b5d80 con 0x7ff11c06f0f0 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 0x7ff11c1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 0x7ff11c1567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57652/0 (socket says 172.21.15.77:57652) 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 -- 172.21.15.77:0/740813851 learned_addr learned my addr 172.21.15.77:0/740813851 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff111d9b640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff11c0b5920 0x7ff11c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11a59c640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff11c06f0f0 0x7ff11c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 -- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff11c06f0f0 msgr2=0x7ff11c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff11c06f0f0 0x7ff11c152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 -- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff11c0b5920 msgr2=0x7ff11c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff11c0b5920 0x7ff11c157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 -- 172.21.15.77:0/740813851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff11c0cab90 con 0x7ff11c15b720 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff111d9b640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff11c0b5920 0x7ff11c157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff11ad9d640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 0x7ff11c1567e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff114009f10 tx=0x7ff114004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff114036050 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff114042070 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.148+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff11c0cae70 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.149+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff11403d8b0 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.149+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff11c0cb430 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.149+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff11c06a640 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.150+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff11403da50 con 0x7ff11c15b720 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.150+0000 7ff1137fe640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff0fc0762d0 0x7ff0fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.151+0000 7ff11a59c640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff0fc0762d0 0x7ff0fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.151+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff1140b83e0 con 0x7ff11c15b720 2024-05-15T12:09:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.151+0000 7ff11a59c640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff0fc0762d0 0x7ff0fc078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00b840 tx=0x7ff10c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:44.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.155+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff114081d40 con 0x7ff11c15b720 2024-05-15T12:09:44.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.337+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff11c0d0730 con 0x7ff11c15b720 2024-05-15T12:09:44.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.338+0000 7ff1137fe640 1 -- 172.21.15.77:0/740813851 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16550 (secure 0 0 0) 0x7ff114081640 con 0x7ff11c15b720 2024-05-15T12:09:44.333 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:44.334 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":20,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:43.024915+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:44.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff0fc0762d0 msgr2=0x7ff0fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff0fc0762d0 0x7ff0fc078790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff10c00b840 tx=0x7ff10c008040 comp rx=0 tx=0).stop 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 msgr2=0x7ff11c1567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 0x7ff11c1567e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff114009f10 tx=0x7ff114004a40 comp rx=0 tx=0).stop 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 shutdown_connections 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff0fc0762d0 0x7ff0fc078790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff11c15b720 0x7ff11c1567e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff11c0b5920 0x7ff11c157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 --2- 172.21.15.77:0/740813851 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff11c06f0f0 0x7ff11c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.340+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 >> 172.21.15.77:0/740813851 conn(0x7ff11c06c810 msgr2=0x7ff11c151880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.341+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 shutdown_connections 2024-05-15T12:09:44.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.341+0000 7ff120ff7640 1 -- 172.21.15.77:0/740813851 wait complete. 2024-05-15T12:09:44.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-15T12:09:44.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.454+0000 7f47e0304640 1 Processor -- start 2024-05-15T12:09:44.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.454+0000 7f47e0304640 1 -- start start 2024-05-15T12:09:44.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47e0304640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8073770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47e0304640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47d813ff00 0x7f47d8140390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47e0304640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d815cff0 con 0x7f47d80ce6d0 2024-05-15T12:09:44.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47e0304640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f47d80ceab0 con 0x7f47d813ff00 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47e0304640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f47d815d2d0 con 0x7f47d80732f0 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47de8a1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f47d813ff00 0x7f47d8140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47de0a0640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f47d80ce6d0 0x7f47d815c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:53012/0 (socket says 172.21.15.77:53012) 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47dd89f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.455+0000 7f47de0a0640 1 -- 172.21.15.77:0/864672882 learned_addr learned my addr 172.21.15.77:0/864672882 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.456+0000 7f47de8a1640 1 -- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 msgr2=0x7f47d8073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.456+0000 7f47de8a1640 1 --2- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8073770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.456+0000 7f47de8a1640 1 -- 172.21.15.77:0/864672882 >> v1:172.21.15.83:6789/0 conn(0x7f47d80ce6d0 legacy=0x7f47d815c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.456+0000 7f47de8a1640 1 -- 172.21.15.77:0/864672882 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d813f700 con 0x7f47d813ff00 2024-05-15T12:09:44.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.456+0000 7f47dd89f640 1 --2- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:44.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.456+0000 7f47de8a1640 1 --2- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d813ff00 0x7f47d8140390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009d90 tx=0x7f47d002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=208bf8cc08c6f3a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:44.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47dd09e640 1 -- 172.21.15.77:0/864672882 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0007740 con 0x7f47d813ff00 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47dd09e640 1 -- 172.21.15.77:0/864672882 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d00078e0 con 0x7f47d813ff00 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47dd09e640 1 -- 172.21.15.77:0/864672882 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0007cb0 con 0x7f47d813ff00 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 -- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d813ff00 msgr2=0x7f47d8140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 --2- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d813ff00 0x7f47d8140390 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009d90 tx=0x7f47d002a660 comp rx=0 tx=0).stop 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 -- 172.21.15.77:0/864672882 shutdown_connections 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 --2- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d813ff00 0x7f47d8140390 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 --2- 172.21.15.77:0/864672882 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 -- 172.21.15.77:0/864672882 >> 172.21.15.77:0/864672882 conn(0x7f47d80b3c30 msgr2=0x7f47d80b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 -- 172.21.15.77:0/864672882 shutdown_connections 2024-05-15T12:09:44.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.457+0000 7f47e0304640 1 -- 172.21.15.77:0/864672882 wait complete. 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.458+0000 7f47e0304640 1 Processor -- start 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.458+0000 7f47e0304640 1 -- start start 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47e0304640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47e0304640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80ce6d0 0x7f47d8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47e0304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 0x7f47d8152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47e0304640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f47d8070be0 con 0x7f47d813ff00 2024-05-15T12:09:44.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47e0304640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f47d8070a60 con 0x7f47d80ce6d0 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47e0304640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f47d815cbe0 con 0x7f47d80732f0 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47de8a1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 0x7f47d8152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47de8a1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 0x7f47d8152240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57668/0 (socket says 172.21.15.77:57668) 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47de8a1640 1 -- 172.21.15.77:0/2856372261 learned_addr learned my addr 172.21.15.77:0/2856372261 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47dd89f640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80ce6d0 0x7f47d8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.459+0000 7f47de0a0640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47de8a1640 1 -- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 msgr2=0x7f47d8155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47de8a1640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47de8a1640 1 -- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80ce6d0 msgr2=0x7f47d8151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47de8a1640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80ce6d0 0x7f47d8151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47de8a1640 1 -- 172.21.15.77:0/2856372261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d81f4780 con 0x7f47d813ff00 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47dd89f640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80ce6d0 0x7f47d8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47de8a1640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 0x7f47d8152240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47d002ac50 tx=0x7f47d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:44.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d003f070 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47d0031bc0 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d81f7220 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47d0009450 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.460+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d81f77e0 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.461+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d81f7010 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.461+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f47d003b410 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.462+0000 7f47ceffd640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f47bc0762d0 0x7f47bc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.462+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f47d00b8dc0 con 0x7f47d813ff00 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.462+0000 7f47de0a0640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f47bc0762d0 0x7f47bc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:44.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.462+0000 7f47de0a0640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f47bc0762d0 0x7f47bc078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47d4000f60 tx=0x7f47d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:44.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.466+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f47d00820d0 con 0x7f47d813ff00 2024-05-15T12:09:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:44.687+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f47d80694d0 con 0x7f47d813ff00 2024-05-15T12:09:45.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.677+0000 7f47ceffd640 1 -- 172.21.15.77:0/2856372261 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f47d00863d0 con 0x7f47d813ff00 2024-05-15T12:09:45.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f47bc0762d0 msgr2=0x7f47bc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:45.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f47bc0762d0 0x7f47bc078790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47d4000f60 tx=0x7f47d4009040 comp rx=0 tx=0).stop 2024-05-15T12:09:45.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 msgr2=0x7f47d8152240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 0x7f47d8152240 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47d002ac50 tx=0x7f47d0004a40 comp rx=0 tx=0).stop 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 shutdown_connections 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f47bc0762d0 0x7f47bc078790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47d813ff00 0x7f47d8152240 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f47d80ce6d0 0x7f47d8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 --2- 172.21.15.77:0/2856372261 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f47d80732f0 0x7f47d8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 >> 172.21.15.77:0/2856372261 conn(0x7f47d80b3c30 msgr2=0x7f47d80b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 shutdown_connections 2024-05-15T12:09:45.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.680+0000 7f47e0304640 1 -- 172.21.15.77:0/2856372261 wait complete. 2024-05-15T12:09:45.688 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-15T12:09:45.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-15T12:09:45.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.802+0000 7f5b76650640 1 Processor -- start 2024-05-15T12:09:45.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.802+0000 7f5b76650640 1 -- start start 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b76650640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b700ce6d0 0x7f5b7015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b76650640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b70073a00 0x7f5b7013ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b76650640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b7015cff0 con 0x7f5b7015ca10 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b76650640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5b700ceab0 con 0x7f5b700ce6d0 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b76650640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5b7015d2d0 con 0x7f5b70073a00 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b700ce6d0 0x7f5b7015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b700ce6d0 0x7f5b7015c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57672/0 (socket says 172.21.15.77:57672) 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 -- 172.21.15.77:0/589378182 learned_addr learned my addr 172.21.15.77:0/589378182 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 -- 172.21.15.77:0/589378182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b70073a00 msgr2=0x7f5b7013ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b74bed640 1 --2- 172.21.15.77:0/589378182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b70073a00 0x7f5b7013ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 --2- 172.21.15.77:0/589378182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b70073a00 0x7f5b7013ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 -- 172.21.15.77:0/589378182 >> v1:172.21.15.83:6789/0 conn(0x7f5b7015ca10 legacy=0x7f5b700732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:45.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.803+0000 7f5b6ffff640 1 -- 172.21.15.77:0/589378182 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b7013f700 con 0x7f5b700ce6d0 2024-05-15T12:09:45.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.804+0000 7f5b6ffff640 1 --2- 172.21.15.77:0/589378182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b700ce6d0 0x7f5b7015c4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b6002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d891c082afa81d81 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:45.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.804+0000 7f5b6f7fe640 1 -- 172.21.15.77:0/589378182 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60037070 con 0x7f5b700ce6d0 2024-05-15T12:09:45.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.804+0000 7f5b6f7fe640 1 -- 172.21.15.77:0/589378182 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60032440 con 0x7f5b700ce6d0 2024-05-15T12:09:45.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.804+0000 7f5b6f7fe640 1 -- 172.21.15.77:0/589378182 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60032810 con 0x7f5b700ce6d0 2024-05-15T12:09:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.804+0000 7f5b76650640 1 -- 172.21.15.77:0/589378182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b700ce6d0 msgr2=0x7f5b7015c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.804+0000 7f5b76650640 1 --2- 172.21.15.77:0/589378182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b700ce6d0 0x7f5b7015c4d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b6002a130 comp rx=0 tx=0).stop 2024-05-15T12:09:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.805+0000 7f5b76650640 1 -- 172.21.15.77:0/589378182 shutdown_connections 2024-05-15T12:09:45.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.805+0000 7f5b76650640 1 --2- 172.21.15.77:0/589378182 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b70073a00 0x7f5b7013ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.805+0000 7f5b76650640 1 --2- 172.21.15.77:0/589378182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b700ce6d0 0x7f5b7015c4d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.805+0000 7f5b76650640 1 -- 172.21.15.77:0/589378182 >> 172.21.15.77:0/589378182 conn(0x7f5b700b3c30 msgr2=0x7f5b700b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.805+0000 7f5b76650640 1 -- 172.21.15.77:0/589378182 shutdown_connections 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.805+0000 7f5b76650640 1 -- 172.21.15.77:0/589378182 wait complete. 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 Processor -- start 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 -- start start 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 0x7f5b700b2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b700ce6d0 0x7f5b700b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b7015ca10 0x7f5b7013e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70070be0 con 0x7f5b70073a00 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5b70070a60 con 0x7f5b7015ca10 2024-05-15T12:09:45.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.806+0000 7f5b76650640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5b70140440 con 0x7f5b700ce6d0 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 0x7f5b700b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 0x7f5b700b2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57682/0 (socket says 172.21.15.77:57682) 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 -- 172.21.15.77:0/3475795184 learned_addr learned my addr 172.21.15.77:0/3475795184 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b74bed640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b7015ca10 0x7f5b7013e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b67fff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b700ce6d0 0x7f5b700b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 -- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b700ce6d0 msgr2=0x7f5b700b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b700ce6d0 0x7f5b700b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 -- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b7015ca10 msgr2=0x7f5b7013e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b7015ca10 0x7f5b7013e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 -- 172.21.15.77:0/3475795184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b70159aa0 con 0x7f5b70073a00 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b67fff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b700ce6d0 0x7f5b700b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6ffff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 0x7f5b700b2900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:45.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60041020 con 0x7f5b70073a00 2024-05-15T12:09:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60030970 con 0x7f5b70073a00 2024-05-15T12:09:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60037040 con 0x7f5b70073a00 2024-05-15T12:09:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b70138170 con 0x7f5b70073a00 2024-05-15T12:09:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.807+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b701386f0 con 0x7f5b70073a00 2024-05-15T12:09:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.808+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b70075b90 con 0x7f5b70073a00 2024-05-15T12:09:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.809+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b60044020 con 0x7f5b70073a00 2024-05-15T12:09:45.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.809+0000 7f5b6d7fa640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5b500762d0 0x7f5b50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:45.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.809+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b600b7b20 con 0x7f5b70073a00 2024-05-15T12:09:45.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.809+0000 7f5b67fff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5b500762d0 0x7f5b50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:45.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.810+0000 7f5b67fff640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5b500762d0 0x7f5b50078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b58006fd0 tx=0x7f5b58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:45.814+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b6004b070 con 0x7f5b70073a00 2024-05-15T12:09:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.031+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5b700d2bf0 con 0x7f5b70073a00 2024-05-15T12:09:46.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.685+0000 7f5b6d7fa640 1 -- 172.21.15.77:0/3475795184 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f5b60081510 con 0x7f5b70073a00 2024-05-15T12:09:46.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5b500762d0 msgr2=0x7f5b50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5b500762d0 0x7f5b50078790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5b58006fd0 tx=0x7f5b58008040 comp rx=0 tx=0).stop 2024-05-15T12:09:46.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 msgr2=0x7f5b700b2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 0x7f5b700b2900 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5b60009870 tx=0x7f5b600046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 shutdown_connections 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5b500762d0 0x7f5b50078790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5b700ce6d0 0x7f5b700b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5b7015ca10 0x7f5b7013e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 --2- 172.21.15.77:0/3475795184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b70073a00 0x7f5b700b2900 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 >> 172.21.15.77:0/3475795184 conn(0x7f5b700b3c30 msgr2=0x7f5b700b6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 shutdown_connections 2024-05-15T12:09:46.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.687+0000 7f5b76650640 1 -- 172.21.15.77:0/3475795184 wait complete. 2024-05-15T12:09:46.695 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-15T12:09:46.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:09:46.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.806+0000 7f24811b6640 1 Processor -- start 2024-05-15T12:09:46.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.806+0000 7f24811b6640 1 -- start start 2024-05-15T12:09:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f24811b6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f247c0cfe70 0x7f247c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f24811b6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c072680 con 0x7f247c0cf9e0 2024-05-15T12:09:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f24811b6640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247c072960 con 0x7f247c148b10 2024-05-15T12:09:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f24811b6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f247c0d0280 con 0x7f247c0cfe70 2024-05-15T12:09:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f2473fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f247c0cf9e0 0x7f247c06e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49016/0 (socket says 172.21.15.77:49016) 2024-05-15T12:09:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f2473fff640 1 -- 172.21.15.77:0/678984032 learned_addr learned my addr 172.21.15.77:0/678984032 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 671148915 0 0) 0x7f247c072680 con 0x7f247c0cf9e0 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2468003520 con 0x7f247c0cf9e0 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247b59e640 1 --2- 172.21.15.77:0/678984032 >> v2:172.21.15.83:3300/0 conn(0x7f247c0cfe70 0x7f247c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3860099236 0 0) 0x7f2468003520 con 0x7f247c0cf9e0 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 >> v2:172.21.15.83:3300/0 conn(0x7f247c0cfe70 msgr2=0x7f247c0706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 --2- 172.21.15.77:0/678984032 >> v2:172.21.15.83:3300/0 conn(0x7f247c0cfe70 0x7f247c0706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 >> v1:172.21.15.83:6789/0 conn(0x7f247c148b10 legacy=0x7f247c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c06dbb0 con 0x7f247c0cf9e0 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f24640016f0 con 0x7f247c0cf9e0 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 >> v1:172.21.15.77:6789/0 conn(0x7f247c0cf9e0 legacy=0x7f247c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2468003ac0 0x7f2468003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2468004800 0x7f2468004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468005410 0x7f246800ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f247c0d0280 con 0x7f2468003ac0 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f246800c350 con 0x7f2468005410 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.807+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f246800c550 con 0x7f2468004800 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2468003ac0 0x7f2468003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f2473fff640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2468004800 0x7f2468004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247b59e640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468005410 0x7f246800ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 -- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2468004800 msgr2=0x7f2468004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2468004800 0x7f2468004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 -- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468005410 msgr2=0x7f246800ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468005410 0x7f246800ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 -- 172.21.15.77:0/678984032 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468003520 con 0x7f2468003ac0 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247b59e640 1 -- 172.21.15.77:0/678984032 reap_dead start 2024-05-15T12:09:46.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.808+0000 7f247ad9d640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2468003ac0 0x7f2468003ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f246c001790 tx=0x7f2468005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f0c5565495c1c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c0013b0 con 0x7f2468003ac0 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c0052d0 con 0x7f2468003ac0 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f247a59c640 1 -- 172.21.15.77:0/678984032 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c02aa80 con 0x7f2468003ac0 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 -- 172.21.15.77:0/678984032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2468003ac0 msgr2=0x7f2468003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2468003ac0 0x7f2468003ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f246c001790 tx=0x7f2468005830 comp rx=0 tx=0).stop 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 -- 172.21.15.77:0/678984032 shutdown_connections 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 --2- 172.21.15.77:0/678984032 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2468003ac0 0x7f2468003ee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 -- 172.21.15.77:0/678984032 >> 172.21.15.77:0/678984032 conn(0x7f247c0d2fd0 msgr2=0x7f247c0d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 -- 172.21.15.77:0/678984032 shutdown_connections 2024-05-15T12:09:46.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.809+0000 7f24811b6640 1 -- 172.21.15.77:0/678984032 wait complete. 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 Processor -- start 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 -- start start 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468003ac0 0x7f247c143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 0x7f247c15ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f247c1f5aa0 0x7f247c1f5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f247c0b6100 con 0x7f247c140fd0 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f247c148ef0 con 0x7f2468003ac0 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f24811b6640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f247c0b6280 con 0x7f247c1f5aa0 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f2473fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 0x7f247c15ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f2473fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 0x7f247c15ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57700/0 (socket says 172.21.15.77:57700) 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f2473fff640 1 -- 172.21.15.77:0/1954384999 learned_addr learned my addr 172.21.15.77:0/1954384999 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f247ad9d640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468003ac0 0x7f247c143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.811+0000 7f247b59e640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f247c1f5aa0 0x7f247c1f5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f2473fff640 1 -- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f247c1f5aa0 msgr2=0x7f247c1f5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f2473fff640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f247c1f5aa0 0x7f247c1f5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f2473fff640 1 -- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468003ac0 msgr2=0x7f247c143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f2473fff640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468003ac0 0x7f247c143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f2473fff640 1 -- 172.21.15.77:0/1954384999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c1f6460 con 0x7f247c140fd0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f2473fff640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 0x7f247c15ea20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2464004ec0 tx=0x7f2464007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246400f7b0 con 0x7f247c140fd0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2464018070 con 0x7f247c140fd0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c1427c0 con 0x7f247c140fd0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246400fbd0 con 0x7f247c140fd0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.812+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c141a00 con 0x7f247c140fd0 2024-05-15T12:09:46.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.813+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247c06a640 con 0x7f247c140fd0 2024-05-15T12:09:46.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.814+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f246401d460 con 0x7f247c140fd0 2024-05-15T12:09:46.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.814+0000 7f24737fe640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f245c0762d0 0x7f245c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:46.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.814+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2464097380 con 0x7f247c140fd0 2024-05-15T12:09:46.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.814+0000 7f247ad9d640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f245c0762d0 0x7f245c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:46.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.814+0000 7f247ad9d640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f245c0762d0 0x7f245c078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f246c032000 tx=0x7f246c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:46.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:46.818+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f247c1f6460 con 0x7f247c140fd0 2024-05-15T12:09:47.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.035+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f247c071510 con 0x7f247c140fd0 2024-05-15T12:09:47.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.035+0000 7f24737fe640 1 -- 172.21.15.77:0/1954384999 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f2464060690 con 0x7f247c140fd0 2024-05-15T12:09:47.030 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:47.030 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:09:47.031 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:09:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f245c0762d0 msgr2=0x7f245c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f245c0762d0 0x7f245c078790 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f246c032000 tx=0x7f246c02e000 comp rx=0 tx=0).stop 2024-05-15T12:09:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 msgr2=0x7f247c15ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 0x7f247c15ea20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2464004ec0 tx=0x7f2464007430 comp rx=0 tx=0).stop 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 shutdown_connections 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f245c0762d0 0x7f245c078790 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f247c1f5aa0 0x7f247c1f5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f247c140fd0 0x7f247c15ea20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 --2- 172.21.15.77:0/1954384999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2468003ac0 0x7f247c143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 >> 172.21.15.77:0/1954384999 conn(0x7f247c0d2fd0 msgr2=0x7f247c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 shutdown_connections 2024-05-15T12:09:47.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.037+0000 7f24811b6640 1 -- 172.21.15.77:0/1954384999 wait complete. 2024-05-15T12:09:47.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.148+0000 7fa1d9c2a640 1 Processor -- start 2024-05-15T12:09:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.148+0000 7fa1d9c2a640 1 -- start start 2024-05-15T12:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d9c2a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1d415d520 0x7fa1d4071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d9c2a640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4143150 0x7fa1d40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d9c2a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d41435b0 con 0x7fa1d4070c30 2024-05-15T12:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d9c2a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d4071060 con 0x7fa1d415d520 2024-05-15T12:09:47.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d9c2a640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d4072210 con 0x7fa1d4143150 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1d415d520 0x7fa1d4071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1d415d520 0x7fa1d4071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57702/0 (socket says 172.21.15.77:57702) 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 -- 172.21.15.77:0/3511474964 learned_addr learned my addr 172.21.15.77:0/3511474964 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 -- 172.21.15.77:0/3511474964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4143150 msgr2=0x7fa1d40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 --2- 172.21.15.77:0/3511474964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4143150 0x7fa1d40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 -- 172.21.15.77:0/3511474964 >> v1:172.21.15.83:6789/0 conn(0x7fa1d4070c30 legacy=0x7fa1d4160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:47.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.149+0000 7fa1d37fe640 1 -- 172.21.15.77:0/3511474964 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d40724f0 con 0x7fa1d415d520 2024-05-15T12:09:47.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.150+0000 7fa1d37fe640 1 --2- 172.21.15.77:0/3511474964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4071c30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973ff124f0e40a62 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.150+0000 7fa1d27fc640 1 -- 172.21.15.77:0/3511474964 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4036070 con 0x7fa1d415d520 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.150+0000 7fa1d27fc640 1 -- 172.21.15.77:0/3511474964 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c4031600 con 0x7fa1d415d520 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.150+0000 7fa1d27fc640 1 -- 172.21.15.77:0/3511474964 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40319d0 con 0x7fa1d415d520 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/3511474964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 msgr2=0x7fa1d4071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/3511474964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4071c30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c402a680 comp rx=0 tx=0).stop 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/3511474964 shutdown_connections 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/3511474964 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4143150 0x7fa1d40706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/3511474964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4071c30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/3511474964 >> 172.21.15.77:0/3511474964 conn(0x7fa1d40d2fd0 msgr2=0x7fa1d40d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/3511474964 shutdown_connections 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.151+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/3511474964 wait complete. 2024-05-15T12:09:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.152+0000 7fa1d9c2a640 1 Processor -- start 2024-05-15T12:09:47.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.152+0000 7fa1d9c2a640 1 -- start start 2024-05-15T12:09:47.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d9c2a640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4070c30 0x7fa1d41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d9c2a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d4143150 0x7fa1d4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d9c2a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d9c2a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d415d900 con 0x7fa1d415d520 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d9c2a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4072ab0 con 0x7fa1d4143150 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d9c2a640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d40d18c0 con 0x7fa1d4070c30 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57704/0 (socket says 172.21.15.77:57704) 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 -- 172.21.15.77:0/41619886 learned_addr learned my addr 172.21.15.77:0/41619886 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d37fe640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4070c30 0x7fa1d41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d2ffd640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d4143150 0x7fa1d4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 -- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4070c30 msgr2=0x7fa1d41591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4070c30 0x7fa1d41591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 -- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d4143150 msgr2=0x7fa1d4154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d4143150 0x7fa1d4154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 -- 172.21.15.77:0/41619886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d415ab50 con 0x7fa1d415d520 2024-05-15T12:09:47.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d2ffd640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d4143150 0x7fa1d4154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.153+0000 7fa1d3fff640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4154bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c390 tx=0x7fa1cc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.154+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc017070 con 0x7fa1d415d520 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.154+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1cc0035f0 con 0x7fa1d415d520 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.154+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc0039e0 con 0x7fa1d415d520 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.154+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d4159ab0 con 0x7fa1d415d520 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.154+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d415a070 con 0x7fa1d415d520 2024-05-15T12:09:47.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.155+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d406a640 con 0x7fa1d415d520 2024-05-15T12:09:47.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.155+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa1cc003b80 con 0x7fa1d415d520 2024-05-15T12:09:47.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.156+0000 7fa1bbfff640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa1c00762d0 0x7fa1c0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.156+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa1cc0968a0 con 0x7fa1d415d520 2024-05-15T12:09:47.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.156+0000 7fa1d37fe640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa1c00762d0 0x7fa1c0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.156+0000 7fa1d37fe640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa1c00762d0 0x7fa1c0078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4033000 tx=0x7fa1c4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.160+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa1cc060200 con 0x7fa1d415d520 2024-05-15T12:09:47.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.343+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1d40b8200 con 0x7fa1d415d520 2024-05-15T12:09:47.339 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.344+0000 7fa1bbfff640 1 -- 172.21.15.77:0/41619886 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7fa1cc05fb00 con 0x7fa1d415d520 2024-05-15T12:09:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:47.340 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:47.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa1c00762d0 msgr2=0x7fa1c0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa1c00762d0 0x7fa1c0078790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4033000 tx=0x7fa1c4009000 comp rx=0 tx=0).stop 2024-05-15T12:09:47.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 msgr2=0x7fa1d4154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4154bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa1cc00c390 tx=0x7fa1cc00c850 comp rx=0 tx=0).stop 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 shutdown_connections 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa1c00762d0 0x7fa1c0078790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1d415d520 0x7fa1d4154bb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa1d4143150 0x7fa1d4154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 --2- 172.21.15.77:0/41619886 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa1d4070c30 0x7fa1d41591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 >> 172.21.15.77:0/41619886 conn(0x7fa1d40d2fd0 msgr2=0x7fa1d4140640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 shutdown_connections 2024-05-15T12:09:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.346+0000 7fa1d9c2a640 1 -- 172.21.15.77:0/41619886 wait complete. 2024-05-15T12:09:47.353 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T12:09:47.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:47.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.459+0000 7fb2f79c8640 1 Processor -- start 2024-05-15T12:09:47.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.459+0000 7fb2f79c8640 1 -- start start 2024-05-15T12:09:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f79c8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb2f015d520 0x7fb2f0071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f79c8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0143150 0x7fb2f00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f79c8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2f0070c30 0x7fb2f0160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f79c8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb2f0071060 con 0x7fb2f0070c30 2024-05-15T12:09:47.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f79c8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb2f01435b0 con 0x7fb2f015d520 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f79c8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f0072210 con 0x7fb2f0143150 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2f0070c30 0x7fb2f0160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb2f0070c30 0x7fb2f0160bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57708/0 (socket says 172.21.15.77:57708) 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 -- 172.21.15.77:0/2256845976 learned_addr learned my addr 172.21.15.77:0/2256845976 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f4f63640 1 --2- 172.21.15.77:0/2256845976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0143150 0x7fb2f00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 -- 172.21.15.77:0/2256845976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0143150 msgr2=0x7fb2f00706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5764640 1 --2- 172.21.15.77:0/2256845976 >> v2:172.21.15.83:3300/0 conn(0x7fb2f015d520 0x7fb2f0071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 --2- 172.21.15.77:0/2256845976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0143150 0x7fb2f00706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 -- 172.21.15.77:0/2256845976 >> v2:172.21.15.83:3300/0 conn(0x7fb2f015d520 msgr2=0x7fb2f0071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 --2- 172.21.15.77:0/2256845976 >> v2:172.21.15.83:3300/0 conn(0x7fb2f015d520 0x7fb2f0071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.460+0000 7fb2f5f65640 1 -- 172.21.15.77:0/2256845976 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f00724f0 con 0x7fb2f0070c30 2024-05-15T12:09:47.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.461+0000 7fb2f5f65640 1 --2- 172.21.15.77:0/2256845976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0070c30 0x7fb2f0160bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0072fd0 tx=0x7fb2e002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85178ca185c9293 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.461+0000 7fb2effff640 1 -- 172.21.15.77:0/2256845976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0036070 con 0x7fb2f0070c30 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.461+0000 7fb2effff640 1 -- 172.21.15.77:0/2256845976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e0031600 con 0x7fb2f0070c30 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.461+0000 7fb2effff640 1 -- 172.21.15.77:0/2256845976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e00319d0 con 0x7fb2f0070c30 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.461+0000 7fb2f79c8640 1 -- 172.21.15.77:0/2256845976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0070c30 msgr2=0x7fb2f0160bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.461+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/2256845976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0070c30 0x7fb2f0160bd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0072fd0 tx=0x7fb2e002a6a0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 -- 172.21.15.77:0/2256845976 shutdown_connections 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/2256845976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0070c30 0x7fb2f0160bd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/2256845976 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0143150 0x7fb2f00706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/2256845976 >> v2:172.21.15.83:3300/0 conn(0x7fb2f015d520 0x7fb2f0071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 -- 172.21.15.77:0/2256845976 >> 172.21.15.77:0/2256845976 conn(0x7fb2f00d2fd0 msgr2=0x7fb2f00d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 -- 172.21.15.77:0/2256845976 shutdown_connections 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.462+0000 7fb2f79c8640 1 -- 172.21.15.77:0/2256845976 wait complete. 2024-05-15T12:09:47.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 Processor -- start 2024-05-15T12:09:47.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 -- start start 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0070c30 0x7fb2f01580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 0x7fb2f0141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2f015d520 0x7fb2f0141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f015d900 con 0x7fb2f0143150 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0072ab0 con 0x7fb2f015d520 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.463+0000 7fb2f79c8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f00d18c0 con 0x7fb2f0070c30 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 0x7fb2f0141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 0x7fb2f0141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57724/0 (socket says 172.21.15.77:57724) 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 -- 172.21.15.77:0/658015389 learned_addr learned my addr 172.21.15.77:0/658015389 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:47.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f5764640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0070c30 0x7fb2f01580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f5f65640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2f015d520 0x7fb2f0141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 -- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0070c30 msgr2=0x7fb2f01580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0070c30 0x7fb2f01580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 -- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2f015d520 msgr2=0x7fb2f0141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2f015d520 0x7fb2f0141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 -- 172.21.15.77:0/658015389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f0154e40 con 0x7fb2f0143150 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f4f63640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 0x7fb2f0141510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c7f0 tx=0x7fb2e400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4015070 con 0x7fb2f0143150 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2e4004240 con 0x7fb2f0143150 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01550e0 con 0x7fb2f0143150 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e4007620 con 0x7fb2f0143150 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.464+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01556a0 con 0x7fb2f0143150 2024-05-15T12:09:47.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.465+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f006a640 con 0x7fb2f0143150 2024-05-15T12:09:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.466+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb2e40079d0 con 0x7fb2f0143150 2024-05-15T12:09:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.466+0000 7fb2edffb640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb2dc0762d0 0x7fb2dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.466+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2e4097970 con 0x7fb2f0143150 2024-05-15T12:09:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.466+0000 7fb2f5764640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb2dc0762d0 0x7fb2dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.467+0000 7fb2f5764640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb2dc0762d0 0x7fb2dc078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800aa40 tx=0x7fb2e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.471+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2e4060c80 con 0x7fb2f0143150 2024-05-15T12:09:47.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.646+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2f0154120 con 0x7fb2dc0762d0 2024-05-15T12:09:47.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.652+0000 7fb2edffb640 1 -- 172.21.15.77:0/658015389 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245951 (secure 0 0 0) 0x7fb2f0154120 con 0x7fb2dc0762d0 2024-05-15T12:09:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:47.652 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:47.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb2dc0762d0 msgr2=0x7fb2dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb2dc0762d0 0x7fb2dc078790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800aa40 tx=0x7fb2e8008040 comp rx=0 tx=0).stop 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 msgr2=0x7fb2f0141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 0x7fb2f0141510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2e400c7f0 tx=0x7fb2e400ccb0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 shutdown_connections 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb2dc0762d0 0x7fb2dc078790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb2f015d520 0x7fb2f0141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2f0143150 0x7fb2f0141510 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 --2- 172.21.15.77:0/658015389 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb2f0070c30 0x7fb2f01580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.655+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 >> 172.21.15.77:0/658015389 conn(0x7fb2f00d2fd0 msgr2=0x7fb2f015bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.656+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 shutdown_connections 2024-05-15T12:09:47.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.656+0000 7fb2f79c8640 1 -- 172.21.15.77:0/658015389 wait complete. 2024-05-15T12:09:47.661 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-15T12:09:46.243823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591074,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219004,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2686976,"data_stored":1660561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":706,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.587071"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675610+0000","last_change":"2024-05-15T12:09:42.675610+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675610+0000","last_undegraded":"2024-05-15T12:09:42.675610+0000","last_fullsized":"2024-05-15T12:09:42.675610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675367+0000","last_change":"2024-05-15T12:09:42.675367+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675367+0000","last_undegraded":"2024-05-15T12:09:42.675367+0000","last_fullsized":"2024-05-15T12:09:42.675367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.671381+0000","last_change":"2024-05-15T12:09:42.671381+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.671381+0000","last_undegraded":"2024-05-15T12:09:42.671381+0000","last_fullsized":"2024-05-15T12:09:42.671381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673323+0000","last_change":"2024-05-15T12:09:42.673323+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673323+0000","last_undegraded":"2024-05-15T12:09:42.673323+0000","last_fullsized":"2024-05-15T12:09:42.673323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675013+0000","last_change":"2024-05-15T12:09:42.675013+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675013+0000","last_undegraded":"2024-05-15T12:09:42.675013+0000","last_fullsized":"2024-05-15T12:09:42.675013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675698+0000","last_change":"2024-05-15T12:09:42.675698+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675698+0000","last_undegraded":"2024-05-15T12:09:42.675698+0000","last_fullsized":"2024-05-15T12:09:42.675698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687713+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:43.687713+0000","last_peered":"2024-05-15T12:09:43.687713+0000","last_clean":"2024-05-15T12:09:43.687713+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:43.687713+0000","last_undegraded":"2024-05-15T12:09:43.687713+0000","last_fullsized":"2024-05-15T12:09:43.687713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697693+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:43.697693+0000","last_peered":"2024-05-15T12:09:43.697693+0000","last_clean":"2024-05-15T12:09:43.697693+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:43.697693+0000","last_undegraded":"2024-05-15T12:09:43.697693+0000","last_fullsized":"2024-05-15T12:09:43.697693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688966+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:43.688966+0000","last_peered":"2024-05-15T12:09:43.688966+0000","last_clean":"2024-05-15T12:09:43.688966+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:43.688966+0000","last_undegraded":"2024-05-15T12:09:43.688966+0000","last_fullsized":"2024-05-15T12:09:43.688966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:14.308287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.680388+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:43.680388+0000","last_peered":"2024-05-15T12:09:43.680388+0000","last_clean":"2024-05-15T12:09:43.680388+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:43.680388+0000","last_undegraded":"2024-05-15T12:09:43.680388+0000","last_fullsized":"2024-05-15T12:09:43.680388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675337+0000","last_change":"2024-05-15T12:09:42.675337+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675337+0000","last_undegraded":"2024-05-15T12:09:42.675337+0000","last_fullsized":"2024-05-15T12:09:42.675337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.689424+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:43.689424+0000","last_peered":"2024-05-15T12:09:43.689424+0000","last_clean":"2024-05-15T12:09:43.689424+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:43.689424+0000","last_undegraded":"2024-05-15T12:09:43.689424+0000","last_fullsized":"2024-05-15T12:09:43.689424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687349+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:43.687349+0000","last_peered":"2024-05-15T12:09:43.687349+0000","last_clean":"2024-05-15T12:09:43.687349+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:43.687349+0000","last_undegraded":"2024-05-15T12:09:43.687349+0000","last_fullsized":"2024-05-15T12:09:43.687349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.678110+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:43.678110+0000","last_peered":"2024-05-15T12:09:43.678110+0000","last_clean":"2024-05-15T12:09:43.678110+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:43.678110+0000","last_undegraded":"2024-05-15T12:09:43.678110+0000","last_fullsized":"2024-05-15T12:09:43.678110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:19.840876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688148+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:43.688148+0000","last_peered":"2024-05-15T12:09:43.688148+0000","last_clean":"2024-05-15T12:09:43.688148+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:43.688148+0000","last_undegraded":"2024-05-15T12:09:43.688148+0000","last_fullsized":"2024-05-15T12:09:43.688148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664627+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:43.664627+0000","last_peered":"2024-05-15T12:09:43.664627+0000","last_clean":"2024-05-15T12:09:43.664627+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:43.664627+0000","last_undegraded":"2024-05-15T12:09:43.664627+0000","last_fullsized":"2024-05-15T12:09:43.664627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685627+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:42.685627+0000","last_peered":"2024-05-15T12:09:42.685627+0000","last_clean":"2024-05-15T12:09:42.685627+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:42.685627+0000","last_undegraded":"2024-05-15T12:09:42.685627+0000","last_fullsized":"2024-05-15T12:09:42.685627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:14:24.882724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.679017+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:43.679017+0000","last_peered":"2024-05-15T12:09:43.679017+0000","last_clean":"2024-05-15T12:09:43.679017+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:43.679017+0000","last_undegraded":"2024-05-15T12:09:43.679017+0000","last_fullsized":"2024-05-15T12:09:43.679017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687307+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:43.687307+0000","last_peered":"2024-05-15T12:09:43.687307+0000","last_clean":"2024-05-15T12:09:43.687307+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:43.687307+0000","last_undegraded":"2024-05-15T12:09:43.687307+0000","last_fullsized":"2024-05-15T12:09:43.687307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-15T12:09:41.662209+0000","last_change":"2024-05-15T12:09:41.662209+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.662209+0000","last_undegraded":"2024-05-15T12:09:41.662209+0000","last_fullsized":"2024-05-15T12:09:41.662209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673535+0000","last_change":"2024-05-15T12:09:42.673535+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673535+0000","last_undegraded":"2024-05-15T12:09:42.673535+0000","last_fullsized":"2024-05-15T12:09:42.673535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.691816+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:43.691816+0000","last_peered":"2024-05-15T12:09:43.691816+0000","last_clean":"2024-05-15T12:09:43.691816+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:43.691816+0000","last_undegraded":"2024-05-15T12:09:43.691816+0000","last_fullsized":"2024-05-15T12:09:43.691816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664659+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:43.664659+0000","last_peered":"2024-05-15T12:09:43.664659+0000","last_clean":"2024-05-15T12:09:43.664659+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:43.664659+0000","last_undegraded":"2024-05-15T12:09:43.664659+0000","last_fullsized":"2024-05-15T12:09:43.664659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697671+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:43.697671+0000","last_peered":"2024-05-15T12:09:43.697671+0000","last_clean":"2024-05-15T12:09:43.697671+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:43.697671+0000","last_undegraded":"2024-05-15T12:09:43.697671+0000","last_fullsized":"2024-05-15T12:09:43.697671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688493+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:42.688493+0000","last_peered":"2024-05-15T12:09:42.688493+0000","last_clean":"2024-05-15T12:09:42.688493+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:42.688493+0000","last_undegraded":"2024-05-15T12:09:42.688493+0000","last_fullsized":"2024-05-15T12:09:42.688493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:04.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687273+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:43.687273+0000","last_peered":"2024-05-15T12:09:43.687273+0000","last_clean":"2024-05-15T12:09:43.687273+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:43.687273+0000","last_undegraded":"2024-05-15T12:09:43.687273+0000","last_fullsized":"2024-05-15T12:09:43.687273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688392+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:42.688392+0000","last_peered":"2024-05-15T12:09:42.688392+0000","last_clean":"2024-05-15T12:09:42.688392+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:42.688392+0000","last_undegraded":"2024-05-15T12:09:42.688392+0000","last_fullsized":"2024-05-15T12:09:42.688392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:34:06.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675209+0000","last_change":"2024-05-15T12:09:42.675209+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675209+0000","last_undegraded":"2024-05-15T12:09:42.675209+0000","last_fullsized":"2024-05-15T12:09:42.675209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.674192+0000","last_change":"2024-05-15T12:09:42.674192+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.674192+0000","last_undegraded":"2024-05-15T12:09:42.674192+0000","last_fullsized":"2024-05-15T12:09:42.674192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.673978+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:43.673978+0000","last_peered":"2024-05-15T12:09:43.673978+0000","last_clean":"2024-05-15T12:09:43.673978+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:43.673978+0000","last_undegraded":"2024-05-15T12:09:43.673978+0000","last_fullsized":"2024-05-15T12:09:43.673978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664134+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:43.664134+0000","last_peered":"2024-05-15T12:09:43.664134+0000","last_clean":"2024-05-15T12:09:43.664134+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:43.664134+0000","last_undegraded":"2024-05-15T12:09:43.664134+0000","last_fullsized":"2024-05-15T12:09:43.664134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664772+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:43.664772+0000","last_peered":"2024-05-15T12:09:43.664772+0000","last_clean":"2024-05-15T12:09:43.664772+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:43.664772+0000","last_undegraded":"2024-05-15T12:09:43.664772+0000","last_fullsized":"2024-05-15T12:09:43.664772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.668358+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:43.668358+0000","last_peered":"2024-05-15T12:09:43.668358+0000","last_clean":"2024-05-15T12:09:43.668358+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:43.668358+0000","last_undegraded":"2024-05-15T12:09:43.668358+0000","last_fullsized":"2024-05-15T12:09:43.668358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664803+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:43.664803+0000","last_peered":"2024-05-15T12:09:43.664803+0000","last_clean":"2024-05-15T12:09:43.664803+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:43.664803+0000","last_undegraded":"2024-05-15T12:09:43.664803+0000","last_fullsized":"2024-05-15T12:09:43.664803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675853+0000","last_change":"2024-05-15T12:09:42.675853+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675853+0000","last_undegraded":"2024-05-15T12:09:42.675853+0000","last_fullsized":"2024-05-15T12:09:42.675853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.665840+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:43.665840+0000","last_peered":"2024-05-15T12:09:43.665840+0000","last_clean":"2024-05-15T12:09:43.665840+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:43.665840+0000","last_undegraded":"2024-05-15T12:09:43.665840+0000","last_fullsized":"2024-05-15T12:09:43.665840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666562+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:44.666562+0000","last_peered":"2024-05-15T12:09:44.666562+0000","last_clean":"2024-05-15T12:09:44.666562+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:44.666562+0000","last_undegraded":"2024-05-15T12:09:44.666562+0000","last_fullsized":"2024-05-15T12:09:44.666562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.692038+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:43.692038+0000","last_peered":"2024-05-15T12:09:43.692038+0000","last_clean":"2024-05-15T12:09:43.692038+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:43.692038+0000","last_undegraded":"2024-05-15T12:09:43.692038+0000","last_fullsized":"2024-05-15T12:09:43.692038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.693715+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:42.693715+0000","last_peered":"2024-05-15T12:09:42.693715+0000","last_clean":"2024-05-15T12:09:42.693715+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:42.693715+0000","last_undegraded":"2024-05-15T12:09:42.693715+0000","last_fullsized":"2024-05-15T12:09:42.693715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:14.268472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.676948+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:43.676948+0000","last_peered":"2024-05-15T12:09:43.676948+0000","last_clean":"2024-05-15T12:09:43.676948+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:43.676948+0000","last_undegraded":"2024-05-15T12:09:43.676948+0000","last_fullsized":"2024-05-15T12:09:43.676948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685338+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:43.685338+0000","last_peered":"2024-05-15T12:09:43.685338+0000","last_clean":"2024-05-15T12:09:43.685338+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:43.685338+0000","last_undegraded":"2024-05-15T12:09:43.685338+0000","last_fullsized":"2024-05-15T12:09:43.685338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:42.135888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685783+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:43.685783+0000","last_peered":"2024-05-15T12:09:43.685783+0000","last_clean":"2024-05-15T12:09:43.685783+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:43.685783+0000","last_undegraded":"2024-05-15T12:09:43.685783+0000","last_fullsized":"2024-05-15T12:09:43.685783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.671695+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:43.671695+0000","last_peered":"2024-05-15T12:09:43.671695+0000","last_clean":"2024-05-15T12:09:43.671695+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:43.671695+0000","last_undegraded":"2024-05-15T12:09:43.671695+0000","last_fullsized":"2024-05-15T12:09:43.671695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.693212+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:43.693212+0000","last_peered":"2024-05-15T12:09:43.693212+0000","last_clean":"2024-05-15T12:09:43.693212+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:43.693212+0000","last_undegraded":"2024-05-15T12:09:43.693212+0000","last_fullsized":"2024-05-15T12:09:43.693212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685600+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:42.685600+0000","last_peered":"2024-05-15T12:09:42.685600+0000","last_clean":"2024-05-15T12:09:42.685600+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:42.685600+0000","last_undegraded":"2024-05-15T12:09:42.685600+0000","last_fullsized":"2024-05-15T12:09:42.685600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:06.159469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688347+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:42.688347+0000","last_peered":"2024-05-15T12:09:42.688347+0000","last_clean":"2024-05-15T12:09:42.688347+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:42.688347+0000","last_undegraded":"2024-05-15T12:09:42.688347+0000","last_fullsized":"2024-05-15T12:09:42.688347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:32:07.585125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":706,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":753664,"data_stored":638228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":67309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:47.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.807+0000 7f6054f9e640 1 Processor -- start 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.807+0000 7f6054f9e640 1 -- start start 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f6054f9e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60500d19b0 0x7f60500cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f6054f9e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500d3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f6054f9e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60500d0e90 con 0x7f60500d5b00 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f6054f9e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f60500b8000 con 0x7f60500d19b0 2024-05-15T12:09:47.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f6054f9e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f60500b82e0 con 0x7f60500d1d90 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f604f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60500d19b0 0x7f60500cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f604f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f60500d19b0 0x7f60500cfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57732/0 (socket says 172.21.15.77:57732) 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f604f7fe640 1 -- 172.21.15.77:0/3874490737 learned_addr learned my addr 172.21.15.77:0/3874490737 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f604ffff640 1 --2- 172.21.15.77:0/3874490737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500d3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f604f7fe640 1 -- 172.21.15.77:0/3874490737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 msgr2=0x7f60500d3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.808+0000 7f604f7fe640 1 --2- 172.21.15.77:0/3874490737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500d3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.809+0000 7f604f7fe640 1 -- 172.21.15.77:0/3874490737 >> v1:172.21.15.83:6789/0 conn(0x7f60500d5b00 legacy=0x7f60500d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.809+0000 7f604f7fe640 1 -- 172.21.15.77:0/3874490737 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60500b85c0 con 0x7f60500d19b0 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.809+0000 7f604f7fe640 1 --2- 172.21.15.77:0/3874490737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500cfcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6040009870 tx=0x7f604002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05a9a15770c9edd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.809+0000 7f604e7fc640 1 -- 172.21.15.77:0/3874490737 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040037070 con 0x7f60500d19b0 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.809+0000 7f604e7fc640 1 -- 172.21.15.77:0/3874490737 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6040032440 con 0x7f60500d19b0 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.809+0000 7f604e7fc640 1 -- 172.21.15.77:0/3874490737 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040032810 con 0x7f60500d19b0 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 -- 172.21.15.77:0/3874490737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 msgr2=0x7f60500cfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 --2- 172.21.15.77:0/3874490737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500cfcd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6040009870 tx=0x7f604002a270 comp rx=0 tx=0).stop 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 -- 172.21.15.77:0/3874490737 shutdown_connections 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 --2- 172.21.15.77:0/3874490737 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500d3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 --2- 172.21.15.77:0/3874490737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500cfcd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 -- 172.21.15.77:0/3874490737 >> 172.21.15.77:0/3874490737 conn(0x7f60500d5010 msgr2=0x7f60500d53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:47.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 -- 172.21.15.77:0/3874490737 shutdown_connections 2024-05-15T12:09:47.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.810+0000 7f6054f9e640 1 -- 172.21.15.77:0/3874490737 wait complete. 2024-05-15T12:09:47.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.811+0000 7f6054f9e640 1 Processor -- start 2024-05-15T12:09:47.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.811+0000 7f6054f9e640 1 -- start start 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f6054f9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f6054f9e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500a1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f6054f9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60500d5b00 0x7f60500ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f6054f9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f60500d3ce0 con 0x7f60500d19b0 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f6054f9e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f60500d3b60 con 0x7f60500d5b00 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f6054f9e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f60500b8ac0 con 0x7f60500d1d90 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f604f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f604f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57746/0 (socket says 172.21.15.77:57746) 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f604f7fe640 1 -- 172.21.15.77:0/346488117 learned_addr learned my addr 172.21.15.77:0/346488117 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f604effd640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500a1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.812+0000 7f604ffff640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60500d5b00 0x7f60500ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f604f7fe640 1 -- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 msgr2=0x7f60500a1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f604f7fe640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500a1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f604f7fe640 1 -- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60500d5b00 msgr2=0x7f60500ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f604f7fe640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60500d5b00 0x7f60500ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f604f7fe640 1 -- 172.21.15.77:0/346488117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6050162bb0 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f604f7fe640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500a14e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f60400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040041020 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60500caf30 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60400306c0 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040037040 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.813+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f605014d7f0 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.814+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60500768e0 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.815+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6040044020 con 0x7f60500d19b0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.815+0000 7f6037fff640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f603c0762d0 0x7f603c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.815+0000 7f604effd640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f603c0762d0 0x7f603c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:47.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.815+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f60400b7c10 con 0x7f60500d19b0 2024-05-15T12:09:47.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.816+0000 7f604effd640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f603c0762d0 0x7f603c078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6050150530 tx=0x7f6044009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:47.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.819+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f604004b030 con 0x7f60500d19b0 2024-05-15T12:09:47.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:47.996+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60500cb210 con 0x7f603c0762d0 2024-05-15T12:09:47.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.002+0000 7f6037fff640 1 -- 172.21.15.77:0/346488117 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245951 (secure 0 0 0) 0x7f60500cb210 con 0x7f603c0762d0 2024-05-15T12:09:48.000 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:48.001 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f603c0762d0 msgr2=0x7f603c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f603c0762d0 0x7f603c078790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6050150530 tx=0x7f6044009040 comp rx=0 tx=0).stop 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 msgr2=0x7f60500a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500a14e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f60400046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 shutdown_connections 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f603c0762d0 0x7f603c078790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60500d1d90 0x7f60500a1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f60500d5b00 0x7f60500ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 --2- 172.21.15.77:0/346488117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f60500d19b0 0x7f60500a14e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 >> 172.21.15.77:0/346488117 conn(0x7f60500d5010 msgr2=0x7f60500b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 shutdown_connections 2024-05-15T12:09:48.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.005+0000 7f6054f9e640 1 -- 172.21.15.77:0/346488117 wait complete. 2024-05-15T12:09:48.011 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-05-15T12:09:46.243823+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591074,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":128,"acting":128,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219004,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755716,"statfs":{"total":773094113280,"available":772869853184,"internally_reserved":0,"allocated":2686976,"data_stored":1660561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":706,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.587071"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675610+0000","last_change":"2024-05-15T12:09:42.675610+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675610+0000","last_undegraded":"2024-05-15T12:09:42.675610+0000","last_fullsized":"2024-05-15T12:09:42.675610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675367+0000","last_change":"2024-05-15T12:09:42.675367+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675367+0000","last_undegraded":"2024-05-15T12:09:42.675367+0000","last_fullsized":"2024-05-15T12:09:42.675367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.671381+0000","last_change":"2024-05-15T12:09:42.671381+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.671381+0000","last_undegraded":"2024-05-15T12:09:42.671381+0000","last_fullsized":"2024-05-15T12:09:42.671381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673323+0000","last_change":"2024-05-15T12:09:42.673323+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673323+0000","last_undegraded":"2024-05-15T12:09:42.673323+0000","last_fullsized":"2024-05-15T12:09:42.673323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675013+0000","last_change":"2024-05-15T12:09:42.675013+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675013+0000","last_undegraded":"2024-05-15T12:09:42.675013+0000","last_fullsized":"2024-05-15T12:09:42.675013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675698+0000","last_change":"2024-05-15T12:09:42.675698+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675698+0000","last_undegraded":"2024-05-15T12:09:42.675698+0000","last_fullsized":"2024-05-15T12:09:42.675698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687713+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:43.687713+0000","last_peered":"2024-05-15T12:09:43.687713+0000","last_clean":"2024-05-15T12:09:43.687713+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:43.687713+0000","last_undegraded":"2024-05-15T12:09:43.687713+0000","last_fullsized":"2024-05-15T12:09:43.687713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697693+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:43.697693+0000","last_peered":"2024-05-15T12:09:43.697693+0000","last_clean":"2024-05-15T12:09:43.697693+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:43.697693+0000","last_undegraded":"2024-05-15T12:09:43.697693+0000","last_fullsized":"2024-05-15T12:09:43.697693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688966+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:43.688966+0000","last_peered":"2024-05-15T12:09:43.688966+0000","last_clean":"2024-05-15T12:09:43.688966+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:43.688966+0000","last_undegraded":"2024-05-15T12:09:43.688966+0000","last_fullsized":"2024-05-15T12:09:43.688966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:14.308287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.680388+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:43.680388+0000","last_peered":"2024-05-15T12:09:43.680388+0000","last_clean":"2024-05-15T12:09:43.680388+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:43.680388+0000","last_undegraded":"2024-05-15T12:09:43.680388+0000","last_fullsized":"2024-05-15T12:09:43.680388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675337+0000","last_change":"2024-05-15T12:09:42.675337+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675337+0000","last_undegraded":"2024-05-15T12:09:42.675337+0000","last_fullsized":"2024-05-15T12:09:42.675337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.689424+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:43.689424+0000","last_peered":"2024-05-15T12:09:43.689424+0000","last_clean":"2024-05-15T12:09:43.689424+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:43.689424+0000","last_undegraded":"2024-05-15T12:09:43.689424+0000","last_fullsized":"2024-05-15T12:09:43.689424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687349+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:43.687349+0000","last_peered":"2024-05-15T12:09:43.687349+0000","last_clean":"2024-05-15T12:09:43.687349+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:43.687349+0000","last_undegraded":"2024-05-15T12:09:43.687349+0000","last_fullsized":"2024-05-15T12:09:43.687349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.678110+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:43.678110+0000","last_peered":"2024-05-15T12:09:43.678110+0000","last_clean":"2024-05-15T12:09:43.678110+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:43.678110+0000","last_undegraded":"2024-05-15T12:09:43.678110+0000","last_fullsized":"2024-05-15T12:09:43.678110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:19.840876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688148+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:43.688148+0000","last_peered":"2024-05-15T12:09:43.688148+0000","last_clean":"2024-05-15T12:09:43.688148+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:43.688148+0000","last_undegraded":"2024-05-15T12:09:43.688148+0000","last_fullsized":"2024-05-15T12:09:43.688148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664627+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:43.664627+0000","last_peered":"2024-05-15T12:09:43.664627+0000","last_clean":"2024-05-15T12:09:43.664627+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:43.664627+0000","last_undegraded":"2024-05-15T12:09:43.664627+0000","last_fullsized":"2024-05-15T12:09:43.664627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685627+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:42.685627+0000","last_peered":"2024-05-15T12:09:42.685627+0000","last_clean":"2024-05-15T12:09:42.685627+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:42.685627+0000","last_undegraded":"2024-05-15T12:09:42.685627+0000","last_fullsized":"2024-05-15T12:09:42.685627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:14:24.882724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.679017+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:43.679017+0000","last_peered":"2024-05-15T12:09:43.679017+0000","last_clean":"2024-05-15T12:09:43.679017+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:43.679017+0000","last_undegraded":"2024-05-15T12:09:43.679017+0000","last_fullsized":"2024-05-15T12:09:43.679017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687307+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:43.687307+0000","last_peered":"2024-05-15T12:09:43.687307+0000","last_clean":"2024-05-15T12:09:43.687307+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:43.687307+0000","last_undegraded":"2024-05-15T12:09:43.687307+0000","last_fullsized":"2024-05-15T12:09:43.687307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-05-15T12:09:41.662209+0000","last_change":"2024-05-15T12:09:41.662209+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.662209+0000","last_undegraded":"2024-05-15T12:09:41.662209+0000","last_fullsized":"2024-05-15T12:09:41.662209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673535+0000","last_change":"2024-05-15T12:09:42.673535+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673535+0000","last_undegraded":"2024-05-15T12:09:42.673535+0000","last_fullsized":"2024-05-15T12:09:42.673535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.691816+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:43.691816+0000","last_peered":"2024-05-15T12:09:43.691816+0000","last_clean":"2024-05-15T12:09:43.691816+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:43.691816+0000","last_undegraded":"2024-05-15T12:09:43.691816+0000","last_fullsized":"2024-05-15T12:09:43.691816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664659+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:43.664659+0000","last_peered":"2024-05-15T12:09:43.664659+0000","last_clean":"2024-05-15T12:09:43.664659+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:43.664659+0000","last_undegraded":"2024-05-15T12:09:43.664659+0000","last_fullsized":"2024-05-15T12:09:43.664659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697671+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:43.697671+0000","last_peered":"2024-05-15T12:09:43.697671+0000","last_clean":"2024-05-15T12:09:43.697671+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:43.697671+0000","last_undegraded":"2024-05-15T12:09:43.697671+0000","last_fullsized":"2024-05-15T12:09:43.697671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688493+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:42.688493+0000","last_peered":"2024-05-15T12:09:42.688493+0000","last_clean":"2024-05-15T12:09:42.688493+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:42.688493+0000","last_undegraded":"2024-05-15T12:09:42.688493+0000","last_fullsized":"2024-05-15T12:09:42.688493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:04.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687273+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:43.687273+0000","last_peered":"2024-05-15T12:09:43.687273+0000","last_clean":"2024-05-15T12:09:43.687273+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:43.687273+0000","last_undegraded":"2024-05-15T12:09:43.687273+0000","last_fullsized":"2024-05-15T12:09:43.687273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688392+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:42.688392+0000","last_peered":"2024-05-15T12:09:42.688392+0000","last_clean":"2024-05-15T12:09:42.688392+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:42.688392+0000","last_undegraded":"2024-05-15T12:09:42.688392+0000","last_fullsized":"2024-05-15T12:09:42.688392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:34:06.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675209+0000","last_change":"2024-05-15T12:09:42.675209+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675209+0000","last_undegraded":"2024-05-15T12:09:42.675209+0000","last_fullsized":"2024-05-15T12:09:42.675209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.674192+0000","last_change":"2024-05-15T12:09:42.674192+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.674192+0000","last_undegraded":"2024-05-15T12:09:42.674192+0000","last_fullsized":"2024-05-15T12:09:42.674192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.673978+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:43.673978+0000","last_peered":"2024-05-15T12:09:43.673978+0000","last_clean":"2024-05-15T12:09:43.673978+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:43.673978+0000","last_undegraded":"2024-05-15T12:09:43.673978+0000","last_fullsized":"2024-05-15T12:09:43.673978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664134+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:43.664134+0000","last_peered":"2024-05-15T12:09:43.664134+0000","last_clean":"2024-05-15T12:09:43.664134+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:43.664134+0000","last_undegraded":"2024-05-15T12:09:43.664134+0000","last_fullsized":"2024-05-15T12:09:43.664134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664772+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:43.664772+0000","last_peered":"2024-05-15T12:09:43.664772+0000","last_clean":"2024-05-15T12:09:43.664772+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:43.664772+0000","last_undegraded":"2024-05-15T12:09:43.664772+0000","last_fullsized":"2024-05-15T12:09:43.664772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.668358+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:43.668358+0000","last_peered":"2024-05-15T12:09:43.668358+0000","last_clean":"2024-05-15T12:09:43.668358+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:43.668358+0000","last_undegraded":"2024-05-15T12:09:43.668358+0000","last_fullsized":"2024-05-15T12:09:43.668358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664803+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:43.664803+0000","last_peered":"2024-05-15T12:09:43.664803+0000","last_clean":"2024-05-15T12:09:43.664803+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:43.664803+0000","last_undegraded":"2024-05-15T12:09:43.664803+0000","last_fullsized":"2024-05-15T12:09:43.664803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675853+0000","last_change":"2024-05-15T12:09:42.675853+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675853+0000","last_undegraded":"2024-05-15T12:09:42.675853+0000","last_fullsized":"2024-05-15T12:09:42.675853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.665840+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:43.665840+0000","last_peered":"2024-05-15T12:09:43.665840+0000","last_clean":"2024-05-15T12:09:43.665840+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:43.665840+0000","last_undegraded":"2024-05-15T12:09:43.665840+0000","last_fullsized":"2024-05-15T12:09:43.665840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666562+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:44.666562+0000","last_peered":"2024-05-15T12:09:44.666562+0000","last_clean":"2024-05-15T12:09:44.666562+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:44.666562+0000","last_undegraded":"2024-05-15T12:09:44.666562+0000","last_fullsized":"2024-05-15T12:09:44.666562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.692038+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:43.692038+0000","last_peered":"2024-05-15T12:09:43.692038+0000","last_clean":"2024-05-15T12:09:43.692038+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:43.692038+0000","last_undegraded":"2024-05-15T12:09:43.692038+0000","last_fullsized":"2024-05-15T12:09:43.692038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.693715+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:42.693715+0000","last_peered":"2024-05-15T12:09:42.693715+0000","last_clean":"2024-05-15T12:09:42.693715+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:42.693715+0000","last_undegraded":"2024-05-15T12:09:42.693715+0000","last_fullsized":"2024-05-15T12:09:42.693715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:14.268472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.676948+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:43.676948+0000","last_peered":"2024-05-15T12:09:43.676948+0000","last_clean":"2024-05-15T12:09:43.676948+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:43.676948+0000","last_undegraded":"2024-05-15T12:09:43.676948+0000","last_fullsized":"2024-05-15T12:09:43.676948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685338+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:43.685338+0000","last_peered":"2024-05-15T12:09:43.685338+0000","last_clean":"2024-05-15T12:09:43.685338+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:43.685338+0000","last_undegraded":"2024-05-15T12:09:43.685338+0000","last_fullsized":"2024-05-15T12:09:43.685338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:42.135888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685783+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:43.685783+0000","last_peered":"2024-05-15T12:09:43.685783+0000","last_clean":"2024-05-15T12:09:43.685783+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:43.685783+0000","last_undegraded":"2024-05-15T12:09:43.685783+0000","last_fullsized":"2024-05-15T12:09:43.685783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.671695+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:43.671695+0000","last_peered":"2024-05-15T12:09:43.671695+0000","last_clean":"2024-05-15T12:09:43.671695+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:43.671695+0000","last_undegraded":"2024-05-15T12:09:43.671695+0000","last_fullsized":"2024-05-15T12:09:43.671695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.693212+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:43.693212+0000","last_peered":"2024-05-15T12:09:43.693212+0000","last_clean":"2024-05-15T12:09:43.693212+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:43.693212+0000","last_undegraded":"2024-05-15T12:09:43.693212+0000","last_fullsized":"2024-05-15T12:09:43.693212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685600+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:42.685600+0000","last_peered":"2024-05-15T12:09:42.685600+0000","last_clean":"2024-05-15T12:09:42.685600+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:42.685600+0000","last_undegraded":"2024-05-15T12:09:42.685600+0000","last_fullsized":"2024-05-15T12:09:42.685600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:06.159469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688347+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:42.688347+0000","last_peered":"2024-05-15T12:09:42.688347+0000","last_clean":"2024-05-15T12:09:42.688347+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:42.688347+0000","last_undegraded":"2024-05-15T12:09:42.688347+0000","last_fullsized":"2024-05-15T12:09:42.688347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:32:07.585125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:41.644969+0000","last_change":"2024-05-15T12:09:41.644969+0000","last_active":"2024-05-15T12:09:41.644969+0000","last_peered":"2024-05-15T12:09:41.644969+0000","last_clean":"2024-05-15T12:09:41.644969+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:41.644969+0000","last_undegraded":"2024-05-15T12:09:41.644969+0000","last_fullsized":"2024-05-15T12:09:41.644969+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:09:42.654322+0000","last_change":"2024-05-15T12:09:42.654322+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.654322+0000","last_undegraded":"2024-05-15T12:09:42.654322+0000","last_fullsized":"2024-05-15T12:09:42.654322+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":76,"acting":76,"num_store_stats":5},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":706,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476742,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":159744,"data_stored":47860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":159744,"data_stored":47860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":753664,"data_stored":638228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":67309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:48.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.157+0000 7f8829e93640 1 Processor -- start 2024-05-15T12:09:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.157+0000 7f8829e93640 1 -- start start 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8829e93640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f882406c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8829e93640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8824161440 0x7f88240d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8829e93640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88240d0b80 con 0x7f88240cdfe0 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8829e93640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f88240d0e60 con 0x7f8824161440 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8829e93640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f88240d1140 con 0x7f8824161060 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8822ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8824161440 0x7f88240d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8822ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8824161440 0x7f88240d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57758/0 (socket says 172.21.15.77:57758) 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f8822ffd640 1 -- 172.21.15.77:0/2819742948 learned_addr learned my addr 172.21.15.77:0/2819742948 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.158+0000 7f88237fe640 1 --2- 172.21.15.77:0/2819742948 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f882406c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f8822ffd640 1 -- 172.21.15.77:0/2819742948 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 msgr2=0x7f882406c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f8822ffd640 1 --2- 172.21.15.77:0/2819742948 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f882406c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f8822ffd640 1 -- 172.21.15.77:0/2819742948 >> v1:172.21.15.83:6789/0 conn(0x7f88240cdfe0 legacy=0x7f88240ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:48.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f8822ffd640 1 -- 172.21.15.77:0/2819742948 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88240d1420 con 0x7f8824161440 2024-05-15T12:09:48.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f8822ffd640 1 --2- 172.21.15.77:0/2819742948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8824161440 0x7f88240d0270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8818009870 tx=0x7f881802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28778418db59f76 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f88227fc640 1 -- 172.21.15.77:0/2819742948 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818037070 con 0x7f8824161440 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f88227fc640 1 -- 172.21.15.77:0/2819742948 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8818032440 con 0x7f8824161440 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.159+0000 7f88227fc640 1 -- 172.21.15.77:0/2819742948 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8818032810 con 0x7f8824161440 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 -- 172.21.15.77:0/2819742948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8824161440 msgr2=0x7f88240d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 --2- 172.21.15.77:0/2819742948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8824161440 0x7f88240d0270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8818009870 tx=0x7f881802a1c0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 -- 172.21.15.77:0/2819742948 shutdown_connections 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 --2- 172.21.15.77:0/2819742948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8824161440 0x7f88240d0270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 --2- 172.21.15.77:0/2819742948 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f882406c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 -- 172.21.15.77:0/2819742948 >> 172.21.15.77:0/2819742948 conn(0x7f88240d1dd0 msgr2=0x7f88240b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:48.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 -- 172.21.15.77:0/2819742948 shutdown_connections 2024-05-15T12:09:48.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.160+0000 7f8829e93640 1 -- 172.21.15.77:0/2819742948 wait complete. 2024-05-15T12:09:48.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.161+0000 7f8829e93640 1 Processor -- start 2024-05-15T12:09:48.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.161+0000 7f8829e93640 1 -- start start 2024-05-15T12:09:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f8829e93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 0x7f8824156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f8829e93640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f8824152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f8829e93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8824161440 0x7f88241f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f8829e93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88240d0930 con 0x7f88240cdfe0 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f8829e93640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f88240d07b0 con 0x7f8824161440 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f8829e93640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f88240ceb80 con 0x7f8824161060 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 0x7f8824156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 0x7f8824156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57764/0 (socket says 172.21.15.77:57764) 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 -- 172.21.15.77:0/2522562294 learned_addr learned my addr 172.21.15.77:0/2522562294 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 -- 172.21.15.77:0/2522562294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 msgr2=0x7f8824152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f8824152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 -- 172.21.15.77:0/2522562294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8824161440 msgr2=0x7f88241f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.162+0000 7f88237fe640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8824161440 0x7f88241f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f88237fe640 1 -- 172.21.15.77:0/2522562294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8824156370 con 0x7f88240cdfe0 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f88237fe640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 0x7f8824156e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f881400cdf0 tx=0x7f881400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814003b90 con 0x7f88240cdfe0 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8814003d50 con 0x7f88240cdfe0 2024-05-15T12:09:48.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8824159ad0 con 0x7f88240cdfe0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8814004260 con 0x7f88240cdfe0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.163+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88241568f0 con 0x7f88240cdfe0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.164+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f882406a640 con 0x7f88240cdfe0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.164+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8814004400 con 0x7f88240cdfe0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.165+0000 7f880bfff640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f88100762d0 0x7f8810078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.165+0000 7f8822ffd640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f88100762d0 0x7f8810078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.165+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8814098130 con 0x7f88240cdfe0 2024-05-15T12:09:48.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.165+0000 7f8822ffd640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f88100762d0 0x7f8810078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8818034000 tx=0x7f881802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.169+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8814061a90 con 0x7f88240cdfe0 2024-05-15T12:09:48.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.350+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8824152b60 con 0x7f88100762d0 2024-05-15T12:09:48.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.355+0000 7f880bfff640 1 -- 172.21.15.77:0/2522562294 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251010 (secure 0 0 0) 0x7f881803b3f0 con 0x7f88100762d0 2024-05-15T12:09:48.353 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:48.354 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:48.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f88100762d0 msgr2=0x7f8810078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f88100762d0 0x7f8810078790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8818034000 tx=0x7f881802c000 comp rx=0 tx=0).stop 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 msgr2=0x7f8824156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 0x7f8824156e10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f881400cdf0 tx=0x7f881400a660 comp rx=0 tx=0).stop 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 shutdown_connections 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f88100762d0 0x7f8810078790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f8824161060 0x7f8824152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f8824161440 0x7f88241f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 --2- 172.21.15.77:0/2522562294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88240cdfe0 0x7f8824156e10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 >> 172.21.15.77:0/2522562294 conn(0x7f88240d1dd0 msgr2=0x7f882415ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 shutdown_connections 2024-05-15T12:09:48.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.359+0000 7f8829e93640 1 -- 172.21.15.77:0/2522562294 wait complete. 2024-05-15T12:09:48.364 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-15T12:09:48.244182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2854912,"data_stored":1737766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675610+0000","last_change":"2024-05-15T12:09:42.675610+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675610+0000","last_undegraded":"2024-05-15T12:09:42.675610+0000","last_fullsized":"2024-05-15T12:09:42.675610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665728+0000","last_change":"2024-05-15T12:09:43.684869+0000","last_active":"2024-05-15T12:09:44.665728+0000","last_peered":"2024-05-15T12:09:44.665728+0000","last_clean":"2024-05-15T12:09:44.665728+0000","last_became_active":"2024-05-15T12:09:43.684509+0000","last_became_peered":"2024-05-15T12:09:43.684509+0000","last_unstale":"2024-05-15T12:09:44.665728+0000","last_undegraded":"2024-05-15T12:09:44.665728+0000","last_fullsized":"2024-05-15T12:09:44.665728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665257+0000","last_change":"2024-05-15T12:09:43.689819+0000","last_active":"2024-05-15T12:09:44.665257+0000","last_peered":"2024-05-15T12:09:44.665257+0000","last_clean":"2024-05-15T12:09:44.665257+0000","last_became_active":"2024-05-15T12:09:43.689562+0000","last_became_peered":"2024-05-15T12:09:43.689562+0000","last_unstale":"2024-05-15T12:09:44.665257+0000","last_undegraded":"2024-05-15T12:09:44.665257+0000","last_fullsized":"2024-05-15T12:09:44.665257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570774+0000","last_change":"2024-05-15T12:09:43.682424+0000","last_active":"2024-05-15T12:09:45.570774+0000","last_peered":"2024-05-15T12:09:45.570774+0000","last_clean":"2024-05-15T12:09:45.570774+0000","last_became_active":"2024-05-15T12:09:43.680716+0000","last_became_peered":"2024-05-15T12:09:43.680716+0000","last_unstale":"2024-05-15T12:09:45.570774+0000","last_undegraded":"2024-05-15T12:09:45.570774+0000","last_fullsized":"2024-05-15T12:09:45.570774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675367+0000","last_change":"2024-05-15T12:09:42.675367+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675367+0000","last_undegraded":"2024-05-15T12:09:42.675367+0000","last_fullsized":"2024-05-15T12:09:42.675367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570334+0000","last_change":"2024-05-15T12:09:43.679941+0000","last_active":"2024-05-15T12:09:45.570334+0000","last_peered":"2024-05-15T12:09:45.570334+0000","last_clean":"2024-05-15T12:09:45.570334+0000","last_became_active":"2024-05-15T12:09:43.679673+0000","last_became_peered":"2024-05-15T12:09:43.679673+0000","last_unstale":"2024-05-15T12:09:45.570334+0000","last_undegraded":"2024-05-15T12:09:45.570334+0000","last_fullsized":"2024-05-15T12:09:45.570334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.671381+0000","last_change":"2024-05-15T12:09:42.671381+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.671381+0000","last_undegraded":"2024-05-15T12:09:42.671381+0000","last_fullsized":"2024-05-15T12:09:42.671381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664987+0000","last_change":"2024-05-15T12:09:43.687337+0000","last_active":"2024-05-15T12:09:44.664987+0000","last_peered":"2024-05-15T12:09:44.664987+0000","last_clean":"2024-05-15T12:09:44.664987+0000","last_became_active":"2024-05-15T12:09:43.687077+0000","last_became_peered":"2024-05-15T12:09:43.687077+0000","last_unstale":"2024-05-15T12:09:44.664987+0000","last_undegraded":"2024-05-15T12:09:44.664987+0000","last_fullsized":"2024-05-15T12:09:44.664987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673323+0000","last_change":"2024-05-15T12:09:42.673323+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673323+0000","last_undegraded":"2024-05-15T12:09:42.673323+0000","last_fullsized":"2024-05-15T12:09:42.673323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675013+0000","last_change":"2024-05-15T12:09:42.675013+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675013+0000","last_undegraded":"2024-05-15T12:09:42.675013+0000","last_fullsized":"2024-05-15T12:09:42.675013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675698+0000","last_change":"2024-05-15T12:09:42.675698+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675698+0000","last_undegraded":"2024-05-15T12:09:42.675698+0000","last_fullsized":"2024-05-15T12:09:42.675698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570134+0000","last_change":"2024-05-15T12:09:43.690439+0000","last_active":"2024-05-15T12:09:45.570134+0000","last_peered":"2024-05-15T12:09:45.570134+0000","last_clean":"2024-05-15T12:09:45.570134+0000","last_became_active":"2024-05-15T12:09:43.690122+0000","last_became_peered":"2024-05-15T12:09:43.690122+0000","last_unstale":"2024-05-15T12:09:45.570134+0000","last_undegraded":"2024-05-15T12:09:45.570134+0000","last_fullsized":"2024-05-15T12:09:45.570134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569946+0000","last_change":"2024-05-15T12:09:43.677396+0000","last_active":"2024-05-15T12:09:45.569946+0000","last_peered":"2024-05-15T12:09:45.569946+0000","last_clean":"2024-05-15T12:09:45.569946+0000","last_became_active":"2024-05-15T12:09:43.677134+0000","last_became_peered":"2024-05-15T12:09:43.677134+0000","last_unstale":"2024-05-15T12:09:45.569946+0000","last_undegraded":"2024-05-15T12:09:45.569946+0000","last_fullsized":"2024-05-15T12:09:45.569946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:14.148993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664971+0000","last_change":"2024-05-15T12:09:43.692214+0000","last_active":"2024-05-15T12:09:44.664971+0000","last_peered":"2024-05-15T12:09:44.664971+0000","last_clean":"2024-05-15T12:09:44.664971+0000","last_became_active":"2024-05-15T12:09:43.691930+0000","last_became_peered":"2024-05-15T12:09:43.691930+0000","last_unstale":"2024-05-15T12:09:44.664971+0000","last_undegraded":"2024-05-15T12:09:44.664971+0000","last_fullsized":"2024-05-15T12:09:44.664971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687713+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:43.687713+0000","last_peered":"2024-05-15T12:09:43.687713+0000","last_clean":"2024-05-15T12:09:43.687713+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:43.687713+0000","last_undegraded":"2024-05-15T12:09:43.687713+0000","last_fullsized":"2024-05-15T12:09:43.687713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697693+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:43.697693+0000","last_peered":"2024-05-15T12:09:43.697693+0000","last_clean":"2024-05-15T12:09:43.697693+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:43.697693+0000","last_undegraded":"2024-05-15T12:09:43.697693+0000","last_fullsized":"2024-05-15T12:09:43.697693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688966+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:43.688966+0000","last_peered":"2024-05-15T12:09:43.688966+0000","last_clean":"2024-05-15T12:09:43.688966+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:43.688966+0000","last_undegraded":"2024-05-15T12:09:43.688966+0000","last_fullsized":"2024-05-15T12:09:43.688966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:14.308287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.680388+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:43.680388+0000","last_peered":"2024-05-15T12:09:43.680388+0000","last_clean":"2024-05-15T12:09:43.680388+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:43.680388+0000","last_undegraded":"2024-05-15T12:09:43.680388+0000","last_fullsized":"2024-05-15T12:09:43.680388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675337+0000","last_change":"2024-05-15T12:09:42.675337+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675337+0000","last_undegraded":"2024-05-15T12:09:42.675337+0000","last_fullsized":"2024-05-15T12:09:42.675337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665508+0000","last_change":"2024-05-15T12:09:43.682377+0000","last_active":"2024-05-15T12:09:44.665508+0000","last_peered":"2024-05-15T12:09:44.665508+0000","last_clean":"2024-05-15T12:09:44.665508+0000","last_became_active":"2024-05-15T12:09:43.681994+0000","last_became_peered":"2024-05-15T12:09:43.681994+0000","last_unstale":"2024-05-15T12:09:44.665508+0000","last_undegraded":"2024-05-15T12:09:44.665508+0000","last_fullsized":"2024-05-15T12:09:44.665508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.689424+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:43.689424+0000","last_peered":"2024-05-15T12:09:43.689424+0000","last_clean":"2024-05-15T12:09:43.689424+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:43.689424+0000","last_undegraded":"2024-05-15T12:09:43.689424+0000","last_fullsized":"2024-05-15T12:09:43.689424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665400+0000","last_change":"2024-05-15T12:09:43.684244+0000","last_active":"2024-05-15T12:09:44.665400+0000","last_peered":"2024-05-15T12:09:44.665400+0000","last_clean":"2024-05-15T12:09:44.665400+0000","last_became_active":"2024-05-15T12:09:43.683969+0000","last_became_peered":"2024-05-15T12:09:43.683969+0000","last_unstale":"2024-05-15T12:09:44.665400+0000","last_undegraded":"2024-05-15T12:09:44.665400+0000","last_fullsized":"2024-05-15T12:09:44.665400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570957+0000","last_change":"2024-05-15T12:09:43.680234+0000","last_active":"2024-05-15T12:09:45.570957+0000","last_peered":"2024-05-15T12:09:45.570957+0000","last_clean":"2024-05-15T12:09:45.570957+0000","last_became_active":"2024-05-15T12:09:43.679005+0000","last_became_peered":"2024-05-15T12:09:43.679005+0000","last_unstale":"2024-05-15T12:09:45.570957+0000","last_undegraded":"2024-05-15T12:09:45.570957+0000","last_fullsized":"2024-05-15T12:09:45.570957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569504+0000","last_change":"2024-05-15T12:09:43.679589+0000","last_active":"2024-05-15T12:09:45.569504+0000","last_peered":"2024-05-15T12:09:45.569504+0000","last_clean":"2024-05-15T12:09:45.569504+0000","last_became_active":"2024-05-15T12:09:43.679299+0000","last_became_peered":"2024-05-15T12:09:43.679299+0000","last_unstale":"2024-05-15T12:09:45.569504+0000","last_undegraded":"2024-05-15T12:09:45.569504+0000","last_fullsized":"2024-05-15T12:09:45.569504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569877+0000","last_change":"2024-05-15T12:09:43.690523+0000","last_active":"2024-05-15T12:09:45.569877+0000","last_peered":"2024-05-15T12:09:45.569877+0000","last_clean":"2024-05-15T12:09:45.569877+0000","last_became_active":"2024-05-15T12:09:43.690212+0000","last_became_peered":"2024-05-15T12:09:43.690212+0000","last_unstale":"2024-05-15T12:09:45.569877+0000","last_undegraded":"2024-05-15T12:09:45.569877+0000","last_fullsized":"2024-05-15T12:09:45.569877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665359+0000","last_change":"2024-05-15T12:09:43.682107+0000","last_active":"2024-05-15T12:09:44.665359+0000","last_peered":"2024-05-15T12:09:44.665359+0000","last_clean":"2024-05-15T12:09:44.665359+0000","last_became_active":"2024-05-15T12:09:43.681812+0000","last_became_peered":"2024-05-15T12:09:43.681812+0000","last_unstale":"2024-05-15T12:09:44.665359+0000","last_undegraded":"2024-05-15T12:09:44.665359+0000","last_fullsized":"2024-05-15T12:09:44.665359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687349+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:43.687349+0000","last_peered":"2024-05-15T12:09:43.687349+0000","last_clean":"2024-05-15T12:09:43.687349+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:43.687349+0000","last_undegraded":"2024-05-15T12:09:43.687349+0000","last_fullsized":"2024-05-15T12:09:43.687349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.678110+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:43.678110+0000","last_peered":"2024-05-15T12:09:43.678110+0000","last_clean":"2024-05-15T12:09:43.678110+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:43.678110+0000","last_undegraded":"2024-05-15T12:09:43.678110+0000","last_fullsized":"2024-05-15T12:09:43.678110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:19.840876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570107+0000","last_change":"2024-05-15T12:09:43.681262+0000","last_active":"2024-05-15T12:09:45.570107+0000","last_peered":"2024-05-15T12:09:45.570107+0000","last_clean":"2024-05-15T12:09:45.570107+0000","last_became_active":"2024-05-15T12:09:43.680971+0000","last_became_peered":"2024-05-15T12:09:43.680971+0000","last_unstale":"2024-05-15T12:09:45.570107+0000","last_undegraded":"2024-05-15T12:09:45.570107+0000","last_fullsized":"2024-05-15T12:09:45.570107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665379+0000","last_change":"2024-05-15T12:09:42.676644+0000","last_active":"2024-05-15T12:09:44.665379+0000","last_peered":"2024-05-15T12:09:44.665379+0000","last_clean":"2024-05-15T12:09:44.665379+0000","last_became_active":"2024-05-15T12:09:42.676347+0000","last_became_peered":"2024-05-15T12:09:42.676347+0000","last_unstale":"2024-05-15T12:09:44.665379+0000","last_undegraded":"2024-05-15T12:09:44.665379+0000","last_fullsized":"2024-05-15T12:09:44.665379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688148+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:43.688148+0000","last_peered":"2024-05-15T12:09:43.688148+0000","last_clean":"2024-05-15T12:09:43.688148+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:43.688148+0000","last_undegraded":"2024-05-15T12:09:43.688148+0000","last_fullsized":"2024-05-15T12:09:43.688148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569824+0000","last_change":"2024-05-15T12:09:42.683878+0000","last_active":"2024-05-15T12:09:45.569824+0000","last_peered":"2024-05-15T12:09:45.569824+0000","last_clean":"2024-05-15T12:09:45.569824+0000","last_became_active":"2024-05-15T12:09:42.683562+0000","last_became_peered":"2024-05-15T12:09:42.683562+0000","last_unstale":"2024-05-15T12:09:45.569824+0000","last_undegraded":"2024-05-15T12:09:45.569824+0000","last_fullsized":"2024-05-15T12:09:45.569824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665167+0000","last_change":"2024-05-15T12:09:43.683141+0000","last_active":"2024-05-15T12:09:44.665167+0000","last_peered":"2024-05-15T12:09:44.665167+0000","last_clean":"2024-05-15T12:09:44.665167+0000","last_became_active":"2024-05-15T12:09:43.682835+0000","last_became_peered":"2024-05-15T12:09:43.682835+0000","last_unstale":"2024-05-15T12:09:44.665167+0000","last_undegraded":"2024-05-15T12:09:44.665167+0000","last_fullsized":"2024-05-15T12:09:44.665167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664627+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:43.664627+0000","last_peered":"2024-05-15T12:09:43.664627+0000","last_clean":"2024-05-15T12:09:43.664627+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:43.664627+0000","last_undegraded":"2024-05-15T12:09:43.664627+0000","last_fullsized":"2024-05-15T12:09:43.664627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570969+0000","last_change":"2024-05-15T12:09:43.680034+0000","last_active":"2024-05-15T12:09:45.570969+0000","last_peered":"2024-05-15T12:09:45.570969+0000","last_clean":"2024-05-15T12:09:45.570969+0000","last_became_active":"2024-05-15T12:09:43.678658+0000","last_became_peered":"2024-05-15T12:09:43.678658+0000","last_unstale":"2024-05-15T12:09:45.570969+0000","last_undegraded":"2024-05-15T12:09:45.570969+0000","last_fullsized":"2024-05-15T12:09:45.570969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685627+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:42.685627+0000","last_peered":"2024-05-15T12:09:42.685627+0000","last_clean":"2024-05-15T12:09:42.685627+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:42.685627+0000","last_undegraded":"2024-05-15T12:09:42.685627+0000","last_fullsized":"2024-05-15T12:09:42.685627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:14:24.882724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665608+0000","last_change":"2024-05-15T12:09:43.684173+0000","last_active":"2024-05-15T12:09:44.665608+0000","last_peered":"2024-05-15T12:09:44.665608+0000","last_clean":"2024-05-15T12:09:44.665608+0000","last_became_active":"2024-05-15T12:09:43.683863+0000","last_became_peered":"2024-05-15T12:09:43.683863+0000","last_unstale":"2024-05-15T12:09:44.665608+0000","last_undegraded":"2024-05-15T12:09:44.665608+0000","last_fullsized":"2024-05-15T12:09:44.665608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.679017+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:43.679017+0000","last_peered":"2024-05-15T12:09:43.679017+0000","last_clean":"2024-05-15T12:09:43.679017+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:43.679017+0000","last_undegraded":"2024-05-15T12:09:43.679017+0000","last_fullsized":"2024-05-15T12:09:43.679017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687307+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:43.687307+0000","last_peered":"2024-05-15T12:09:43.687307+0000","last_clean":"2024-05-15T12:09:43.687307+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:43.687307+0000","last_undegraded":"2024-05-15T12:09:43.687307+0000","last_fullsized":"2024-05-15T12:09:43.687307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570672+0000","last_change":"2024-05-15T12:09:42.670666+0000","last_active":"2024-05-15T12:09:45.570672+0000","last_peered":"2024-05-15T12:09:45.570672+0000","last_clean":"2024-05-15T12:09:45.570672+0000","last_became_active":"2024-05-15T12:09:42.669923+0000","last_became_peered":"2024-05-15T12:09:42.669923+0000","last_unstale":"2024-05-15T12:09:45.570672+0000","last_undegraded":"2024-05-15T12:09:45.570672+0000","last_fullsized":"2024-05-15T12:09:45.570672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673535+0000","last_change":"2024-05-15T12:09:42.673535+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673535+0000","last_undegraded":"2024-05-15T12:09:42.673535+0000","last_fullsized":"2024-05-15T12:09:42.673535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.691816+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:43.691816+0000","last_peered":"2024-05-15T12:09:43.691816+0000","last_clean":"2024-05-15T12:09:43.691816+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:43.691816+0000","last_undegraded":"2024-05-15T12:09:43.691816+0000","last_fullsized":"2024-05-15T12:09:43.691816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570051+0000","last_change":"2024-05-15T12:09:43.676947+0000","last_active":"2024-05-15T12:09:45.570051+0000","last_peered":"2024-05-15T12:09:45.570051+0000","last_clean":"2024-05-15T12:09:45.570051+0000","last_became_active":"2024-05-15T12:09:43.676630+0000","last_became_peered":"2024-05-15T12:09:43.676630+0000","last_unstale":"2024-05-15T12:09:45.570051+0000","last_undegraded":"2024-05-15T12:09:45.570051+0000","last_fullsized":"2024-05-15T12:09:45.570051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664659+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:43.664659+0000","last_peered":"2024-05-15T12:09:43.664659+0000","last_clean":"2024-05-15T12:09:43.664659+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:43.664659+0000","last_undegraded":"2024-05-15T12:09:43.664659+0000","last_fullsized":"2024-05-15T12:09:43.664659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697671+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:43.697671+0000","last_peered":"2024-05-15T12:09:43.697671+0000","last_clean":"2024-05-15T12:09:43.697671+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:43.697671+0000","last_undegraded":"2024-05-15T12:09:43.697671+0000","last_fullsized":"2024-05-15T12:09:43.697671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688493+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:42.688493+0000","last_peered":"2024-05-15T12:09:42.688493+0000","last_clean":"2024-05-15T12:09:42.688493+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:42.688493+0000","last_undegraded":"2024-05-15T12:09:42.688493+0000","last_fullsized":"2024-05-15T12:09:42.688493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:04.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687273+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:43.687273+0000","last_peered":"2024-05-15T12:09:43.687273+0000","last_clean":"2024-05-15T12:09:43.687273+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:43.687273+0000","last_undegraded":"2024-05-15T12:09:43.687273+0000","last_fullsized":"2024-05-15T12:09:43.687273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688392+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:42.688392+0000","last_peered":"2024-05-15T12:09:42.688392+0000","last_clean":"2024-05-15T12:09:42.688392+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:42.688392+0000","last_undegraded":"2024-05-15T12:09:42.688392+0000","last_fullsized":"2024-05-15T12:09:42.688392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:34:06.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.571120+0000","last_change":"2024-05-15T12:09:43.691593+0000","last_active":"2024-05-15T12:09:45.571120+0000","last_peered":"2024-05-15T12:09:45.571120+0000","last_clean":"2024-05-15T12:09:45.571120+0000","last_became_active":"2024-05-15T12:09:43.691327+0000","last_became_peered":"2024-05-15T12:09:43.691327+0000","last_unstale":"2024-05-15T12:09:45.571120+0000","last_undegraded":"2024-05-15T12:09:45.571120+0000","last_fullsized":"2024-05-15T12:09:45.571120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675209+0000","last_change":"2024-05-15T12:09:42.675209+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675209+0000","last_undegraded":"2024-05-15T12:09:42.675209+0000","last_fullsized":"2024-05-15T12:09:42.675209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665387+0000","last_change":"2024-05-15T12:09:42.675771+0000","last_active":"2024-05-15T12:09:44.665387+0000","last_peered":"2024-05-15T12:09:44.665387+0000","last_clean":"2024-05-15T12:09:44.665387+0000","last_became_active":"2024-05-15T12:09:42.675470+0000","last_became_peered":"2024-05-15T12:09:42.675470+0000","last_unstale":"2024-05-15T12:09:44.665387+0000","last_undegraded":"2024-05-15T12:09:44.665387+0000","last_fullsized":"2024-05-15T12:09:44.665387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:18.831524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.674192+0000","last_change":"2024-05-15T12:09:42.674192+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.674192+0000","last_undegraded":"2024-05-15T12:09:42.674192+0000","last_fullsized":"2024-05-15T12:09:42.674192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570014+0000","last_change":"2024-05-15T12:09:42.684015+0000","last_active":"2024-05-15T12:09:45.570014+0000","last_peered":"2024-05-15T12:09:45.570014+0000","last_clean":"2024-05-15T12:09:45.570014+0000","last_became_active":"2024-05-15T12:09:42.683509+0000","last_became_peered":"2024-05-15T12:09:42.683509+0000","last_unstale":"2024-05-15T12:09:45.570014+0000","last_undegraded":"2024-05-15T12:09:45.570014+0000","last_fullsized":"2024-05-15T12:09:45.570014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.673978+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:43.673978+0000","last_peered":"2024-05-15T12:09:43.673978+0000","last_clean":"2024-05-15T12:09:43.673978+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:43.673978+0000","last_undegraded":"2024-05-15T12:09:43.673978+0000","last_fullsized":"2024-05-15T12:09:43.673978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664134+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:43.664134+0000","last_peered":"2024-05-15T12:09:43.664134+0000","last_clean":"2024-05-15T12:09:43.664134+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:43.664134+0000","last_undegraded":"2024-05-15T12:09:43.664134+0000","last_fullsized":"2024-05-15T12:09:43.664134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664772+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:43.664772+0000","last_peered":"2024-05-15T12:09:43.664772+0000","last_clean":"2024-05-15T12:09:43.664772+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:43.664772+0000","last_undegraded":"2024-05-15T12:09:43.664772+0000","last_fullsized":"2024-05-15T12:09:43.664772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569728+0000","last_change":"2024-05-15T12:09:43.681455+0000","last_active":"2024-05-15T12:09:45.569728+0000","last_peered":"2024-05-15T12:09:45.569728+0000","last_clean":"2024-05-15T12:09:45.569728+0000","last_became_active":"2024-05-15T12:09:43.681192+0000","last_became_peered":"2024-05-15T12:09:43.681192+0000","last_unstale":"2024-05-15T12:09:45.569728+0000","last_undegraded":"2024-05-15T12:09:45.569728+0000","last_fullsized":"2024-05-15T12:09:45.569728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.668358+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:43.668358+0000","last_peered":"2024-05-15T12:09:43.668358+0000","last_clean":"2024-05-15T12:09:43.668358+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:43.668358+0000","last_undegraded":"2024-05-15T12:09:43.668358+0000","last_fullsized":"2024-05-15T12:09:43.668358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665688+0000","last_change":"2024-05-15T12:09:43.681676+0000","last_active":"2024-05-15T12:09:44.665688+0000","last_peered":"2024-05-15T12:09:44.665688+0000","last_clean":"2024-05-15T12:09:44.665688+0000","last_became_active":"2024-05-15T12:09:43.681405+0000","last_became_peered":"2024-05-15T12:09:43.681405+0000","last_unstale":"2024-05-15T12:09:44.665688+0000","last_undegraded":"2024-05-15T12:09:44.665688+0000","last_fullsized":"2024-05-15T12:09:44.665688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:07:48.262342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664803+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:43.664803+0000","last_peered":"2024-05-15T12:09:43.664803+0000","last_clean":"2024-05-15T12:09:43.664803+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:43.664803+0000","last_undegraded":"2024-05-15T12:09:43.664803+0000","last_fullsized":"2024-05-15T12:09:43.664803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675853+0000","last_change":"2024-05-15T12:09:42.675853+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675853+0000","last_undegraded":"2024-05-15T12:09:42.675853+0000","last_fullsized":"2024-05-15T12:09:42.675853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665274+0000","last_change":"2024-05-15T12:09:42.676729+0000","last_active":"2024-05-15T12:09:44.665274+0000","last_peered":"2024-05-15T12:09:44.665274+0000","last_clean":"2024-05-15T12:09:44.665274+0000","last_became_active":"2024-05-15T12:09:42.676435+0000","last_became_peered":"2024-05-15T12:09:42.676435+0000","last_unstale":"2024-05-15T12:09:44.665274+0000","last_undegraded":"2024-05-15T12:09:44.665274+0000","last_fullsized":"2024-05-15T12:09:44.665274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570802+0000","last_change":"2024-05-15T12:09:43.683565+0000","last_active":"2024-05-15T12:09:45.570802+0000","last_peered":"2024-05-15T12:09:45.570802+0000","last_clean":"2024-05-15T12:09:45.570802+0000","last_became_active":"2024-05-15T12:09:43.683268+0000","last_became_peered":"2024-05-15T12:09:43.683268+0000","last_unstale":"2024-05-15T12:09:45.570802+0000","last_undegraded":"2024-05-15T12:09:45.570802+0000","last_fullsized":"2024-05-15T12:09:45.570802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.665840+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:43.665840+0000","last_peered":"2024-05-15T12:09:43.665840+0000","last_clean":"2024-05-15T12:09:43.665840+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:43.665840+0000","last_undegraded":"2024-05-15T12:09:43.665840+0000","last_fullsized":"2024-05-15T12:09:43.665840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570045+0000","last_change":"2024-05-15T12:09:43.685808+0000","last_active":"2024-05-15T12:09:45.570045+0000","last_peered":"2024-05-15T12:09:45.570045+0000","last_clean":"2024-05-15T12:09:45.570045+0000","last_became_active":"2024-05-15T12:09:43.685355+0000","last_became_peered":"2024-05-15T12:09:43.685355+0000","last_unstale":"2024-05-15T12:09:45.570045+0000","last_undegraded":"2024-05-15T12:09:45.570045+0000","last_fullsized":"2024-05-15T12:09:45.570045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666562+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:44.666562+0000","last_peered":"2024-05-15T12:09:44.666562+0000","last_clean":"2024-05-15T12:09:44.666562+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:44.666562+0000","last_undegraded":"2024-05-15T12:09:44.666562+0000","last_fullsized":"2024-05-15T12:09:44.666562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.692038+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:43.692038+0000","last_peered":"2024-05-15T12:09:43.692038+0000","last_clean":"2024-05-15T12:09:43.692038+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:43.692038+0000","last_undegraded":"2024-05-15T12:09:43.692038+0000","last_fullsized":"2024-05-15T12:09:43.692038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.693715+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:42.693715+0000","last_peered":"2024-05-15T12:09:42.693715+0000","last_clean":"2024-05-15T12:09:42.693715+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:42.693715+0000","last_undegraded":"2024-05-15T12:09:42.693715+0000","last_fullsized":"2024-05-15T12:09:42.693715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:14.268472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.676948+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:43.676948+0000","last_peered":"2024-05-15T12:09:43.676948+0000","last_clean":"2024-05-15T12:09:43.676948+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:43.676948+0000","last_undegraded":"2024-05-15T12:09:43.676948+0000","last_fullsized":"2024-05-15T12:09:43.676948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570171+0000","last_change":"2024-05-15T12:09:42.677520+0000","last_active":"2024-05-15T12:09:45.570171+0000","last_peered":"2024-05-15T12:09:45.570171+0000","last_clean":"2024-05-15T12:09:45.570171+0000","last_became_active":"2024-05-15T12:09:42.677226+0000","last_became_peered":"2024-05-15T12:09:42.677226+0000","last_unstale":"2024-05-15T12:09:45.570171+0000","last_undegraded":"2024-05-15T12:09:45.570171+0000","last_fullsized":"2024-05-15T12:09:45.570171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685338+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:43.685338+0000","last_peered":"2024-05-15T12:09:43.685338+0000","last_clean":"2024-05-15T12:09:43.685338+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:43.685338+0000","last_undegraded":"2024-05-15T12:09:43.685338+0000","last_fullsized":"2024-05-15T12:09:43.685338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:42.135888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685783+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:43.685783+0000","last_peered":"2024-05-15T12:09:43.685783+0000","last_clean":"2024-05-15T12:09:43.685783+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:43.685783+0000","last_undegraded":"2024-05-15T12:09:43.685783+0000","last_fullsized":"2024-05-15T12:09:43.685783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.671695+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:43.671695+0000","last_peered":"2024-05-15T12:09:43.671695+0000","last_clean":"2024-05-15T12:09:43.671695+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:43.671695+0000","last_undegraded":"2024-05-15T12:09:43.671695+0000","last_fullsized":"2024-05-15T12:09:43.671695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.693212+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:43.693212+0000","last_peered":"2024-05-15T12:09:43.693212+0000","last_clean":"2024-05-15T12:09:43.693212+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:43.693212+0000","last_undegraded":"2024-05-15T12:09:43.693212+0000","last_fullsized":"2024-05-15T12:09:43.693212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685600+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:42.685600+0000","last_peered":"2024-05-15T12:09:42.685600+0000","last_clean":"2024-05-15T12:09:42.685600+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:42.685600+0000","last_undegraded":"2024-05-15T12:09:42.685600+0000","last_fullsized":"2024-05-15T12:09:42.685600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:06.159469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688347+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:42.688347+0000","last_peered":"2024-05-15T12:09:42.688347+0000","last_clean":"2024-05-15T12:09:42.688347+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:42.688347+0000","last_undegraded":"2024-05-15T12:09:42.688347+0000","last_fullsized":"2024-05-15T12:09:42.688347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:32:07.585125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665670+0000","last_change":"2024-05-15T12:09:43.684828+0000","last_active":"2024-05-15T12:09:44.665670+0000","last_peered":"2024-05-15T12:09:44.665670+0000","last_clean":"2024-05-15T12:09:44.665670+0000","last_became_active":"2024-05-15T12:09:43.684507+0000","last_became_peered":"2024-05-15T12:09:43.684507+0000","last_unstale":"2024-05-15T12:09:44.665670+0000","last_undegraded":"2024-05-15T12:09:44.665670+0000","last_fullsized":"2024-05-15T12:09:44.665670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:43:32.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665626+0000","last_change":"2024-05-15T12:09:42.673579+0000","last_active":"2024-05-15T12:09:44.665626+0000","last_peered":"2024-05-15T12:09:44.665626+0000","last_clean":"2024-05-15T12:09:44.665626+0000","last_became_active":"2024-05-15T12:09:42.673301+0000","last_became_peered":"2024-05-15T12:09:42.673301+0000","last_unstale":"2024-05-15T12:09:44.665626+0000","last_undegraded":"2024-05-15T12:09:44.665626+0000","last_fullsized":"2024-05-15T12:09:44.665626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:41.126536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665510+0000","last_change":"2024-05-15T12:09:43.686476+0000","last_active":"2024-05-15T12:09:44.665510+0000","last_peered":"2024-05-15T12:09:44.665510+0000","last_clean":"2024-05-15T12:09:44.665510+0000","last_became_active":"2024-05-15T12:09:43.684889+0000","last_became_peered":"2024-05-15T12:09:43.684889+0000","last_unstale":"2024-05-15T12:09:44.665510+0000","last_undegraded":"2024-05-15T12:09:44.665510+0000","last_fullsized":"2024-05-15T12:09:44.665510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":67309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:48.368 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-05-15T12:09:48.368 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675610+0000', 'last_change': '2024-05-15T12:09:42.675610+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675610+0000', 'last_undegraded': '2024-05-15T12:09:42.675610+0000', 'last_fullsized': '2024-05-15T12:09:42.675610+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675367+0000', 'last_change': '2024-05-15T12:09:42.675367+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675367+0000', 'last_undegraded': '2024-05-15T12:09:42.675367+0000', 'last_fullsized': '2024-05-15T12:09:42.675367+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.671381+0000', 'last_change': '2024-05-15T12:09:42.671381+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.671381+0000', 'last_undegraded': '2024-05-15T12:09:42.671381+0000', 'last_fullsized': '2024-05-15T12:09:42.671381+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.673323+0000', 'last_change': '2024-05-15T12:09:42.673323+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.673323+0000', 'last_undegraded': '2024-05-15T12:09:42.673323+0000', 'last_fullsized': '2024-05-15T12:09:42.673323+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675013+0000', 'last_change': '2024-05-15T12:09:42.675013+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675013+0000', 'last_undegraded': '2024-05-15T12:09:42.675013+0000', 'last_fullsized': '2024-05-15T12:09:42.675013+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-05-15T12:09:48.369 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675698+0000', 'last_change': '2024-05-15T12:09:42.675698+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675698+0000', 'last_undegraded': '2024-05-15T12:09:42.675698+0000', 'last_fullsized': '2024-05-15T12:09:42.675698+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675337+0000', 'last_change': '2024-05-15T12:09:42.675337+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675337+0000', 'last_undegraded': '2024-05-15T12:09:42.675337+0000', 'last_fullsized': '2024-05-15T12:09:42.675337+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.673535+0000', 'last_change': '2024-05-15T12:09:42.673535+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.673535+0000', 'last_undegraded': '2024-05-15T12:09:42.673535+0000', 'last_fullsized': '2024-05-15T12:09:42.673535+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675209+0000', 'last_change': '2024-05-15T12:09:42.675209+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675209+0000', 'last_undegraded': '2024-05-15T12:09:42.675209+0000', 'last_fullsized': '2024-05-15T12:09:42.675209+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.674192+0000', 'last_change': '2024-05-15T12:09:42.674192+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.674192+0000', 'last_undegraded': '2024-05-15T12:09:42.674192+0000', 'last_fullsized': '2024-05-15T12:09:42.674192+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-05-15T12:09:48.370 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:09:42.675853+0000', 'last_change': '2024-05-15T12:09:42.675853+0000', 'last_active': '2024-05-15T12:09:42.654322+0000', 'last_peered': '2024-05-15T12:09:42.654322+0000', 'last_clean': '2024-05-15T12:09:42.654322+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:09:42.675853+0000', 'last_undegraded': '2024-05-15T12:09:42.675853+0000', 'last_fullsized': '2024-05-15T12:09:42.675853+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'last_clean_scrub_stamp': '2024-05-15T12:09:42.654322+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-15T12:09:48.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-15T12:09:48.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.509+0000 7f912046d640 1 Processor -- start 2024-05-15T12:09:48.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.509+0000 7f912046d640 1 -- start start 2024-05-15T12:09:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.510+0000 7f912046d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f91180d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.510+0000 7f912046d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f91180d57e0 0x7f91180cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.510+0000 7f912046d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91181631d0 con 0x7f911815f1d0 2024-05-15T12:09:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.510+0000 7f912046d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9118162f80 con 0x7f91180d57e0 2024-05-15T12:09:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.510+0000 7f912046d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f91180d4ef0 con 0x7f91180d28c0 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911da08640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f91180d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911ea0a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f91180d57e0 0x7f91180cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911e209640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f911815f1d0 0x7f91180d47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:53074/0 (socket says 172.21.15.77:53074) 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911da08640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f91180d52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:56546/0 (socket says 172.21.15.77:56546) 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911e209640 1 -- 172.21.15.77:0/1520298150 learned_addr learned my addr 172.21.15.77:0/1520298150 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911da08640 1 -- 172.21.15.77:0/1520298150 >> v2:172.21.15.83:3300/0 conn(0x7f91180d57e0 msgr2=0x7f91180cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911da08640 1 --2- 172.21.15.77:0/1520298150 >> v2:172.21.15.83:3300/0 conn(0x7f91180d57e0 0x7f91180cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911d207640 1 -- 172.21.15.77:0/1520298150 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4216853097 0 0) 0x7f91181631d0 con 0x7f911815f1d0 2024-05-15T12:09:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911da08640 1 -- 172.21.15.77:0/1520298150 >> v1:172.21.15.83:6789/0 conn(0x7f911815f1d0 legacy=0x7f91180d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.511+0000 7f911da08640 1 -- 172.21.15.77:0/1520298150 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91181634b0 con 0x7f91180d28c0 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.512+0000 7f911da08640 1 --2- 172.21.15.77:0/1520298150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f91180d52a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097a0 tx=0x7f910c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257e7ce210786916 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.512+0000 7f911d207640 1 -- 172.21.15.77:0/1520298150 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c037070 con 0x7f91180d28c0 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.512+0000 7f911d207640 1 -- 172.21.15.77:0/1520298150 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f910c032440 con 0x7f91180d28c0 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.512+0000 7f911d207640 1 -- 172.21.15.77:0/1520298150 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f910c032810 con 0x7f91180d28c0 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 -- 172.21.15.77:0/1520298150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 msgr2=0x7f91180d52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 --2- 172.21.15.77:0/1520298150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f91180d52a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f910c0097a0 tx=0x7f910c02a210 comp rx=0 tx=0).stop 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 -- 172.21.15.77:0/1520298150 shutdown_connections 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 --2- 172.21.15.77:0/1520298150 >> v2:172.21.15.83:3300/0 conn(0x7f91180d57e0 0x7f91180cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 --2- 172.21.15.77:0/1520298150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f91180d52a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 -- 172.21.15.77:0/1520298150 >> 172.21.15.77:0/1520298150 conn(0x7f9118073f10 msgr2=0x7f9118074320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 -- 172.21.15.77:0/1520298150 shutdown_connections 2024-05-15T12:09:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.513+0000 7f912046d640 1 -- 172.21.15.77:0/1520298150 wait complete. 2024-05-15T12:09:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.514+0000 7f912046d640 1 Processor -- start 2024-05-15T12:09:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.514+0000 7f912046d640 1 -- start start 2024-05-15T12:09:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f9118159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91180d57e0 0x7f91180cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 0x7f91181f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91180cfea0 con 0x7f911815f1d0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9118163a70 con 0x7f91180d57e0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f91180d0020 con 0x7f91180d28c0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 0x7f91181f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 0x7f91181f8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57772/0 (socket says 172.21.15.77:57772) 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 -- 172.21.15.77:0/4143851079 learned_addr learned my addr 172.21.15.77:0/4143851079 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911e209640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f9118159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911da08640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91180d57e0 0x7f91180cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 -- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 msgr2=0x7f9118159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f9118159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 -- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91180d57e0 msgr2=0x7f91180cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91180d57e0 0x7f91180cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 -- 172.21.15.77:0/4143851079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91180cf230 con 0x7f911815f1d0 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911da08640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91180d57e0 0x7f91180cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f911ea0a640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 0x7f91181f8ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f911000e960 tx=0x7f911000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9110017070 con 0x7f911815f1d0 2024-05-15T12:09:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f911000c980 con 0x7f911815f1d0 2024-05-15T12:09:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91180ce110 con 0x7f911815f1d0 2024-05-15T12:09:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f911000cd70 con 0x7f911815f1d0 2024-05-15T12:09:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.515+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91180ce690 con 0x7f911815f1d0 2024-05-15T12:09:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.516+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91180ce8d0 con 0x7f911815f1d0 2024-05-15T12:09:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.517+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f911001a070 con 0x7f911815f1d0 2024-05-15T12:09:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.518+0000 7f9116ffd640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f91040762d0 0x7f9104078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.518+0000 7f911e209640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f91040762d0 0x7f9104078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.518+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9110097540 con 0x7f911815f1d0 2024-05-15T12:09:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.518+0000 7f911e209640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f91040762d0 0x7f9104078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91080012e0 tx=0x7f9108001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.522+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91180ce8d0 con 0x7f911815f1d0 2024-05-15T12:09:48.638 INFO:tasks.ceph.mds.b.smithi083.stderr:2024-05-15T12:09:48.643+0000 7fc66347e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-15T12:09:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.776+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f91180d16a0 con 0x7f911815f1d0 2024-05-15T12:09:48.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.776+0000 7f9116ffd640 1 -- 172.21.15.77:0/4143851079 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1097 (secure 0 0 0) 0x7f91180d16a0 con 0x7f911815f1d0 2024-05-15T12:09:48.771 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:48.771 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1715774971,"num_in_osds":8,"osd_in_since":1715774962,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":86},{"state_name":"creating+peering","count":11}],"num_pgs":97,"num_pools":3,"num_objects":20,"data_bytes":592756,"bytes_used":224239616,"bytes_avail":772869873664,"bytes_total":773094113280,"inactive_pgs_ratio":0.11340206116437912,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4302}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-05-15T12:09:19.936159+0000","services":{}},"progress_events":{}} 2024-05-15T12:09:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f91040762d0 msgr2=0x7f9104078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f91040762d0 0x7f9104078790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f91080012e0 tx=0x7f9108001630 comp rx=0 tx=0).stop 2024-05-15T12:09:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 msgr2=0x7f91181f8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 0x7f91181f8ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f911000e960 tx=0x7f911000ee20 comp rx=0 tx=0).stop 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 shutdown_connections 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f91040762d0 0x7f9104078790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f911815f1d0 0x7f91181f8ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f91180d57e0 0x7f91180cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 --2- 172.21.15.77:0/4143851079 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f91180d28c0 0x7f9118159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 >> 172.21.15.77:0/4143851079 conn(0x7f9118073f10 msgr2=0x7f91180b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 shutdown_connections 2024-05-15T12:09:48.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.778+0000 7f912046d640 1 -- 172.21.15.77:0/4143851079 wait complete. 2024-05-15T12:09:48.784 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-15T12:09:48.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:48.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.887+0000 7fbd30578640 1 Processor -- start 2024-05-15T12:09:48.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.887+0000 7fbd30578640 1 -- start start 2024-05-15T12:09:48.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.888+0000 7fbd30578640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280b87c0 0x7fbd2815e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.888+0000 7fbd30578640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbd280cf190 0x7fbd280cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.888+0000 7fbd30578640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd28071570 con 0x7fbd280cffa0 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.888+0000 7fbd30578640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbd280d0410 con 0x7fbd280cf190 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.888+0000 7fbd30578640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280d1c30 con 0x7fbd280b87c0 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2e314640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280b87c0 0x7fbd2815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2eb15640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fbd280cffa0 0x7fbd28160d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:53088/0 (socket says 172.21.15.77:53088) 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2db13640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbd280cf190 0x7fbd280cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2eb15640 1 -- 172.21.15.77:0/3264179052 learned_addr learned my addr 172.21.15.77:0/3264179052 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:48.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2db13640 1 -- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280b87c0 msgr2=0x7fbd2815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2db13640 1 --2- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280b87c0 0x7fbd2815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2db13640 1 -- 172.21.15.77:0/3264179052 >> v1:172.21.15.83:6789/0 conn(0x7fbd280cffa0 legacy=0x7fbd28160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2d312640 1 -- 172.21.15.77:0/3264179052 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069850692 0 0) 0x7fbd20001110 con 0x7fbd280cffa0 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.889+0000 7fbd2db13640 1 -- 172.21.15.77:0/3264179052 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2815e680 con 0x7fbd280cf190 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.890+0000 7fbd2db13640 1 --2- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cf190 0x7fbd280cfa60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0097a0 tx=0x7fbd1c02a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5701a91e8006de29 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.890+0000 7fbd2d312640 1 -- 172.21.15.77:0/3264179052 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c037070 con 0x7fbd280cf190 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.890+0000 7fbd2d312640 1 -- 172.21.15.77:0/3264179052 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c02adb0 con 0x7fbd280cf190 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.890+0000 7fbd2d312640 1 -- 172.21.15.77:0/3264179052 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c032660 con 0x7fbd280cf190 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 -- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cf190 msgr2=0x7fbd280cfa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 --2- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cf190 0x7fbd280cfa60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0097a0 tx=0x7fbd1c02a060 comp rx=0 tx=0).stop 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 -- 172.21.15.77:0/3264179052 shutdown_connections 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 --2- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cf190 0x7fbd280cfa60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 --2- 172.21.15.77:0/3264179052 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280b87c0 0x7fbd2815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 -- 172.21.15.77:0/3264179052 >> 172.21.15.77:0/3264179052 conn(0x7fbd280b4c40 msgr2=0x7fbd280b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 -- 172.21.15.77:0/3264179052 shutdown_connections 2024-05-15T12:09:48.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.891+0000 7fbd30578640 1 -- 172.21.15.77:0/3264179052 wait complete. 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.892+0000 7fbd30578640 1 Processor -- start 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.892+0000 7fbd30578640 1 -- start start 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 0x7fbd281e59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280cf190 0x7fbd281529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cffa0 0x7fbd281e7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280cd6a0 con 0x7fbd280b87c0 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280d21b0 con 0x7fbd280cffa0 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280cd980 con 0x7fbd280cf190 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 0x7fbd281e59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 0x7fbd281e59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57786/0 (socket says 172.21.15.77:57786) 2024-05-15T12:09:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 -- 172.21.15.77:0/4245746063 learned_addr learned my addr 172.21.15.77:0/4245746063 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2db13640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280cf190 0x7fbd281529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2eb15640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cffa0 0x7fbd281e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 -- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280cf190 msgr2=0x7fbd281529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280cf190 0x7fbd281529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 -- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cffa0 msgr2=0x7fbd281e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cffa0 0x7fbd281e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 -- 172.21.15.77:0/4245746063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd28152ee0 con 0x7fbd280b87c0 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd2e314640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 0x7fbd281e59a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800efc0 tx=0x7fbd1800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18018020 con 0x7fbd280b87c0 2024-05-15T12:09:48.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd18014480 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2815ca10 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18014850 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.893+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd281e6360 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.894+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd280694d0 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.895+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbd18005d10 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.896+0000 7fbd26ffd640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd14076300 0x7fbd140787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.896+0000 7fbd2db13640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd14076300 0x7fbd140787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.896+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbd18097e50 con 0x7fbd280b87c0 2024-05-15T12:09:48.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.896+0000 7fbd2db13640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd14076300 0x7fbd140787c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c034000 tx=0x7fbd1c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:48.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:48.900+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbd18022070 con 0x7fbd280b87c0 2024-05-15T12:09:49.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.077+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbd2815e050 con 0x7fbd14076300 2024-05-15T12:09:49.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.083+0000 7fbd26ffd640 1 -- 172.21.15.77:0/4245746063 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251010 (secure 0 0 0) 0x7fbd2815e050 con 0x7fbd14076300 2024-05-15T12:09:49.080 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:49.082 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd14076300 msgr2=0x7fbd140787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd14076300 0x7fbd140787c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c034000 tx=0x7fbd1c02e000 comp rx=0 tx=0).stop 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 msgr2=0x7fbd281e59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 0x7fbd281e59a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800efc0 tx=0x7fbd1800c490 comp rx=0 tx=0).stop 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 shutdown_connections 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd14076300 0x7fbd140787c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd280cf190 0x7fbd281529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd280cffa0 0x7fbd281e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 --2- 172.21.15.77:0/4245746063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd280b87c0 0x7fbd281e59a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 >> 172.21.15.77:0/4245746063 conn(0x7fbd280b4c40 msgr2=0x7fbd2815e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 shutdown_connections 2024-05-15T12:09:49.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:49.086+0000 7fbd30578640 1 -- 172.21.15.77:0/4245746063 wait complete. 2024-05-15T12:09:49.091 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-05-15T12:09:48.244182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592756,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":138,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2788,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2854912,"data_stored":1737766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001023"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675610+0000","last_change":"2024-05-15T12:09:42.675610+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675610+0000","last_undegraded":"2024-05-15T12:09:42.675610+0000","last_fullsized":"2024-05-15T12:09:42.675610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665728+0000","last_change":"2024-05-15T12:09:43.684869+0000","last_active":"2024-05-15T12:09:44.665728+0000","last_peered":"2024-05-15T12:09:44.665728+0000","last_clean":"2024-05-15T12:09:44.665728+0000","last_became_active":"2024-05-15T12:09:43.684509+0000","last_became_peered":"2024-05-15T12:09:43.684509+0000","last_unstale":"2024-05-15T12:09:44.665728+0000","last_undegraded":"2024-05-15T12:09:44.665728+0000","last_fullsized":"2024-05-15T12:09:44.665728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665257+0000","last_change":"2024-05-15T12:09:43.689819+0000","last_active":"2024-05-15T12:09:44.665257+0000","last_peered":"2024-05-15T12:09:44.665257+0000","last_clean":"2024-05-15T12:09:44.665257+0000","last_became_active":"2024-05-15T12:09:43.689562+0000","last_became_peered":"2024-05-15T12:09:43.689562+0000","last_unstale":"2024-05-15T12:09:44.665257+0000","last_undegraded":"2024-05-15T12:09:44.665257+0000","last_fullsized":"2024-05-15T12:09:44.665257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570774+0000","last_change":"2024-05-15T12:09:43.682424+0000","last_active":"2024-05-15T12:09:45.570774+0000","last_peered":"2024-05-15T12:09:45.570774+0000","last_clean":"2024-05-15T12:09:45.570774+0000","last_became_active":"2024-05-15T12:09:43.680716+0000","last_became_peered":"2024-05-15T12:09:43.680716+0000","last_unstale":"2024-05-15T12:09:45.570774+0000","last_undegraded":"2024-05-15T12:09:45.570774+0000","last_fullsized":"2024-05-15T12:09:45.570774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675367+0000","last_change":"2024-05-15T12:09:42.675367+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675367+0000","last_undegraded":"2024-05-15T12:09:42.675367+0000","last_fullsized":"2024-05-15T12:09:42.675367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570334+0000","last_change":"2024-05-15T12:09:43.679941+0000","last_active":"2024-05-15T12:09:45.570334+0000","last_peered":"2024-05-15T12:09:45.570334+0000","last_clean":"2024-05-15T12:09:45.570334+0000","last_became_active":"2024-05-15T12:09:43.679673+0000","last_became_peered":"2024-05-15T12:09:43.679673+0000","last_unstale":"2024-05-15T12:09:45.570334+0000","last_undegraded":"2024-05-15T12:09:45.570334+0000","last_fullsized":"2024-05-15T12:09:45.570334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.671381+0000","last_change":"2024-05-15T12:09:42.671381+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.671381+0000","last_undegraded":"2024-05-15T12:09:42.671381+0000","last_fullsized":"2024-05-15T12:09:42.671381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664987+0000","last_change":"2024-05-15T12:09:43.687337+0000","last_active":"2024-05-15T12:09:44.664987+0000","last_peered":"2024-05-15T12:09:44.664987+0000","last_clean":"2024-05-15T12:09:44.664987+0000","last_became_active":"2024-05-15T12:09:43.687077+0000","last_became_peered":"2024-05-15T12:09:43.687077+0000","last_unstale":"2024-05-15T12:09:44.664987+0000","last_undegraded":"2024-05-15T12:09:44.664987+0000","last_fullsized":"2024-05-15T12:09:44.664987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673323+0000","last_change":"2024-05-15T12:09:42.673323+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673323+0000","last_undegraded":"2024-05-15T12:09:42.673323+0000","last_fullsized":"2024-05-15T12:09:42.673323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675013+0000","last_change":"2024-05-15T12:09:42.675013+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675013+0000","last_undegraded":"2024-05-15T12:09:42.675013+0000","last_fullsized":"2024-05-15T12:09:42.675013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675698+0000","last_change":"2024-05-15T12:09:42.675698+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675698+0000","last_undegraded":"2024-05-15T12:09:42.675698+0000","last_fullsized":"2024-05-15T12:09:42.675698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570134+0000","last_change":"2024-05-15T12:09:43.690439+0000","last_active":"2024-05-15T12:09:45.570134+0000","last_peered":"2024-05-15T12:09:45.570134+0000","last_clean":"2024-05-15T12:09:45.570134+0000","last_became_active":"2024-05-15T12:09:43.690122+0000","last_became_peered":"2024-05-15T12:09:43.690122+0000","last_unstale":"2024-05-15T12:09:45.570134+0000","last_undegraded":"2024-05-15T12:09:45.570134+0000","last_fullsized":"2024-05-15T12:09:45.570134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569946+0000","last_change":"2024-05-15T12:09:43.677396+0000","last_active":"2024-05-15T12:09:45.569946+0000","last_peered":"2024-05-15T12:09:45.569946+0000","last_clean":"2024-05-15T12:09:45.569946+0000","last_became_active":"2024-05-15T12:09:43.677134+0000","last_became_peered":"2024-05-15T12:09:43.677134+0000","last_unstale":"2024-05-15T12:09:45.569946+0000","last_undegraded":"2024-05-15T12:09:45.569946+0000","last_fullsized":"2024-05-15T12:09:45.569946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:14.148993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664971+0000","last_change":"2024-05-15T12:09:43.692214+0000","last_active":"2024-05-15T12:09:44.664971+0000","last_peered":"2024-05-15T12:09:44.664971+0000","last_clean":"2024-05-15T12:09:44.664971+0000","last_became_active":"2024-05-15T12:09:43.691930+0000","last_became_peered":"2024-05-15T12:09:43.691930+0000","last_unstale":"2024-05-15T12:09:44.664971+0000","last_undegraded":"2024-05-15T12:09:44.664971+0000","last_fullsized":"2024-05-15T12:09:44.664971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687713+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:43.687713+0000","last_peered":"2024-05-15T12:09:43.687713+0000","last_clean":"2024-05-15T12:09:43.687713+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:43.687713+0000","last_undegraded":"2024-05-15T12:09:43.687713+0000","last_fullsized":"2024-05-15T12:09:43.687713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697693+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:43.697693+0000","last_peered":"2024-05-15T12:09:43.697693+0000","last_clean":"2024-05-15T12:09:43.697693+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:43.697693+0000","last_undegraded":"2024-05-15T12:09:43.697693+0000","last_fullsized":"2024-05-15T12:09:43.697693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688966+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:43.688966+0000","last_peered":"2024-05-15T12:09:43.688966+0000","last_clean":"2024-05-15T12:09:43.688966+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:43.688966+0000","last_undegraded":"2024-05-15T12:09:43.688966+0000","last_fullsized":"2024-05-15T12:09:43.688966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:14.308287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.680388+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:43.680388+0000","last_peered":"2024-05-15T12:09:43.680388+0000","last_clean":"2024-05-15T12:09:43.680388+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:43.680388+0000","last_undegraded":"2024-05-15T12:09:43.680388+0000","last_fullsized":"2024-05-15T12:09:43.680388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675337+0000","last_change":"2024-05-15T12:09:42.675337+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675337+0000","last_undegraded":"2024-05-15T12:09:42.675337+0000","last_fullsized":"2024-05-15T12:09:42.675337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665508+0000","last_change":"2024-05-15T12:09:43.682377+0000","last_active":"2024-05-15T12:09:44.665508+0000","last_peered":"2024-05-15T12:09:44.665508+0000","last_clean":"2024-05-15T12:09:44.665508+0000","last_became_active":"2024-05-15T12:09:43.681994+0000","last_became_peered":"2024-05-15T12:09:43.681994+0000","last_unstale":"2024-05-15T12:09:44.665508+0000","last_undegraded":"2024-05-15T12:09:44.665508+0000","last_fullsized":"2024-05-15T12:09:44.665508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.689424+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:43.689424+0000","last_peered":"2024-05-15T12:09:43.689424+0000","last_clean":"2024-05-15T12:09:43.689424+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:43.689424+0000","last_undegraded":"2024-05-15T12:09:43.689424+0000","last_fullsized":"2024-05-15T12:09:43.689424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665400+0000","last_change":"2024-05-15T12:09:43.684244+0000","last_active":"2024-05-15T12:09:44.665400+0000","last_peered":"2024-05-15T12:09:44.665400+0000","last_clean":"2024-05-15T12:09:44.665400+0000","last_became_active":"2024-05-15T12:09:43.683969+0000","last_became_peered":"2024-05-15T12:09:43.683969+0000","last_unstale":"2024-05-15T12:09:44.665400+0000","last_undegraded":"2024-05-15T12:09:44.665400+0000","last_fullsized":"2024-05-15T12:09:44.665400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570957+0000","last_change":"2024-05-15T12:09:43.680234+0000","last_active":"2024-05-15T12:09:45.570957+0000","last_peered":"2024-05-15T12:09:45.570957+0000","last_clean":"2024-05-15T12:09:45.570957+0000","last_became_active":"2024-05-15T12:09:43.679005+0000","last_became_peered":"2024-05-15T12:09:43.679005+0000","last_unstale":"2024-05-15T12:09:45.570957+0000","last_undegraded":"2024-05-15T12:09:45.570957+0000","last_fullsized":"2024-05-15T12:09:45.570957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569504+0000","last_change":"2024-05-15T12:09:43.679589+0000","last_active":"2024-05-15T12:09:45.569504+0000","last_peered":"2024-05-15T12:09:45.569504+0000","last_clean":"2024-05-15T12:09:45.569504+0000","last_became_active":"2024-05-15T12:09:43.679299+0000","last_became_peered":"2024-05-15T12:09:43.679299+0000","last_unstale":"2024-05-15T12:09:45.569504+0000","last_undegraded":"2024-05-15T12:09:45.569504+0000","last_fullsized":"2024-05-15T12:09:45.569504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569877+0000","last_change":"2024-05-15T12:09:43.690523+0000","last_active":"2024-05-15T12:09:45.569877+0000","last_peered":"2024-05-15T12:09:45.569877+0000","last_clean":"2024-05-15T12:09:45.569877+0000","last_became_active":"2024-05-15T12:09:43.690212+0000","last_became_peered":"2024-05-15T12:09:43.690212+0000","last_unstale":"2024-05-15T12:09:45.569877+0000","last_undegraded":"2024-05-15T12:09:45.569877+0000","last_fullsized":"2024-05-15T12:09:45.569877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665359+0000","last_change":"2024-05-15T12:09:43.682107+0000","last_active":"2024-05-15T12:09:44.665359+0000","last_peered":"2024-05-15T12:09:44.665359+0000","last_clean":"2024-05-15T12:09:44.665359+0000","last_became_active":"2024-05-15T12:09:43.681812+0000","last_became_peered":"2024-05-15T12:09:43.681812+0000","last_unstale":"2024-05-15T12:09:44.665359+0000","last_undegraded":"2024-05-15T12:09:44.665359+0000","last_fullsized":"2024-05-15T12:09:44.665359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687349+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:43.687349+0000","last_peered":"2024-05-15T12:09:43.687349+0000","last_clean":"2024-05-15T12:09:43.687349+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:43.687349+0000","last_undegraded":"2024-05-15T12:09:43.687349+0000","last_fullsized":"2024-05-15T12:09:43.687349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.678110+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:43.678110+0000","last_peered":"2024-05-15T12:09:43.678110+0000","last_clean":"2024-05-15T12:09:43.678110+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:43.678110+0000","last_undegraded":"2024-05-15T12:09:43.678110+0000","last_fullsized":"2024-05-15T12:09:43.678110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:19.840876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570107+0000","last_change":"2024-05-15T12:09:43.681262+0000","last_active":"2024-05-15T12:09:45.570107+0000","last_peered":"2024-05-15T12:09:45.570107+0000","last_clean":"2024-05-15T12:09:45.570107+0000","last_became_active":"2024-05-15T12:09:43.680971+0000","last_became_peered":"2024-05-15T12:09:43.680971+0000","last_unstale":"2024-05-15T12:09:45.570107+0000","last_undegraded":"2024-05-15T12:09:45.570107+0000","last_fullsized":"2024-05-15T12:09:45.570107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665379+0000","last_change":"2024-05-15T12:09:42.676644+0000","last_active":"2024-05-15T12:09:44.665379+0000","last_peered":"2024-05-15T12:09:44.665379+0000","last_clean":"2024-05-15T12:09:44.665379+0000","last_became_active":"2024-05-15T12:09:42.676347+0000","last_became_peered":"2024-05-15T12:09:42.676347+0000","last_unstale":"2024-05-15T12:09:44.665379+0000","last_undegraded":"2024-05-15T12:09:44.665379+0000","last_fullsized":"2024-05-15T12:09:44.665379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.688148+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:43.688148+0000","last_peered":"2024-05-15T12:09:43.688148+0000","last_clean":"2024-05-15T12:09:43.688148+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:43.688148+0000","last_undegraded":"2024-05-15T12:09:43.688148+0000","last_fullsized":"2024-05-15T12:09:43.688148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569824+0000","last_change":"2024-05-15T12:09:42.683878+0000","last_active":"2024-05-15T12:09:45.569824+0000","last_peered":"2024-05-15T12:09:45.569824+0000","last_clean":"2024-05-15T12:09:45.569824+0000","last_became_active":"2024-05-15T12:09:42.683562+0000","last_became_peered":"2024-05-15T12:09:42.683562+0000","last_unstale":"2024-05-15T12:09:45.569824+0000","last_undegraded":"2024-05-15T12:09:45.569824+0000","last_fullsized":"2024-05-15T12:09:45.569824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665167+0000","last_change":"2024-05-15T12:09:43.683141+0000","last_active":"2024-05-15T12:09:44.665167+0000","last_peered":"2024-05-15T12:09:44.665167+0000","last_clean":"2024-05-15T12:09:44.665167+0000","last_became_active":"2024-05-15T12:09:43.682835+0000","last_became_peered":"2024-05-15T12:09:43.682835+0000","last_unstale":"2024-05-15T12:09:44.665167+0000","last_undegraded":"2024-05-15T12:09:44.665167+0000","last_fullsized":"2024-05-15T12:09:44.665167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664627+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:43.664627+0000","last_peered":"2024-05-15T12:09:43.664627+0000","last_clean":"2024-05-15T12:09:43.664627+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:43.664627+0000","last_undegraded":"2024-05-15T12:09:43.664627+0000","last_fullsized":"2024-05-15T12:09:43.664627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570969+0000","last_change":"2024-05-15T12:09:43.680034+0000","last_active":"2024-05-15T12:09:45.570969+0000","last_peered":"2024-05-15T12:09:45.570969+0000","last_clean":"2024-05-15T12:09:45.570969+0000","last_became_active":"2024-05-15T12:09:43.678658+0000","last_became_peered":"2024-05-15T12:09:43.678658+0000","last_unstale":"2024-05-15T12:09:45.570969+0000","last_undegraded":"2024-05-15T12:09:45.570969+0000","last_fullsized":"2024-05-15T12:09:45.570969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685627+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:42.685627+0000","last_peered":"2024-05-15T12:09:42.685627+0000","last_clean":"2024-05-15T12:09:42.685627+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:42.685627+0000","last_undegraded":"2024-05-15T12:09:42.685627+0000","last_fullsized":"2024-05-15T12:09:42.685627+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:14:24.882724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665608+0000","last_change":"2024-05-15T12:09:43.684173+0000","last_active":"2024-05-15T12:09:44.665608+0000","last_peered":"2024-05-15T12:09:44.665608+0000","last_clean":"2024-05-15T12:09:44.665608+0000","last_became_active":"2024-05-15T12:09:43.683863+0000","last_became_peered":"2024-05-15T12:09:43.683863+0000","last_unstale":"2024-05-15T12:09:44.665608+0000","last_undegraded":"2024-05-15T12:09:44.665608+0000","last_fullsized":"2024-05-15T12:09:44.665608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.679017+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:43.679017+0000","last_peered":"2024-05-15T12:09:43.679017+0000","last_clean":"2024-05-15T12:09:43.679017+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:43.679017+0000","last_undegraded":"2024-05-15T12:09:43.679017+0000","last_fullsized":"2024-05-15T12:09:43.679017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687307+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:43.687307+0000","last_peered":"2024-05-15T12:09:43.687307+0000","last_clean":"2024-05-15T12:09:43.687307+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:43.687307+0000","last_undegraded":"2024-05-15T12:09:43.687307+0000","last_fullsized":"2024-05-15T12:09:43.687307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570672+0000","last_change":"2024-05-15T12:09:42.670666+0000","last_active":"2024-05-15T12:09:45.570672+0000","last_peered":"2024-05-15T12:09:45.570672+0000","last_clean":"2024-05-15T12:09:45.570672+0000","last_became_active":"2024-05-15T12:09:42.669923+0000","last_became_peered":"2024-05-15T12:09:42.669923+0000","last_unstale":"2024-05-15T12:09:45.570672+0000","last_undegraded":"2024-05-15T12:09:45.570672+0000","last_fullsized":"2024-05-15T12:09:45.570672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.673535+0000","last_change":"2024-05-15T12:09:42.673535+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.673535+0000","last_undegraded":"2024-05-15T12:09:42.673535+0000","last_fullsized":"2024-05-15T12:09:42.673535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.691816+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:43.691816+0000","last_peered":"2024-05-15T12:09:43.691816+0000","last_clean":"2024-05-15T12:09:43.691816+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:43.691816+0000","last_undegraded":"2024-05-15T12:09:43.691816+0000","last_fullsized":"2024-05-15T12:09:43.691816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570051+0000","last_change":"2024-05-15T12:09:43.676947+0000","last_active":"2024-05-15T12:09:45.570051+0000","last_peered":"2024-05-15T12:09:45.570051+0000","last_clean":"2024-05-15T12:09:45.570051+0000","last_became_active":"2024-05-15T12:09:43.676630+0000","last_became_peered":"2024-05-15T12:09:43.676630+0000","last_unstale":"2024-05-15T12:09:45.570051+0000","last_undegraded":"2024-05-15T12:09:45.570051+0000","last_fullsized":"2024-05-15T12:09:45.570051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664659+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:43.664659+0000","last_peered":"2024-05-15T12:09:43.664659+0000","last_clean":"2024-05-15T12:09:43.664659+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:43.664659+0000","last_undegraded":"2024-05-15T12:09:43.664659+0000","last_fullsized":"2024-05-15T12:09:43.664659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.697671+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:43.697671+0000","last_peered":"2024-05-15T12:09:43.697671+0000","last_clean":"2024-05-15T12:09:43.697671+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:43.697671+0000","last_undegraded":"2024-05-15T12:09:43.697671+0000","last_fullsized":"2024-05-15T12:09:43.697671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688493+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:42.688493+0000","last_peered":"2024-05-15T12:09:42.688493+0000","last_clean":"2024-05-15T12:09:42.688493+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:42.688493+0000","last_undegraded":"2024-05-15T12:09:42.688493+0000","last_fullsized":"2024-05-15T12:09:42.688493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:04.067586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.687273+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:43.687273+0000","last_peered":"2024-05-15T12:09:43.687273+0000","last_clean":"2024-05-15T12:09:43.687273+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:43.687273+0000","last_undegraded":"2024-05-15T12:09:43.687273+0000","last_fullsized":"2024-05-15T12:09:43.687273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688392+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:42.688392+0000","last_peered":"2024-05-15T12:09:42.688392+0000","last_clean":"2024-05-15T12:09:42.688392+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:42.688392+0000","last_undegraded":"2024-05-15T12:09:42.688392+0000","last_fullsized":"2024-05-15T12:09:42.688392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:34:06.821265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.571120+0000","last_change":"2024-05-15T12:09:43.691593+0000","last_active":"2024-05-15T12:09:45.571120+0000","last_peered":"2024-05-15T12:09:45.571120+0000","last_clean":"2024-05-15T12:09:45.571120+0000","last_became_active":"2024-05-15T12:09:43.691327+0000","last_became_peered":"2024-05-15T12:09:43.691327+0000","last_unstale":"2024-05-15T12:09:45.571120+0000","last_undegraded":"2024-05-15T12:09:45.571120+0000","last_fullsized":"2024-05-15T12:09:45.571120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675209+0000","last_change":"2024-05-15T12:09:42.675209+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675209+0000","last_undegraded":"2024-05-15T12:09:42.675209+0000","last_fullsized":"2024-05-15T12:09:42.675209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665387+0000","last_change":"2024-05-15T12:09:42.675771+0000","last_active":"2024-05-15T12:09:44.665387+0000","last_peered":"2024-05-15T12:09:44.665387+0000","last_clean":"2024-05-15T12:09:44.665387+0000","last_became_active":"2024-05-15T12:09:42.675470+0000","last_became_peered":"2024-05-15T12:09:42.675470+0000","last_unstale":"2024-05-15T12:09:44.665387+0000","last_undegraded":"2024-05-15T12:09:44.665387+0000","last_fullsized":"2024-05-15T12:09:44.665387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:18.831524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.674192+0000","last_change":"2024-05-15T12:09:42.674192+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.674192+0000","last_undegraded":"2024-05-15T12:09:42.674192+0000","last_fullsized":"2024-05-15T12:09:42.674192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570014+0000","last_change":"2024-05-15T12:09:42.684015+0000","last_active":"2024-05-15T12:09:45.570014+0000","last_peered":"2024-05-15T12:09:45.570014+0000","last_clean":"2024-05-15T12:09:45.570014+0000","last_became_active":"2024-05-15T12:09:42.683509+0000","last_became_peered":"2024-05-15T12:09:42.683509+0000","last_unstale":"2024-05-15T12:09:45.570014+0000","last_undegraded":"2024-05-15T12:09:45.570014+0000","last_fullsized":"2024-05-15T12:09:45.570014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.673978+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:43.673978+0000","last_peered":"2024-05-15T12:09:43.673978+0000","last_clean":"2024-05-15T12:09:43.673978+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:43.673978+0000","last_undegraded":"2024-05-15T12:09:43.673978+0000","last_fullsized":"2024-05-15T12:09:43.673978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664134+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:43.664134+0000","last_peered":"2024-05-15T12:09:43.664134+0000","last_clean":"2024-05-15T12:09:43.664134+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:43.664134+0000","last_undegraded":"2024-05-15T12:09:43.664134+0000","last_fullsized":"2024-05-15T12:09:43.664134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664772+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:43.664772+0000","last_peered":"2024-05-15T12:09:43.664772+0000","last_clean":"2024-05-15T12:09:43.664772+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:43.664772+0000","last_undegraded":"2024-05-15T12:09:43.664772+0000","last_fullsized":"2024-05-15T12:09:43.664772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569728+0000","last_change":"2024-05-15T12:09:43.681455+0000","last_active":"2024-05-15T12:09:45.569728+0000","last_peered":"2024-05-15T12:09:45.569728+0000","last_clean":"2024-05-15T12:09:45.569728+0000","last_became_active":"2024-05-15T12:09:43.681192+0000","last_became_peered":"2024-05-15T12:09:43.681192+0000","last_unstale":"2024-05-15T12:09:45.569728+0000","last_undegraded":"2024-05-15T12:09:45.569728+0000","last_fullsized":"2024-05-15T12:09:45.569728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.668358+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:43.668358+0000","last_peered":"2024-05-15T12:09:43.668358+0000","last_clean":"2024-05-15T12:09:43.668358+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:43.668358+0000","last_undegraded":"2024-05-15T12:09:43.668358+0000","last_fullsized":"2024-05-15T12:09:43.668358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665688+0000","last_change":"2024-05-15T12:09:43.681676+0000","last_active":"2024-05-15T12:09:44.665688+0000","last_peered":"2024-05-15T12:09:44.665688+0000","last_clean":"2024-05-15T12:09:44.665688+0000","last_became_active":"2024-05-15T12:09:43.681405+0000","last_became_peered":"2024-05-15T12:09:43.681405+0000","last_unstale":"2024-05-15T12:09:44.665688+0000","last_undegraded":"2024-05-15T12:09:44.665688+0000","last_fullsized":"2024-05-15T12:09:44.665688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:07:48.262342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.664803+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:43.664803+0000","last_peered":"2024-05-15T12:09:43.664803+0000","last_clean":"2024-05-15T12:09:43.664803+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:43.664803+0000","last_undegraded":"2024-05-15T12:09:43.664803+0000","last_fullsized":"2024-05-15T12:09:43.664803+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-05-15T12:09:42.675853+0000","last_change":"2024-05-15T12:09:42.675853+0000","last_active":"2024-05-15T12:09:42.654322+0000","last_peered":"2024-05-15T12:09:42.654322+0000","last_clean":"2024-05-15T12:09:42.654322+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:09:42.675853+0000","last_undegraded":"2024-05-15T12:09:42.675853+0000","last_fullsized":"2024-05-15T12:09:42.675853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665274+0000","last_change":"2024-05-15T12:09:42.676729+0000","last_active":"2024-05-15T12:09:44.665274+0000","last_peered":"2024-05-15T12:09:44.665274+0000","last_clean":"2024-05-15T12:09:44.665274+0000","last_became_active":"2024-05-15T12:09:42.676435+0000","last_became_peered":"2024-05-15T12:09:42.676435+0000","last_unstale":"2024-05-15T12:09:44.665274+0000","last_undegraded":"2024-05-15T12:09:44.665274+0000","last_fullsized":"2024-05-15T12:09:44.665274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570802+0000","last_change":"2024-05-15T12:09:43.683565+0000","last_active":"2024-05-15T12:09:45.570802+0000","last_peered":"2024-05-15T12:09:45.570802+0000","last_clean":"2024-05-15T12:09:45.570802+0000","last_became_active":"2024-05-15T12:09:43.683268+0000","last_became_peered":"2024-05-15T12:09:43.683268+0000","last_unstale":"2024-05-15T12:09:45.570802+0000","last_undegraded":"2024-05-15T12:09:45.570802+0000","last_fullsized":"2024-05-15T12:09:45.570802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.665840+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:43.665840+0000","last_peered":"2024-05-15T12:09:43.665840+0000","last_clean":"2024-05-15T12:09:43.665840+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:43.665840+0000","last_undegraded":"2024-05-15T12:09:43.665840+0000","last_fullsized":"2024-05-15T12:09:43.665840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570045+0000","last_change":"2024-05-15T12:09:43.685808+0000","last_active":"2024-05-15T12:09:45.570045+0000","last_peered":"2024-05-15T12:09:45.570045+0000","last_clean":"2024-05-15T12:09:45.570045+0000","last_became_active":"2024-05-15T12:09:43.685355+0000","last_became_peered":"2024-05-15T12:09:43.685355+0000","last_unstale":"2024-05-15T12:09:45.570045+0000","last_undegraded":"2024-05-15T12:09:45.570045+0000","last_fullsized":"2024-05-15T12:09:45.570045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666562+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:44.666562+0000","last_peered":"2024-05-15T12:09:44.666562+0000","last_clean":"2024-05-15T12:09:44.666562+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:44.666562+0000","last_undegraded":"2024-05-15T12:09:44.666562+0000","last_fullsized":"2024-05-15T12:09:44.666562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.692038+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:43.692038+0000","last_peered":"2024-05-15T12:09:43.692038+0000","last_clean":"2024-05-15T12:09:43.692038+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:43.692038+0000","last_undegraded":"2024-05-15T12:09:43.692038+0000","last_fullsized":"2024-05-15T12:09:43.692038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.693715+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:42.693715+0000","last_peered":"2024-05-15T12:09:42.693715+0000","last_clean":"2024-05-15T12:09:42.693715+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:42.693715+0000","last_undegraded":"2024-05-15T12:09:42.693715+0000","last_fullsized":"2024-05-15T12:09:42.693715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:14.268472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.676948+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:43.676948+0000","last_peered":"2024-05-15T12:09:43.676948+0000","last_clean":"2024-05-15T12:09:43.676948+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:43.676948+0000","last_undegraded":"2024-05-15T12:09:43.676948+0000","last_fullsized":"2024-05-15T12:09:43.676948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570171+0000","last_change":"2024-05-15T12:09:42.677520+0000","last_active":"2024-05-15T12:09:45.570171+0000","last_peered":"2024-05-15T12:09:45.570171+0000","last_clean":"2024-05-15T12:09:45.570171+0000","last_became_active":"2024-05-15T12:09:42.677226+0000","last_became_peered":"2024-05-15T12:09:42.677226+0000","last_unstale":"2024-05-15T12:09:45.570171+0000","last_undegraded":"2024-05-15T12:09:45.570171+0000","last_fullsized":"2024-05-15T12:09:45.570171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685338+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:43.685338+0000","last_peered":"2024-05-15T12:09:43.685338+0000","last_clean":"2024-05-15T12:09:43.685338+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:43.685338+0000","last_undegraded":"2024-05-15T12:09:43.685338+0000","last_fullsized":"2024-05-15T12:09:43.685338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:42.135888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.685783+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:43.685783+0000","last_peered":"2024-05-15T12:09:43.685783+0000","last_clean":"2024-05-15T12:09:43.685783+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:43.685783+0000","last_undegraded":"2024-05-15T12:09:43.685783+0000","last_fullsized":"2024-05-15T12:09:43.685783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.671695+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:43.671695+0000","last_peered":"2024-05-15T12:09:43.671695+0000","last_clean":"2024-05-15T12:09:43.671695+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:43.671695+0000","last_undegraded":"2024-05-15T12:09:43.671695+0000","last_fullsized":"2024-05-15T12:09:43.671695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-05-15T12:09:43.693212+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:43.693212+0000","last_peered":"2024-05-15T12:09:43.693212+0000","last_clean":"2024-05-15T12:09:43.693212+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:43.693212+0000","last_undegraded":"2024-05-15T12:09:43.693212+0000","last_fullsized":"2024-05-15T12:09:43.693212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.685600+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:42.685600+0000","last_peered":"2024-05-15T12:09:42.685600+0000","last_clean":"2024-05-15T12:09:42.685600+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:42.685600+0000","last_undegraded":"2024-05-15T12:09:42.685600+0000","last_fullsized":"2024-05-15T12:09:42.685600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:12:06.159469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-05-15T12:09:42.688347+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:42.688347+0000","last_peered":"2024-05-15T12:09:42.688347+0000","last_clean":"2024-05-15T12:09:42.688347+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:42.688347+0000","last_undegraded":"2024-05-15T12:09:42.688347+0000","last_fullsized":"2024-05-15T12:09:42.688347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:32:07.585125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665670+0000","last_change":"2024-05-15T12:09:43.684828+0000","last_active":"2024-05-15T12:09:44.665670+0000","last_peered":"2024-05-15T12:09:44.665670+0000","last_clean":"2024-05-15T12:09:44.665670+0000","last_became_active":"2024-05-15T12:09:43.684507+0000","last_became_peered":"2024-05-15T12:09:43.684507+0000","last_unstale":"2024-05-15T12:09:44.665670+0000","last_undegraded":"2024-05-15T12:09:44.665670+0000","last_fullsized":"2024-05-15T12:09:44.665670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:43:32.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665626+0000","last_change":"2024-05-15T12:09:42.673579+0000","last_active":"2024-05-15T12:09:44.665626+0000","last_peered":"2024-05-15T12:09:44.665626+0000","last_clean":"2024-05-15T12:09:44.665626+0000","last_became_active":"2024-05-15T12:09:42.673301+0000","last_became_peered":"2024-05-15T12:09:42.673301+0000","last_unstale":"2024-05-15T12:09:44.665626+0000","last_undegraded":"2024-05-15T12:09:44.665626+0000","last_fullsized":"2024-05-15T12:09:44.665626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:41.126536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665510+0000","last_change":"2024-05-15T12:09:43.686476+0000","last_active":"2024-05-15T12:09:44.665510+0000","last_peered":"2024-05-15T12:09:44.665510+0000","last_clean":"2024-05-15T12:09:44.665510+0000","last_became_active":"2024-05-15T12:09:43.684889+0000","last_became_peered":"2024-05-15T12:09:43.684889+0000","last_unstale":"2024-05-15T12:09:44.665510+0000","last_undegraded":"2024-05-15T12:09:44.665510+0000","last_fullsized":"2024-05-15T12:09:44.665510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2388,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":33,"ondisk_log_size":33,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":66851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":200704,"data_stored":67309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":172032,"data_stored":53677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:52.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:52.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.213+0000 7fb8d27e4640 1 Processor -- start 2024-05-15T12:09:52.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.213+0000 7fb8d27e4640 1 -- start start 2024-05-15T12:09:52.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8d27e4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb8cc1469b0 0x7fb8cc15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8d27e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8cc0b4a40 0x7fb8cc0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8d27e4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc0ceaa0 0x7fb8cc160c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8d27e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb8cc15e620 con 0x7fb8cc0b4a40 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8d27e4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb8cc0b6430 con 0x7fb8cc1469b0 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8d27e4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb8cc0b4f00 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.214+0000 7fb8cb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8cc0b4a40 0x7fb8cc0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8cc0b4a40 0x7fb8cc0ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57788/0 (socket says 172.21.15.77:57788) 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/2705794911 learned_addr learned my addr 172.21.15.77:0/2705794911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8d0d81640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc0ceaa0 0x7fb8cc160c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cbfff640 1 --2- 172.21.15.77:0/2705794911 >> v2:172.21.15.83:3300/0 conn(0x7fb8cc1469b0 0x7fb8cc15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/2705794911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc0ceaa0 msgr2=0x7fb8cc160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc0ceaa0 0x7fb8cc160c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/2705794911 >> v2:172.21.15.83:3300/0 conn(0x7fb8cc1469b0 msgr2=0x7fb8cc15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 --2- 172.21.15.77:0/2705794911 >> v2:172.21.15.83:3300/0 conn(0x7fb8cc1469b0 0x7fb8cc15e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/2705794911 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc0b51e0 con 0x7fb8cc0b4a40 2024-05-15T12:09:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.215+0000 7fb8d0d81640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc0ceaa0 0x7fb8cc160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8cb7fe640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc0ce560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0704b0 tx=0x7fb8c002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1fb4023c4765e49 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8caffd640 1 -- 172.21.15.77:0/2705794911 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0037070 con 0x7fb8cc0b4a40 2024-05-15T12:09:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8caffd640 1 -- 172.21.15.77:0/2705794911 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c0032440 con 0x7fb8cc0b4a40 2024-05-15T12:09:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8caffd640 1 -- 172.21.15.77:0/2705794911 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0032810 con 0x7fb8cc0b4a40 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 -- 172.21.15.77:0/2705794911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0b4a40 msgr2=0x7fb8cc0ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc0ce560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc0704b0 tx=0x7fb8c002a140 comp rx=0 tx=0).stop 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 -- 172.21.15.77:0/2705794911 shutdown_connections 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc0ceaa0 0x7fb8cc160c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/2705794911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc0ce560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/2705794911 >> v2:172.21.15.83:3300/0 conn(0x7fb8cc1469b0 0x7fb8cc15e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 -- 172.21.15.77:0/2705794911 >> 172.21.15.77:0/2705794911 conn(0x7fb8cc06c810 msgr2=0x7fb8cc06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 -- 172.21.15.77:0/2705794911 shutdown_connections 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.216+0000 7fb8d27e4640 1 -- 172.21.15.77:0/2705794911 wait complete. 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.218+0000 7fb8d27e4640 1 Processor -- start 2024-05-15T12:09:52.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.218+0000 7fb8d27e4640 1 -- start start 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc14c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 0x7fb8cc0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc1469b0 0x7fb8cc1f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc0b5a80 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb8cc0b57a0 con 0x7fb8cc0b4a40 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb8cc161190 con 0x7fb8cc1469b0 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 0x7fb8cc0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 0x7fb8cc0af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57794/0 (socket says 172.21.15.77:57794) 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cbfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc14c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/1068190509 learned_addr learned my addr 172.21.15.77:0/1068190509 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d0d81640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc1469b0 0x7fb8cc1f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc1469b0 msgr2=0x7fb8cc1f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc1469b0 0x7fb8cc1f8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8cc0b4a40 msgr2=0x7fb8cc14c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc14c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 -- 172.21.15.77:0/1068190509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8cc0aff00 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8cb7fe640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 0x7fb8cc0af9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8c002a180 tx=0x7fb8c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0037040 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c0042070 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c0030880 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.219+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8cc0b01a0 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.220+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8cc0b0ff0 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.220+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8cc06a640 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.221+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb8c0030a20 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.221+0000 7fb8c8ff9640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb8b80762d0 0x7fb8b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.222+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb8c00b7ca0 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.222+0000 7fb8cbfff640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb8b80762d0 0x7fb8b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.222+0000 7fb8cbfff640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb8b80762d0 0x7fb8b8078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009a20 tx=0x7fb8bc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.226+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb8c0081040 con 0x7fb8cc0ceaa0 2024-05-15T12:09:52.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.404+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8cc15d2d0 con 0x7fb8b80762d0 2024-05-15T12:09:52.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.409+0000 7fb8c8ff9640 1 -- 172.21.15.77:0/1068190509 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251861 (secure 0 0 0) 0x7fb8cc15d2d0 con 0x7fb8b80762d0 2024-05-15T12:09:52.407 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:52.408 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.412+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb8b80762d0 msgr2=0x7fb8b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.412+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb8b80762d0 0x7fb8b8078790 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc009a20 tx=0x7fb8bc009190 comp rx=0 tx=0).stop 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.412+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 msgr2=0x7fb8cc0af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.412+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 0x7fb8cc0af9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8c002a180 tx=0x7fb8c00046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 shutdown_connections 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb8b80762d0 0x7fb8b8078790 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb8cc1469b0 0x7fb8cc1f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8cc0ceaa0 0x7fb8cc0af9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 --2- 172.21.15.77:0/1068190509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb8cc0b4a40 0x7fb8cc14c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 >> 172.21.15.77:0/1068190509 conn(0x7fb8cc06c810 msgr2=0x7fb8cc15a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 shutdown_connections 2024-05-15T12:09:52.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.413+0000 7fb8d27e4640 1 -- 172.21.15.77:0/1068190509 wait complete. 2024-05-15T12:09:52.418 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-05-15T12:09:52.245159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2924544,"data_stored":1769772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.584121"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301762+0000","last_change":"2024-05-15T12:09:43.688570+0000","last_active":"2024-05-15T12:09:45.301762+0000","last_peered":"2024-05-15T12:09:45.301762+0000","last_clean":"2024-05-15T12:09:45.301762+0000","last_became_active":"2024-05-15T12:09:43.688306+0000","last_became_peered":"2024-05-15T12:09:43.688306+0000","last_unstale":"2024-05-15T12:09:45.301762+0000","last_undegraded":"2024-05-15T12:09:45.301762+0000","last_fullsized":"2024-05-15T12:09:45.301762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:05:52.845647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665728+0000","last_change":"2024-05-15T12:09:43.684869+0000","last_active":"2024-05-15T12:09:44.665728+0000","last_peered":"2024-05-15T12:09:44.665728+0000","last_clean":"2024-05-15T12:09:44.665728+0000","last_became_active":"2024-05-15T12:09:43.684509+0000","last_became_peered":"2024-05-15T12:09:43.684509+0000","last_unstale":"2024-05-15T12:09:44.665728+0000","last_undegraded":"2024-05-15T12:09:44.665728+0000","last_fullsized":"2024-05-15T12:09:44.665728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665257+0000","last_change":"2024-05-15T12:09:43.689819+0000","last_active":"2024-05-15T12:09:44.665257+0000","last_peered":"2024-05-15T12:09:44.665257+0000","last_clean":"2024-05-15T12:09:44.665257+0000","last_became_active":"2024-05-15T12:09:43.689562+0000","last_became_peered":"2024-05-15T12:09:43.689562+0000","last_unstale":"2024-05-15T12:09:44.665257+0000","last_undegraded":"2024-05-15T12:09:44.665257+0000","last_fullsized":"2024-05-15T12:09:44.665257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570774+0000","last_change":"2024-05-15T12:09:43.682424+0000","last_active":"2024-05-15T12:09:45.570774+0000","last_peered":"2024-05-15T12:09:45.570774+0000","last_clean":"2024-05-15T12:09:45.570774+0000","last_became_active":"2024-05-15T12:09:43.680716+0000","last_became_peered":"2024-05-15T12:09:43.680716+0000","last_unstale":"2024-05-15T12:09:45.570774+0000","last_undegraded":"2024-05-15T12:09:45.570774+0000","last_fullsized":"2024-05-15T12:09:45.570774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301439+0000","last_change":"2024-05-15T12:09:43.687774+0000","last_active":"2024-05-15T12:09:45.301439+0000","last_peered":"2024-05-15T12:09:45.301439+0000","last_clean":"2024-05-15T12:09:45.301439+0000","last_became_active":"2024-05-15T12:09:43.687470+0000","last_became_peered":"2024-05-15T12:09:43.687470+0000","last_unstale":"2024-05-15T12:09:45.301439+0000","last_undegraded":"2024-05-15T12:09:45.301439+0000","last_fullsized":"2024-05-15T12:09:45.301439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570334+0000","last_change":"2024-05-15T12:09:43.679941+0000","last_active":"2024-05-15T12:09:45.570334+0000","last_peered":"2024-05-15T12:09:45.570334+0000","last_clean":"2024-05-15T12:09:45.570334+0000","last_became_active":"2024-05-15T12:09:43.679673+0000","last_became_peered":"2024-05-15T12:09:43.679673+0000","last_unstale":"2024-05-15T12:09:45.570334+0000","last_undegraded":"2024-05-15T12:09:45.570334+0000","last_fullsized":"2024-05-15T12:09:45.570334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301315+0000","last_change":"2024-05-15T12:09:43.690274+0000","last_active":"2024-05-15T12:09:45.301315+0000","last_peered":"2024-05-15T12:09:45.301315+0000","last_clean":"2024-05-15T12:09:45.301315+0000","last_became_active":"2024-05-15T12:09:43.689924+0000","last_became_peered":"2024-05-15T12:09:43.689924+0000","last_unstale":"2024-05-15T12:09:45.301315+0000","last_undegraded":"2024-05-15T12:09:45.301315+0000","last_fullsized":"2024-05-15T12:09:45.301315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664987+0000","last_change":"2024-05-15T12:09:43.687337+0000","last_active":"2024-05-15T12:09:44.664987+0000","last_peered":"2024-05-15T12:09:44.664987+0000","last_clean":"2024-05-15T12:09:44.664987+0000","last_became_active":"2024-05-15T12:09:43.687077+0000","last_became_peered":"2024-05-15T12:09:43.687077+0000","last_unstale":"2024-05-15T12:09:44.664987+0000","last_undegraded":"2024-05-15T12:09:44.664987+0000","last_fullsized":"2024-05-15T12:09:44.664987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301648+0000","last_change":"2024-05-15T12:09:43.690965+0000","last_active":"2024-05-15T12:09:45.301648+0000","last_peered":"2024-05-15T12:09:45.301648+0000","last_clean":"2024-05-15T12:09:45.301648+0000","last_became_active":"2024-05-15T12:09:43.690543+0000","last_became_peered":"2024-05-15T12:09:43.690543+0000","last_unstale":"2024-05-15T12:09:45.301648+0000","last_undegraded":"2024-05-15T12:09:45.301648+0000","last_fullsized":"2024-05-15T12:09:45.301648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:10:52.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301466+0000","last_change":"2024-05-15T12:09:43.687426+0000","last_active":"2024-05-15T12:09:45.301466+0000","last_peered":"2024-05-15T12:09:45.301466+0000","last_clean":"2024-05-15T12:09:45.301466+0000","last_became_active":"2024-05-15T12:09:43.687081+0000","last_became_peered":"2024-05-15T12:09:43.687081+0000","last_unstale":"2024-05-15T12:09:45.301466+0000","last_undegraded":"2024-05-15T12:09:45.301466+0000","last_fullsized":"2024-05-15T12:09:45.301466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:09.653727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301460+0000","last_change":"2024-05-15T12:09:43.690220+0000","last_active":"2024-05-15T12:09:45.301460+0000","last_peered":"2024-05-15T12:09:45.301460+0000","last_clean":"2024-05-15T12:09:45.301460+0000","last_became_active":"2024-05-15T12:09:43.689961+0000","last_became_peered":"2024-05-15T12:09:43.689961+0000","last_unstale":"2024-05-15T12:09:45.301460+0000","last_undegraded":"2024-05-15T12:09:45.301460+0000","last_fullsized":"2024-05-15T12:09:45.301460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:39:03.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570134+0000","last_change":"2024-05-15T12:09:43.690439+0000","last_active":"2024-05-15T12:09:45.570134+0000","last_peered":"2024-05-15T12:09:45.570134+0000","last_clean":"2024-05-15T12:09:45.570134+0000","last_became_active":"2024-05-15T12:09:43.690122+0000","last_became_peered":"2024-05-15T12:09:43.690122+0000","last_unstale":"2024-05-15T12:09:45.570134+0000","last_undegraded":"2024-05-15T12:09:45.570134+0000","last_fullsized":"2024-05-15T12:09:45.570134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569946+0000","last_change":"2024-05-15T12:09:43.677396+0000","last_active":"2024-05-15T12:09:45.569946+0000","last_peered":"2024-05-15T12:09:45.569946+0000","last_clean":"2024-05-15T12:09:45.569946+0000","last_became_active":"2024-05-15T12:09:43.677134+0000","last_became_peered":"2024-05-15T12:09:43.677134+0000","last_unstale":"2024-05-15T12:09:45.569946+0000","last_undegraded":"2024-05-15T12:09:45.569946+0000","last_fullsized":"2024-05-15T12:09:45.569946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:14.148993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664971+0000","last_change":"2024-05-15T12:09:43.692214+0000","last_active":"2024-05-15T12:09:44.664971+0000","last_peered":"2024-05-15T12:09:44.664971+0000","last_clean":"2024-05-15T12:09:44.664971+0000","last_became_active":"2024-05-15T12:09:43.691930+0000","last_became_peered":"2024-05-15T12:09:43.691930+0000","last_unstale":"2024-05-15T12:09:44.664971+0000","last_undegraded":"2024-05-15T12:09:44.664971+0000","last_fullsized":"2024-05-15T12:09:44.664971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569783+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:45.569783+0000","last_peered":"2024-05-15T12:09:45.569783+0000","last_clean":"2024-05-15T12:09:45.569783+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:45.569783+0000","last_undegraded":"2024-05-15T12:09:45.569783+0000","last_fullsized":"2024-05-15T12:09:45.569783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:46.388308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570602+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:45.570602+0000","last_peered":"2024-05-15T12:09:45.570602+0000","last_clean":"2024-05-15T12:09:45.570602+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:45.570602+0000","last_undegraded":"2024-05-15T12:09:45.570602+0000","last_fullsized":"2024-05-15T12:09:45.570602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:00.031488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569769+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:45.569769+0000","last_peered":"2024-05-15T12:09:45.569769+0000","last_clean":"2024-05-15T12:09:45.569769+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:45.569769+0000","last_undegraded":"2024-05-15T12:09:45.569769+0000","last_fullsized":"2024-05-15T12:09:45.569769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570373+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:45.570373+0000","last_peered":"2024-05-15T12:09:45.570373+0000","last_clean":"2024-05-15T12:09:45.570373+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:45.570373+0000","last_undegraded":"2024-05-15T12:09:45.570373+0000","last_fullsized":"2024-05-15T12:09:45.570373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:51:48.147256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301507+0000","last_change":"2024-05-15T12:09:43.689570+0000","last_active":"2024-05-15T12:09:45.301507+0000","last_peered":"2024-05-15T12:09:45.301507+0000","last_clean":"2024-05-15T12:09:45.301507+0000","last_became_active":"2024-05-15T12:09:43.689307+0000","last_became_peered":"2024-05-15T12:09:43.689307+0000","last_unstale":"2024-05-15T12:09:45.301507+0000","last_undegraded":"2024-05-15T12:09:45.301507+0000","last_fullsized":"2024-05-15T12:09:45.301507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:49.540352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665508+0000","last_change":"2024-05-15T12:09:43.682377+0000","last_active":"2024-05-15T12:09:44.665508+0000","last_peered":"2024-05-15T12:09:44.665508+0000","last_clean":"2024-05-15T12:09:44.665508+0000","last_became_active":"2024-05-15T12:09:43.681994+0000","last_became_peered":"2024-05-15T12:09:43.681994+0000","last_unstale":"2024-05-15T12:09:44.665508+0000","last_undegraded":"2024-05-15T12:09:44.665508+0000","last_fullsized":"2024-05-15T12:09:44.665508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569477+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:45.569477+0000","last_peered":"2024-05-15T12:09:45.569477+0000","last_clean":"2024-05-15T12:09:45.569477+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:45.569477+0000","last_undegraded":"2024-05-15T12:09:45.569477+0000","last_fullsized":"2024-05-15T12:09:45.569477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665400+0000","last_change":"2024-05-15T12:09:43.684244+0000","last_active":"2024-05-15T12:09:44.665400+0000","last_peered":"2024-05-15T12:09:44.665400+0000","last_clean":"2024-05-15T12:09:44.665400+0000","last_became_active":"2024-05-15T12:09:43.683969+0000","last_became_peered":"2024-05-15T12:09:43.683969+0000","last_unstale":"2024-05-15T12:09:44.665400+0000","last_undegraded":"2024-05-15T12:09:44.665400+0000","last_fullsized":"2024-05-15T12:09:44.665400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570957+0000","last_change":"2024-05-15T12:09:43.680234+0000","last_active":"2024-05-15T12:09:45.570957+0000","last_peered":"2024-05-15T12:09:45.570957+0000","last_clean":"2024-05-15T12:09:45.570957+0000","last_became_active":"2024-05-15T12:09:43.679005+0000","last_became_peered":"2024-05-15T12:09:43.679005+0000","last_unstale":"2024-05-15T12:09:45.570957+0000","last_undegraded":"2024-05-15T12:09:45.570957+0000","last_fullsized":"2024-05-15T12:09:45.570957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569504+0000","last_change":"2024-05-15T12:09:43.679589+0000","last_active":"2024-05-15T12:09:45.569504+0000","last_peered":"2024-05-15T12:09:45.569504+0000","last_clean":"2024-05-15T12:09:45.569504+0000","last_became_active":"2024-05-15T12:09:43.679299+0000","last_became_peered":"2024-05-15T12:09:43.679299+0000","last_unstale":"2024-05-15T12:09:45.569504+0000","last_undegraded":"2024-05-15T12:09:45.569504+0000","last_fullsized":"2024-05-15T12:09:45.569504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569877+0000","last_change":"2024-05-15T12:09:43.690523+0000","last_active":"2024-05-15T12:09:45.569877+0000","last_peered":"2024-05-15T12:09:45.569877+0000","last_clean":"2024-05-15T12:09:45.569877+0000","last_became_active":"2024-05-15T12:09:43.690212+0000","last_became_peered":"2024-05-15T12:09:43.690212+0000","last_unstale":"2024-05-15T12:09:45.569877+0000","last_undegraded":"2024-05-15T12:09:45.569877+0000","last_fullsized":"2024-05-15T12:09:45.569877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665359+0000","last_change":"2024-05-15T12:09:43.682107+0000","last_active":"2024-05-15T12:09:44.665359+0000","last_peered":"2024-05-15T12:09:44.665359+0000","last_clean":"2024-05-15T12:09:44.665359+0000","last_became_active":"2024-05-15T12:09:43.681812+0000","last_became_peered":"2024-05-15T12:09:43.681812+0000","last_unstale":"2024-05-15T12:09:44.665359+0000","last_undegraded":"2024-05-15T12:09:44.665359+0000","last_fullsized":"2024-05-15T12:09:44.665359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569621+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:45.569621+0000","last_peered":"2024-05-15T12:09:45.569621+0000","last_clean":"2024-05-15T12:09:45.569621+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:45.569621+0000","last_undegraded":"2024-05-15T12:09:45.569621+0000","last_fullsized":"2024-05-15T12:09:45.569621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:17.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569080+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:45.569080+0000","last_peered":"2024-05-15T12:09:45.569080+0000","last_clean":"2024-05-15T12:09:45.569080+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:45.569080+0000","last_undegraded":"2024-05-15T12:09:45.569080+0000","last_fullsized":"2024-05-15T12:09:45.569080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570107+0000","last_change":"2024-05-15T12:09:43.681262+0000","last_active":"2024-05-15T12:09:45.570107+0000","last_peered":"2024-05-15T12:09:45.570107+0000","last_clean":"2024-05-15T12:09:45.570107+0000","last_became_active":"2024-05-15T12:09:43.680971+0000","last_became_peered":"2024-05-15T12:09:43.680971+0000","last_unstale":"2024-05-15T12:09:45.570107+0000","last_undegraded":"2024-05-15T12:09:45.570107+0000","last_fullsized":"2024-05-15T12:09:45.570107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665379+0000","last_change":"2024-05-15T12:09:42.676644+0000","last_active":"2024-05-15T12:09:44.665379+0000","last_peered":"2024-05-15T12:09:44.665379+0000","last_clean":"2024-05-15T12:09:44.665379+0000","last_became_active":"2024-05-15T12:09:42.676347+0000","last_became_peered":"2024-05-15T12:09:42.676347+0000","last_unstale":"2024-05-15T12:09:44.665379+0000","last_undegraded":"2024-05-15T12:09:44.665379+0000","last_fullsized":"2024-05-15T12:09:44.665379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569732+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:45.569732+0000","last_peered":"2024-05-15T12:09:45.569732+0000","last_clean":"2024-05-15T12:09:45.569732+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:45.569732+0000","last_undegraded":"2024-05-15T12:09:45.569732+0000","last_fullsized":"2024-05-15T12:09:45.569732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569824+0000","last_change":"2024-05-15T12:09:42.683878+0000","last_active":"2024-05-15T12:09:45.569824+0000","last_peered":"2024-05-15T12:09:45.569824+0000","last_clean":"2024-05-15T12:09:45.569824+0000","last_became_active":"2024-05-15T12:09:42.683562+0000","last_became_peered":"2024-05-15T12:09:42.683562+0000","last_unstale":"2024-05-15T12:09:45.569824+0000","last_undegraded":"2024-05-15T12:09:45.569824+0000","last_fullsized":"2024-05-15T12:09:45.569824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665167+0000","last_change":"2024-05-15T12:09:43.683141+0000","last_active":"2024-05-15T12:09:44.665167+0000","last_peered":"2024-05-15T12:09:44.665167+0000","last_clean":"2024-05-15T12:09:44.665167+0000","last_became_active":"2024-05-15T12:09:43.682835+0000","last_became_peered":"2024-05-15T12:09:43.682835+0000","last_unstale":"2024-05-15T12:09:44.665167+0000","last_undegraded":"2024-05-15T12:09:44.665167+0000","last_fullsized":"2024-05-15T12:09:44.665167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569587+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:45.569587+0000","last_peered":"2024-05-15T12:09:45.569587+0000","last_clean":"2024-05-15T12:09:45.569587+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:45.569587+0000","last_undegraded":"2024-05-15T12:09:45.569587+0000","last_fullsized":"2024-05-15T12:09:45.569587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570969+0000","last_change":"2024-05-15T12:09:43.680034+0000","last_active":"2024-05-15T12:09:45.570969+0000","last_peered":"2024-05-15T12:09:45.570969+0000","last_clean":"2024-05-15T12:09:45.570969+0000","last_became_active":"2024-05-15T12:09:43.678658+0000","last_became_peered":"2024-05-15T12:09:43.678658+0000","last_unstale":"2024-05-15T12:09:45.570969+0000","last_undegraded":"2024-05-15T12:09:45.570969+0000","last_fullsized":"2024-05-15T12:09:45.570969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301750+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:45.301750+0000","last_peered":"2024-05-15T12:09:45.301750+0000","last_clean":"2024-05-15T12:09:45.301750+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:45.301750+0000","last_undegraded":"2024-05-15T12:09:45.301750+0000","last_fullsized":"2024-05-15T12:09:45.301750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665608+0000","last_change":"2024-05-15T12:09:43.684173+0000","last_active":"2024-05-15T12:09:44.665608+0000","last_peered":"2024-05-15T12:09:44.665608+0000","last_clean":"2024-05-15T12:09:44.665608+0000","last_became_active":"2024-05-15T12:09:43.683863+0000","last_became_peered":"2024-05-15T12:09:43.683863+0000","last_unstale":"2024-05-15T12:09:44.665608+0000","last_undegraded":"2024-05-15T12:09:44.665608+0000","last_fullsized":"2024-05-15T12:09:44.665608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569400+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:45.569400+0000","last_peered":"2024-05-15T12:09:45.569400+0000","last_clean":"2024-05-15T12:09:45.569400+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:45.569400+0000","last_undegraded":"2024-05-15T12:09:45.569400+0000","last_fullsized":"2024-05-15T12:09:45.569400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570185+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:45.570185+0000","last_peered":"2024-05-15T12:09:45.570185+0000","last_clean":"2024-05-15T12:09:45.570185+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:45.570185+0000","last_undegraded":"2024-05-15T12:09:45.570185+0000","last_fullsized":"2024-05-15T12:09:45.570185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:13.810960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570672+0000","last_change":"2024-05-15T12:09:42.670666+0000","last_active":"2024-05-15T12:09:45.570672+0000","last_peered":"2024-05-15T12:09:45.570672+0000","last_clean":"2024-05-15T12:09:45.570672+0000","last_became_active":"2024-05-15T12:09:42.669923+0000","last_became_peered":"2024-05-15T12:09:42.669923+0000","last_unstale":"2024-05-15T12:09:45.570672+0000","last_undegraded":"2024-05-15T12:09:45.570672+0000","last_fullsized":"2024-05-15T12:09:45.570672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301535+0000","last_change":"2024-05-15T12:09:43.687137+0000","last_active":"2024-05-15T12:09:45.301535+0000","last_peered":"2024-05-15T12:09:45.301535+0000","last_clean":"2024-05-15T12:09:45.301535+0000","last_became_active":"2024-05-15T12:09:43.686734+0000","last_became_peered":"2024-05-15T12:09:43.686734+0000","last_unstale":"2024-05-15T12:09:45.301535+0000","last_undegraded":"2024-05-15T12:09:45.301535+0000","last_fullsized":"2024-05-15T12:09:45.301535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:41:27.669352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569471+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:45.569471+0000","last_peered":"2024-05-15T12:09:45.569471+0000","last_clean":"2024-05-15T12:09:45.569471+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:45.569471+0000","last_undegraded":"2024-05-15T12:09:45.569471+0000","last_fullsized":"2024-05-15T12:09:45.569471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570051+0000","last_change":"2024-05-15T12:09:43.676947+0000","last_active":"2024-05-15T12:09:45.570051+0000","last_peered":"2024-05-15T12:09:45.570051+0000","last_clean":"2024-05-15T12:09:45.570051+0000","last_became_active":"2024-05-15T12:09:43.676630+0000","last_became_peered":"2024-05-15T12:09:43.676630+0000","last_unstale":"2024-05-15T12:09:45.570051+0000","last_undegraded":"2024-05-15T12:09:45.570051+0000","last_fullsized":"2024-05-15T12:09:45.570051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569792+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:45.569792+0000","last_peered":"2024-05-15T12:09:45.569792+0000","last_clean":"2024-05-15T12:09:45.569792+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:45.569792+0000","last_undegraded":"2024-05-15T12:09:45.569792+0000","last_fullsized":"2024-05-15T12:09:45.569792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569904+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:45.569904+0000","last_peered":"2024-05-15T12:09:45.569904+0000","last_clean":"2024-05-15T12:09:45.569904+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:45.569904+0000","last_undegraded":"2024-05-15T12:09:45.569904+0000","last_fullsized":"2024-05-15T12:09:45.569904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:29.858762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301233+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:45.301233+0000","last_peered":"2024-05-15T12:09:45.301233+0000","last_clean":"2024-05-15T12:09:45.301233+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:45.301233+0000","last_undegraded":"2024-05-15T12:09:45.301233+0000","last_fullsized":"2024-05-15T12:09:45.301233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569525+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:45.569525+0000","last_peered":"2024-05-15T12:09:45.569525+0000","last_clean":"2024-05-15T12:09:45.569525+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:45.569525+0000","last_undegraded":"2024-05-15T12:09:45.569525+0000","last_fullsized":"2024-05-15T12:09:45.569525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:57:51.828579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301822+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:45.301822+0000","last_peered":"2024-05-15T12:09:45.301822+0000","last_clean":"2024-05-15T12:09:45.301822+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:45.301822+0000","last_undegraded":"2024-05-15T12:09:45.301822+0000","last_fullsized":"2024-05-15T12:09:45.301822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.571120+0000","last_change":"2024-05-15T12:09:43.691593+0000","last_active":"2024-05-15T12:09:45.571120+0000","last_peered":"2024-05-15T12:09:45.571120+0000","last_clean":"2024-05-15T12:09:45.571120+0000","last_became_active":"2024-05-15T12:09:43.691327+0000","last_became_peered":"2024-05-15T12:09:43.691327+0000","last_unstale":"2024-05-15T12:09:45.571120+0000","last_undegraded":"2024-05-15T12:09:45.571120+0000","last_fullsized":"2024-05-15T12:09:45.571120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301808+0000","last_change":"2024-05-15T12:09:43.689517+0000","last_active":"2024-05-15T12:09:45.301808+0000","last_peered":"2024-05-15T12:09:45.301808+0000","last_clean":"2024-05-15T12:09:45.301808+0000","last_became_active":"2024-05-15T12:09:43.689258+0000","last_became_peered":"2024-05-15T12:09:43.689258+0000","last_unstale":"2024-05-15T12:09:45.301808+0000","last_undegraded":"2024-05-15T12:09:45.301808+0000","last_fullsized":"2024-05-15T12:09:45.301808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:47:15.314058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665387+0000","last_change":"2024-05-15T12:09:42.675771+0000","last_active":"2024-05-15T12:09:44.665387+0000","last_peered":"2024-05-15T12:09:44.665387+0000","last_clean":"2024-05-15T12:09:44.665387+0000","last_became_active":"2024-05-15T12:09:42.675470+0000","last_became_peered":"2024-05-15T12:09:42.675470+0000","last_unstale":"2024-05-15T12:09:44.665387+0000","last_undegraded":"2024-05-15T12:09:44.665387+0000","last_fullsized":"2024-05-15T12:09:44.665387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:18.831524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301647+0000","last_change":"2024-05-15T12:09:43.688535+0000","last_active":"2024-05-15T12:09:45.301647+0000","last_peered":"2024-05-15T12:09:45.301647+0000","last_clean":"2024-05-15T12:09:45.301647+0000","last_became_active":"2024-05-15T12:09:43.688274+0000","last_became_peered":"2024-05-15T12:09:43.688274+0000","last_unstale":"2024-05-15T12:09:45.301647+0000","last_undegraded":"2024-05-15T12:09:45.301647+0000","last_fullsized":"2024-05-15T12:09:45.301647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:47:15.480528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570014+0000","last_change":"2024-05-15T12:09:42.684015+0000","last_active":"2024-05-15T12:09:45.570014+0000","last_peered":"2024-05-15T12:09:45.570014+0000","last_clean":"2024-05-15T12:09:45.570014+0000","last_became_active":"2024-05-15T12:09:42.683509+0000","last_became_peered":"2024-05-15T12:09:42.683509+0000","last_unstale":"2024-05-15T12:09:45.570014+0000","last_undegraded":"2024-05-15T12:09:45.570014+0000","last_fullsized":"2024-05-15T12:09:45.570014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570287+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:45.570287+0000","last_peered":"2024-05-15T12:09:45.570287+0000","last_clean":"2024-05-15T12:09:45.570287+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:45.570287+0000","last_undegraded":"2024-05-15T12:09:45.570287+0000","last_fullsized":"2024-05-15T12:09:45.570287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:59.653626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570049+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:45.570049+0000","last_peered":"2024-05-15T12:09:45.570049+0000","last_clean":"2024-05-15T12:09:45.570049+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:45.570049+0000","last_undegraded":"2024-05-15T12:09:45.570049+0000","last_fullsized":"2024-05-15T12:09:45.570049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569733+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:45.569733+0000","last_peered":"2024-05-15T12:09:45.569733+0000","last_clean":"2024-05-15T12:09:45.569733+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:45.569733+0000","last_undegraded":"2024-05-15T12:09:45.569733+0000","last_fullsized":"2024-05-15T12:09:45.569733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569728+0000","last_change":"2024-05-15T12:09:43.681455+0000","last_active":"2024-05-15T12:09:45.569728+0000","last_peered":"2024-05-15T12:09:45.569728+0000","last_clean":"2024-05-15T12:09:45.569728+0000","last_became_active":"2024-05-15T12:09:43.681192+0000","last_became_peered":"2024-05-15T12:09:43.681192+0000","last_unstale":"2024-05-15T12:09:45.569728+0000","last_undegraded":"2024-05-15T12:09:45.569728+0000","last_fullsized":"2024-05-15T12:09:45.569728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569206+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:45.569206+0000","last_peered":"2024-05-15T12:09:45.569206+0000","last_clean":"2024-05-15T12:09:45.569206+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:45.569206+0000","last_undegraded":"2024-05-15T12:09:45.569206+0000","last_fullsized":"2024-05-15T12:09:45.569206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665688+0000","last_change":"2024-05-15T12:09:43.681676+0000","last_active":"2024-05-15T12:09:44.665688+0000","last_peered":"2024-05-15T12:09:44.665688+0000","last_clean":"2024-05-15T12:09:44.665688+0000","last_became_active":"2024-05-15T12:09:43.681405+0000","last_became_peered":"2024-05-15T12:09:43.681405+0000","last_unstale":"2024-05-15T12:09:44.665688+0000","last_undegraded":"2024-05-15T12:09:44.665688+0000","last_fullsized":"2024-05-15T12:09:44.665688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:07:48.262342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569916+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:45.569916+0000","last_peered":"2024-05-15T12:09:45.569916+0000","last_clean":"2024-05-15T12:09:45.569916+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:45.569916+0000","last_undegraded":"2024-05-15T12:09:45.569916+0000","last_fullsized":"2024-05-15T12:09:45.569916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301462+0000","last_change":"2024-05-15T12:09:43.688728+0000","last_active":"2024-05-15T12:09:45.301462+0000","last_peered":"2024-05-15T12:09:45.301462+0000","last_clean":"2024-05-15T12:09:45.301462+0000","last_became_active":"2024-05-15T12:09:43.688448+0000","last_became_peered":"2024-05-15T12:09:43.688448+0000","last_unstale":"2024-05-15T12:09:45.301462+0000","last_undegraded":"2024-05-15T12:09:45.301462+0000","last_fullsized":"2024-05-15T12:09:45.301462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:32.589878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665274+0000","last_change":"2024-05-15T12:09:42.676729+0000","last_active":"2024-05-15T12:09:44.665274+0000","last_peered":"2024-05-15T12:09:44.665274+0000","last_clean":"2024-05-15T12:09:44.665274+0000","last_became_active":"2024-05-15T12:09:42.676435+0000","last_became_peered":"2024-05-15T12:09:42.676435+0000","last_unstale":"2024-05-15T12:09:44.665274+0000","last_undegraded":"2024-05-15T12:09:44.665274+0000","last_fullsized":"2024-05-15T12:09:44.665274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570802+0000","last_change":"2024-05-15T12:09:43.683565+0000","last_active":"2024-05-15T12:09:45.570802+0000","last_peered":"2024-05-15T12:09:45.570802+0000","last_clean":"2024-05-15T12:09:45.570802+0000","last_became_active":"2024-05-15T12:09:43.683268+0000","last_became_peered":"2024-05-15T12:09:43.683268+0000","last_unstale":"2024-05-15T12:09:45.570802+0000","last_undegraded":"2024-05-15T12:09:45.570802+0000","last_fullsized":"2024-05-15T12:09:45.570802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570420+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:45.570420+0000","last_peered":"2024-05-15T12:09:45.570420+0000","last_clean":"2024-05-15T12:09:45.570420+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:45.570420+0000","last_undegraded":"2024-05-15T12:09:45.570420+0000","last_fullsized":"2024-05-15T12:09:45.570420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570045+0000","last_change":"2024-05-15T12:09:43.685808+0000","last_active":"2024-05-15T12:09:45.570045+0000","last_peered":"2024-05-15T12:09:45.570045+0000","last_clean":"2024-05-15T12:09:45.570045+0000","last_became_active":"2024-05-15T12:09:43.685355+0000","last_became_peered":"2024-05-15T12:09:43.685355+0000","last_unstale":"2024-05-15T12:09:45.570045+0000","last_undegraded":"2024-05-15T12:09:45.570045+0000","last_fullsized":"2024-05-15T12:09:45.570045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.252560+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:45.252560+0000","last_peered":"2024-05-15T12:09:45.252560+0000","last_clean":"2024-05-15T12:09:45.252560+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:45.252560+0000","last_undegraded":"2024-05-15T12:09:45.252560+0000","last_fullsized":"2024-05-15T12:09:45.252560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570594+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:45.570594+0000","last_peered":"2024-05-15T12:09:45.570594+0000","last_clean":"2024-05-15T12:09:45.570594+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:45.570594+0000","last_undegraded":"2024-05-15T12:09:45.570594+0000","last_fullsized":"2024-05-15T12:09:45.570594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301077+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:45.301077+0000","last_peered":"2024-05-15T12:09:45.301077+0000","last_clean":"2024-05-15T12:09:45.301077+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:45.301077+0000","last_undegraded":"2024-05-15T12:09:45.301077+0000","last_fullsized":"2024-05-15T12:09:45.301077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:21:15.071184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569731+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:45.569731+0000","last_peered":"2024-05-15T12:09:45.569731+0000","last_clean":"2024-05-15T12:09:45.569731+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:45.569731+0000","last_undegraded":"2024-05-15T12:09:45.569731+0000","last_fullsized":"2024-05-15T12:09:45.569731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:14.329414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570171+0000","last_change":"2024-05-15T12:09:42.677520+0000","last_active":"2024-05-15T12:09:45.570171+0000","last_peered":"2024-05-15T12:09:45.570171+0000","last_clean":"2024-05-15T12:09:45.570171+0000","last_became_active":"2024-05-15T12:09:42.677226+0000","last_became_peered":"2024-05-15T12:09:42.677226+0000","last_unstale":"2024-05-15T12:09:45.570171+0000","last_undegraded":"2024-05-15T12:09:45.570171+0000","last_fullsized":"2024-05-15T12:09:45.570171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569369+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:45.569369+0000","last_peered":"2024-05-15T12:09:45.569369+0000","last_clean":"2024-05-15T12:09:45.569369+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:45.569369+0000","last_undegraded":"2024-05-15T12:09:45.569369+0000","last_fullsized":"2024-05-15T12:09:45.569369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569625+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:45.569625+0000","last_peered":"2024-05-15T12:09:45.569625+0000","last_clean":"2024-05-15T12:09:45.569625+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:45.569625+0000","last_undegraded":"2024-05-15T12:09:45.569625+0000","last_fullsized":"2024-05-15T12:09:45.569625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569706+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:45.569706+0000","last_peered":"2024-05-15T12:09:45.569706+0000","last_clean":"2024-05-15T12:09:45.569706+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:45.569706+0000","last_undegraded":"2024-05-15T12:09:45.569706+0000","last_fullsized":"2024-05-15T12:09:45.569706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:52.672228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570220+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:45.570220+0000","last_peered":"2024-05-15T12:09:45.570220+0000","last_clean":"2024-05-15T12:09:45.570220+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:45.570220+0000","last_undegraded":"2024-05-15T12:09:45.570220+0000","last_fullsized":"2024-05-15T12:09:45.570220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:18.042253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301615+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:45.301615+0000","last_peered":"2024-05-15T12:09:45.301615+0000","last_clean":"2024-05-15T12:09:45.301615+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:45.301615+0000","last_undegraded":"2024-05-15T12:09:45.301615+0000","last_fullsized":"2024-05-15T12:09:45.301615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301605+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:45.301605+0000","last_peered":"2024-05-15T12:09:45.301605+0000","last_clean":"2024-05-15T12:09:45.301605+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:45.301605+0000","last_undegraded":"2024-05-15T12:09:45.301605+0000","last_fullsized":"2024-05-15T12:09:45.301605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.554599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665670+0000","last_change":"2024-05-15T12:09:43.684828+0000","last_active":"2024-05-15T12:09:44.665670+0000","last_peered":"2024-05-15T12:09:44.665670+0000","last_clean":"2024-05-15T12:09:44.665670+0000","last_became_active":"2024-05-15T12:09:43.684507+0000","last_became_peered":"2024-05-15T12:09:43.684507+0000","last_unstale":"2024-05-15T12:09:44.665670+0000","last_undegraded":"2024-05-15T12:09:44.665670+0000","last_fullsized":"2024-05-15T12:09:44.665670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:43:32.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665626+0000","last_change":"2024-05-15T12:09:42.673579+0000","last_active":"2024-05-15T12:09:44.665626+0000","last_peered":"2024-05-15T12:09:44.665626+0000","last_clean":"2024-05-15T12:09:44.665626+0000","last_became_active":"2024-05-15T12:09:42.673301+0000","last_became_peered":"2024-05-15T12:09:42.673301+0000","last_unstale":"2024-05-15T12:09:44.665626+0000","last_undegraded":"2024-05-15T12:09:44.665626+0000","last_fullsized":"2024-05-15T12:09:44.665626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:41.126536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665510+0000","last_change":"2024-05-15T12:09:43.686476+0000","last_active":"2024-05-15T12:09:44.665510+0000","last_peered":"2024-05-15T12:09:44.665510+0000","last_clean":"2024-05-15T12:09:44.665510+0000","last_became_active":"2024-05-15T12:09:43.684889+0000","last_became_peered":"2024-05-15T12:09:43.684889+0000","last_unstale":"2024-05-15T12:09:44.665510+0000","last_undegraded":"2024-05-15T12:09:44.665510+0000","last_fullsized":"2024-05-15T12:09:44.665510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:52.422 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T12:09:52.423 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-15T12:09:52.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-15T12:09:52.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-15T12:09:52.423 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 Processor -- start 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 -- start start 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c815ff30 0x7fc0c8160310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc0c8068260 0x7fc0c80b4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0c806ed70 con 0x7fc0c8068710 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc0c806f050 con 0x7fc0c8068260 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.564+0000 7fc0ceb11640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c806f330 con 0x7fc0c815ff30 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0c7fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc0c8068260 0x7fc0c80b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0cd0ae640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc0c8068710 0x7fc0c8162fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:53098/0 (socket says 172.21.15.77:53098) 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0cc8ad640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c815ff30 0x7fc0c8160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0cd0ae640 1 -- 172.21.15.77:0/3067876272 learned_addr learned my addr 172.21.15.77:0/3067876272 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c815ff30 msgr2=0x7fc0c8160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0c7fff640 1 --2- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c815ff30 0x7fc0c8160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3067876272 >> v1:172.21.15.83:6789/0 conn(0x7fc0c8068710 legacy=0x7fc0c8162fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3067876272 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c806f610 con 0x7fc0c8068260 2024-05-15T12:09:52.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.565+0000 7fc0cc8ad640 1 --2- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c815ff30 0x7fc0c8160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0c7fff640 1 --2- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c8068260 0x7fc0c80b4670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00097a0 tx=0x7fc0b002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bebfbfd8429c0eef server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0c77fe640 1 -- 172.21.15.77:0/3067876272 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0037070 con 0x7fc0c8068260 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0c77fe640 1 -- 172.21.15.77:0/3067876272 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b002ae50 con 0x7fc0c8068260 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0c77fe640 1 -- 172.21.15.77:0/3067876272 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0032660 con 0x7fc0c8068260 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c8068260 msgr2=0x7fc0c80b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c8068260 0x7fc0c80b4670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0b00097a0 tx=0x7fc0b002a100 comp rx=0 tx=0).stop 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3067876272 shutdown_connections 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c8068260 0x7fc0c80b4670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3067876272 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c815ff30 0x7fc0c8160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3067876272 >> 172.21.15.77:0/3067876272 conn(0x7fc0c80d1660 msgr2=0x7fc0c80d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3067876272 shutdown_connections 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.566+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3067876272 wait complete. 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.568+0000 7fc0ceb11640 1 Processor -- start 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.568+0000 7fc0ceb11640 1 -- start start 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.568+0000 7fc0ceb11640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c8068260 0x7fc0c8149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.568+0000 7fc0ceb11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 0x7fc0c81563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.568+0000 7fc0ceb11640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c815ff30 0x7fc0c8156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.568+0000 7fc0ceb11640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c81609d0 con 0x7fc0c8068710 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0ceb11640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0c8160850 con 0x7fc0c815ff30 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0ceb11640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc0c80b4bb0 con 0x7fc0c8068260 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 0x7fc0c81563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 0x7fc0c81563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57808/0 (socket says 172.21.15.77:57808) 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3109227225 learned_addr learned my addr 172.21.15.77:0/3109227225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0cc8ad640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c8068260 0x7fc0c8149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0cd0ae640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c815ff30 0x7fc0c8156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c8068260 msgr2=0x7fc0c8149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c8068260 0x7fc0c8149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c815ff30 msgr2=0x7fc0c8156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c815ff30 0x7fc0c8156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 -- 172.21.15.77:0/3109227225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0c80cfb50 con 0x7fc0c8068710 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0cd0ae640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c815ff30 0x7fc0c8156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c7fff640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 0x7fc0c81563c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0035040 tx=0x7fc0b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0041070 con 0x7fc0c8068710 2024-05-15T12:09:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0b003c460 con 0x7fc0c8068710 2024-05-15T12:09:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0c80cfe30 con 0x7fc0c8068710 2024-05-15T12:09:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0037040 con 0x7fc0c8068710 2024-05-15T12:09:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.569+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0c80ced60 con 0x7fc0c8068710 2024-05-15T12:09:52.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.570+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0c814a9b0 con 0x7fc0c8068710 2024-05-15T12:09:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.571+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0b003a070 con 0x7fc0c8068710 2024-05-15T12:09:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.571+0000 7fc0c57fa640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0a80762d0 0x7fc0a8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.571+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc0b00b7a10 con 0x7fc0c8068710 2024-05-15T12:09:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.571+0000 7fc0cc8ad640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0a80762d0 0x7fc0a8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.572+0000 7fc0cc8ad640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0a80762d0 0x7fc0a8078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8007440 tx=0x7fc0b800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.570 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.576+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0c814a9b0 con 0x7fc0c8068710 2024-05-15T12:09:52.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.802+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc0c8159a90 con 0x7fc0c8068710 2024-05-15T12:09:52.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.805+0000 7fc0c57fa640 1 -- 172.21.15.77:0/3109227225 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189521 (secure 0 0 0) 0x7fc0b0081400 con 0x7fc0c8068710 2024-05-15T12:09:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0a80762d0 msgr2=0x7fc0a8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0a80762d0 0x7fc0a8078790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8007440 tx=0x7fc0b800b040 comp rx=0 tx=0).stop 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 msgr2=0x7fc0c81563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 0x7fc0c81563c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0035040 tx=0x7fc0b00046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 shutdown_connections 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0a80762d0 0x7fc0a8078790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0c815ff30 0x7fc0c8156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c8068710 0x7fc0c81563c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 --2- 172.21.15.77:0/3109227225 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0c8068260 0x7fc0c8149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 >> 172.21.15.77:0/3109227225 conn(0x7fc0c80d1660 msgr2=0x7fc0c806cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 shutdown_connections 2024-05-15T12:09:52.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.807+0000 7fc0ceb11640 1 -- 172.21.15.77:0/3109227225 wait complete. 2024-05-15T12:09:52.813 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":3769114186},{"type":"v1","addr":"172.21.15.77:6833","nonce":3769114186}]},"active_addr":"172.21.15.77:6833/3769114186","active_change":"2024-05-15T12:09:24.235427+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2451744388}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2009339327}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1822615900}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":4123009227}]}]} 2024-05-15T12:09:52.818 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-15T12:09:52.818 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-15T12:09:52.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:52.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.922+0000 7f4c45a72640 1 Processor -- start 2024-05-15T12:09:52.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.922+0000 7f4c45a72640 1 -- start start 2024-05-15T12:09:52.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c45a72640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c400cfe70 0x7f4c400706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c45a72640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c40072680 con 0x7f4c40148b10 2024-05-15T12:09:52.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c45a72640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c40072960 con 0x7f4c400cf9e0 2024-05-15T12:09:52.918 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c45a72640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4c400d0280 con 0x7f4c400cfe70 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c400cfe70 0x7f4c400706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c400cfe70 0x7f4c400706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56116/0 (socket says 172.21.15.77:56116) 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3ffff640 1 -- 172.21.15.77:0/996117176 learned_addr learned my addr 172.21.15.77:0/996117176 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3f7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4c40148b10 0x7f4c40071c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44280/0 (socket says 172.21.15.77:44280) 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3ffff640 1 -- 172.21.15.77:0/996117176 >> v1:172.21.15.83:6789/0 conn(0x7f4c400cf9e0 legacy=0x7f4c4006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3ffff640 1 -- 172.21.15.77:0/996117176 >> v1:172.21.15.77:6789/0 conn(0x7f4c40148b10 legacy=0x7f4c40071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3e7fc640 1 -- 172.21.15.77:0/996117176 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 307014080 0 0) 0x7f4c40072680 con 0x7f4c40148b10 2024-05-15T12:09:52.919 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.923+0000 7f4c3ffff640 1 -- 172.21.15.77:0/996117176 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4006dbb0 con 0x7f4c400cfe70 2024-05-15T12:09:52.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.924+0000 7f4c3ffff640 1 --2- 172.21.15.77:0/996117176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c400706f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009870 tx=0x7f4c3802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfb14b6c62e12b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.924+0000 7f4c3e7fc640 1 -- 172.21.15.77:0/996117176 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38037070 con 0x7f4c400cfe70 2024-05-15T12:09:52.920 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.924+0000 7f4c3e7fc640 1 -- 172.21.15.77:0/996117176 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c38032440 con 0x7f4c400cfe70 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.924+0000 7f4c3e7fc640 1 -- 172.21.15.77:0/996117176 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c38032810 con 0x7f4c400cfe70 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 -- 172.21.15.77:0/996117176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 msgr2=0x7f4c400706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 --2- 172.21.15.77:0/996117176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c400706f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c38009870 tx=0x7f4c3802a130 comp rx=0 tx=0).stop 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 -- 172.21.15.77:0/996117176 shutdown_connections 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 --2- 172.21.15.77:0/996117176 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c400706f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 -- 172.21.15.77:0/996117176 >> 172.21.15.77:0/996117176 conn(0x7f4c400d2fd0 msgr2=0x7f4c400d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 -- 172.21.15.77:0/996117176 shutdown_connections 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.925+0000 7f4c45a72640 1 -- 172.21.15.77:0/996117176 wait complete. 2024-05-15T12:09:52.921 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.926+0000 7f4c45a72640 1 Processor -- start 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.926+0000 7f4c45a72640 1 -- start start 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c45a72640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c400cf9e0 0x7f4c4015ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c45a72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c401423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c45a72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c40148b10 0x7f4c4013d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c45a72640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40072340 con 0x7f4c400cfe70 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c45a72640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40148ef0 con 0x7f4c40148b10 2024-05-15T12:09:52.924 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c45a72640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4c400b6100 con 0x7f4c400cf9e0 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c401423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c401423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56118/0 (socket says 172.21.15.77:56118) 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 -- 172.21.15.77:0/1269062135 learned_addr learned my addr 172.21.15.77:0/1269062135 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 -- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c400cf9e0 msgr2=0x7f4c4015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3f7fe640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c400cf9e0 0x7f4c4015ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3ffff640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c40148b10 0x7f4c4013d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c400cf9e0 0x7f4c4015ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 -- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c40148b10 msgr2=0x7f4c4013d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c40148b10 0x7f4c4013d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 -- 172.21.15.77:0/1269062135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c40141300 con 0x7f4c400cfe70 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3f7fe640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c400cf9e0 0x7f4c4015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3ffff640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c40148b10 0x7f4c4013d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.927+0000 7f4c3effd640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c401423a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400ba80 tx=0x7f4c3400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.928+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400cc00 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.928+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c3400cda0 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.928+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c401415e0 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.928+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34003bb0 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.928+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c40141ba0 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.929+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4006a640 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.929+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4c34014440 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.930+0000 7f4c27fff640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c2c0762d0 0x7f4c2c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.930+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4c34097530 con 0x7f4c400cfe70 2024-05-15T12:09:52.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.930+0000 7f4c3f7fe640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c2c0762d0 0x7f4c2c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:52.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.930+0000 7f4c3f7fe640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c2c0762d0 0x7f4c2c078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000f60 tx=0x7f4c30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:52.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:52.934+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4c34060e90 con 0x7f4c400cfe70 2024-05-15T12:09:53.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.112+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c400cf350 con 0x7f4c400cfe70 2024-05-15T12:09:53.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.113+0000 7f4c27fff640 1 -- 172.21.15.77:0/1269062135 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7f4c34060790 con 0x7f4c400cfe70 2024-05-15T12:09:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:53.108 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:53.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c2c0762d0 msgr2=0x7f4c2c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c2c0762d0 0x7f4c2c078790 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4c30000f60 tx=0x7f4c30009040 comp rx=0 tx=0).stop 2024-05-15T12:09:53.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 msgr2=0x7f4c401423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c401423a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400ba80 tx=0x7f4c3400bf40 comp rx=0 tx=0).stop 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 shutdown_connections 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c2c0762d0 0x7f4c2c078790 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4c40148b10 0x7f4c4013d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c400cfe70 0x7f4c401423a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 --2- 172.21.15.77:0/1269062135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4c400cf9e0 0x7f4c4015ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 >> 172.21.15.77:0/1269062135 conn(0x7f4c400d2fd0 msgr2=0x7f4c400cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 shutdown_connections 2024-05-15T12:09:53.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.115+0000 7f4c45a72640 1 -- 172.21.15.77:0/1269062135 wait complete. 2024-05-15T12:09:53.121 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-15T12:09:53.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:53.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.227+0000 7fdd84f24640 1 Processor -- start 2024-05-15T12:09:53.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.227+0000 7fdd84f24640 1 -- start start 2024-05-15T12:09:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd84f24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f460 0x7fdd800d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd84f24640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd8015f840 0x7fdd800d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd84f24640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd800d0dd0 con 0x7fdd800d0060 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd84f24640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdd800d19e0 con 0x7fdd8015f840 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd84f24640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800d10b0 con 0x7fdd8015f460 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd8015f840 0x7fdd800d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdd8015f840 0x7fdd800d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56120/0 (socket says 172.21.15.77:56120) 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/4036287102 learned_addr learned my addr 172.21.15.77:0/4036287102 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7e59c640 1 --2- 172.21.15.77:0/4036287102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f460 0x7fdd800d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/4036287102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f460 msgr2=0x7fdd800d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 --2- 172.21.15.77:0/4036287102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f460 0x7fdd800d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/4036287102 >> v1:172.21.15.83:6789/0 conn(0x7fdd800d0060 legacy=0x7fdd800d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.229+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/4036287102 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd800d1390 con 0x7fdd8015f840 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.230+0000 7fdd7dd9b640 1 --2- 172.21.15.77:0/4036287102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f840 0x7fdd800d3e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009870 tx=0x7fdd7402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672228dbcac9d3fb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.230+0000 7fdd7d59a640 1 -- 172.21.15.77:0/4036287102 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74037070 con 0x7fdd8015f840 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.230+0000 7fdd7d59a640 1 -- 172.21.15.77:0/4036287102 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74032440 con 0x7fdd8015f840 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.230+0000 7fdd7d59a640 1 -- 172.21.15.77:0/4036287102 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74032810 con 0x7fdd8015f840 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 -- 172.21.15.77:0/4036287102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f840 msgr2=0x7fdd800d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 --2- 172.21.15.77:0/4036287102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f840 0x7fdd800d3e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009870 tx=0x7fdd7402a130 comp rx=0 tx=0).stop 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 -- 172.21.15.77:0/4036287102 shutdown_connections 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 --2- 172.21.15.77:0/4036287102 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f840 0x7fdd800d3e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 --2- 172.21.15.77:0/4036287102 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f460 0x7fdd800d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 -- 172.21.15.77:0/4036287102 >> 172.21.15.77:0/4036287102 conn(0x7fdd8008ec10 msgr2=0x7fdd8009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 -- 172.21.15.77:0/4036287102 shutdown_connections 2024-05-15T12:09:53.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.231+0000 7fdd84f24640 1 -- 172.21.15.77:0/4036287102 wait complete. 2024-05-15T12:09:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.232+0000 7fdd84f24640 1 Processor -- start 2024-05-15T12:09:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.232+0000 7fdd84f24640 1 -- start start 2024-05-15T12:09:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd84f24640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd800d0060 0x7fdd800ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd84f24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 0x7fdd800b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd84f24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f840 0x7fdd800b8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd84f24640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800b4b80 con 0x7fdd8015f460 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd84f24640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdd800b4a00 con 0x7fdd800d0060 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd84f24640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fdd800b4d00 con 0x7fdd8015f840 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 0x7fdd800b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 0x7fdd800b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56122/0 (socket says 172.21.15.77:56122) 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/2482374400 learned_addr learned my addr 172.21.15.77:0/2482374400 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7ed9d640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f840 0x7fdd800b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f840 msgr2=0x7fdd800b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f840 0x7fdd800b8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd800d0060 msgr2=0x7fdd800ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7e59c640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd800d0060 0x7fdd800ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd800d0060 0x7fdd800ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 -- 172.21.15.77:0/2482374400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd800b89c0 con 0x7fdd8015f460 2024-05-15T12:09:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.233+0000 7fdd7dd9b640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 0x7fdd800b7f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009870 tx=0x7fdd740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.234+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74041020 con 0x7fdd8015f460 2024-05-15T12:09:53.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.234+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd800b9e10 con 0x7fdd8015f460 2024-05-15T12:09:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.234+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd74030970 con 0x7fdd8015f460 2024-05-15T12:09:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.234+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd74037040 con 0x7fdd8015f460 2024-05-15T12:09:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.234+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd800ba370 con 0x7fdd8015f460 2024-05-15T12:09:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.235+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8006a640 con 0x7fdd8015f460 2024-05-15T12:09:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.235+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdd74044020 con 0x7fdd8015f460 2024-05-15T12:09:53.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.236+0000 7fdd6effd640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdd600762d0 0x7fdd60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.236+0000 7fdd7e59c640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdd600762d0 0x7fdd60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.236+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdd740b7c40 con 0x7fdd8015f460 2024-05-15T12:09:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.236+0000 7fdd7e59c640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdd600762d0 0x7fdd60078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006fd0 tx=0x7fdd70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.240+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdd7404b070 con 0x7fdd8015f460 2024-05-15T12:09:53.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.423+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd800d3510 con 0x7fdd8015f460 2024-05-15T12:09:53.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.424+0000 7fdd6effd640 1 -- 172.21.15.77:0/2482374400 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7fdd800b9e10 con 0x7fdd8015f460 2024-05-15T12:09:53.419 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:53.419 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:53.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdd600762d0 msgr2=0x7fdd60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdd600762d0 0x7fdd60078790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd70006fd0 tx=0x7fdd70008040 comp rx=0 tx=0).stop 2024-05-15T12:09:53.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 msgr2=0x7fdd800b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 0x7fdd800b7f40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009870 tx=0x7fdd740046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 shutdown_connections 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdd600762d0 0x7fdd60078790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdd8015f840 0x7fdd800b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd8015f460 0x7fdd800b7f40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.426+0000 7fdd84f24640 1 --2- 172.21.15.77:0/2482374400 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdd800d0060 0x7fdd800ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.427+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 >> 172.21.15.77:0/2482374400 conn(0x7fdd8008ec10 msgr2=0x7fdd800b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.427+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 shutdown_connections 2024-05-15T12:09:53.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.427+0000 7fdd84f24640 1 -- 172.21.15.77:0/2482374400 wait complete. 2024-05-15T12:09:53.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-15T12:09:53.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-15T12:09:53.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-15T12:09:53.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-15T12:09:53.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-15T12:09:53.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-15T12:09:53.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-15T12:09:53.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-15T12:09:53.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.610+0000 7fdc7b354640 1 Processor -- start 2024-05-15T12:09:53.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.610+0000 7fdc7b354640 1 -- start start 2024-05-15T12:09:53.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.610+0000 7fc3bcada640 1 Processor -- start 2024-05-15T12:09:53.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.610+0000 7fc3bcada640 1 -- start start 2024-05-15T12:09:53.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.610+0000 7fedb6940640 1 Processor -- start 2024-05-15T12:09:53.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.610+0000 7fedb6940640 1 -- start start 2024-05-15T12:09:53.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fcf8759e640 1 Processor -- start 2024-05-15T12:09:53.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fdc7b354640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc6c03a2c0 0x7fdc6c009de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fcf8759e640 1 -- start start 2024-05-15T12:09:53.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fdc7b354640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c055ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fdc7b354640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc6c054c40 con 0x7fdc6c0e12f0 2024-05-15T12:09:53.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fdc7b354640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fdc6c03a730 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fdc7b354640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fdc6c055850 con 0x7fdc6c00a320 2024-05-15T12:09:53.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fdc79b51640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc6c03a2c0 0x7fdc6c009de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fc3bcada640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3b80b4ac0 0x7fc3b80735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc79b51640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc6c03a2c0 0x7fdc6c009de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56124/0 (socket says 172.21.15.77:56124) 2024-05-15T12:09:53.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc79b51640 1 -- 172.21.15.77:0/4155968113 learned_addr learned my addr 172.21.15.77:0/4155968113 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4155968113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c055ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7f962f59e640 1 Processor -- start 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7f962f59e640 1 -- start start 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fc3bcada640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3b806cf10 0x7fc3b81449a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fc3bcada640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b8072b10 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fc3bcada640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b80b4f60 con 0x7fc3b806cf10 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.611+0000 7fc3bcada640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc3b8072df0 con 0x7fc3b80b4ac0 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3b80b4ac0 0x7fc3b80735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc3b80b4ac0 0x7fc3b80735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47516/0 (socket says 172.21.15.77:47516) 2024-05-15T12:09:53.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 -- 172.21.15.77:0/1306950667 learned_addr learned my addr 172.21.15.77:0/1306950667 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc7ab53640 1 -- 172.21.15.77:0/4155968113 >> v2:172.21.15.77:3300/0 conn(0x7fdc6c03a2c0 msgr2=0x7fdc6c009de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7eff77990640 1 Processor -- start 2024-05-15T12:09:53.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f962f59e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 0x7f96300add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedb6940640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7feda8048100 0x7feda8006f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedb6940640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda8005f10 con 0x7feda80074b0 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedb6940640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda8053280 con 0x7feda8054560 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedb6940640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7feda80e7b90 con 0x7feda8048100 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedb4edd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7feda8054560 0x7feda804f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37150/0 (socket says 172.21.15.77:37150) 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedaf7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7feda80074b0 0x7feda8053e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44286/0 (socket says 172.21.15.77:44286) 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fedaf7fe640 1 -- 172.21.15.77:0/2403508533 learned_addr learned my addr 172.21.15.77:0/2403508533 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758830779 0 0) 0x7feda8005f10 con 0x7feda80074b0 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda0003520 con 0x7feda80074b0 2024-05-15T12:09:53.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3887733315 0 0) 0x7feda0003520 con 0x7feda80074b0 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 >> v2:172.21.15.83:3300/0 conn(0x7feda8048100 msgr2=0x7feda8006f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 --2- 172.21.15.77:0/2403508533 >> v2:172.21.15.83:3300/0 conn(0x7feda8048100 0x7feda8006f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 >> v1:172.21.15.83:6789/0 conn(0x7feda8054560 legacy=0x7feda804f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda80061b0 con 0x7feda80074b0 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7feda40016f0 con 0x7feda80074b0 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 >> v1:172.21.15.77:6789/0 conn(0x7feda80074b0 legacy=0x7feda8053e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda00039b0 0x7feda0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda0004800 0x7feda0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda00051c0 0x7feda001c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feda80e7b90 con 0x7feda0004800 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feda001d070 con 0x7feda00051c0 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7feda001d270 con 0x7feda00039b0 2024-05-15T12:09:53.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaf7fe640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda0004800 0x7feda0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4155968113 >> v2:172.21.15.77:3300/0 conn(0x7fdc6c03a2c0 0x7fdc6c009de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc7ab53640 1 -- 172.21.15.77:0/4155968113 >> v1:172.21.15.83:6789/0 conn(0x7fdc6c0e12f0 legacy=0x7fdc6c0e5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fdc7ab53640 1 -- 172.21.15.77:0/4155968113 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c054f20 con 0x7fdc6c00a320 2024-05-15T12:09:53.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fcf8659c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcf88144ae0 0x7fcf88072040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44304/0 (socket says 172.21.15.77:44304) 2024-05-15T12:09:53.613 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fa771195640 1 Processor -- start 2024-05-15T12:09:53.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f962f59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96300b5760 0x7f9630072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f962f59e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9630072da0 con 0x7f9630072660 2024-05-15T12:09:53.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f962f59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f963006ddc0 con 0x7f96300b5760 2024-05-15T12:09:53.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f962f59e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f963006e660 con 0x7f963015b190 2024-05-15T12:09:53.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedb4edd640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda00051c0 0x7feda001c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fcf8659c640 1 -- 172.21.15.77:0/2641690588 learned_addr learned my addr 172.21.15.77:0/2641690588 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fcf8759e640 1 --2- 172.21.15.77:0/2641690588 >> v2:172.21.15.77:3300/0 conn(0x7fcf8815c350 0x7fcf880d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fcf8759e640 1 --2- 172.21.15.77:0/2641690588 >> v2:172.21.15.83:3300/0 conn(0x7fcf880d1690 0x7fcf8815d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b5d9b640 1 --2- 172.21.15.77:0/1306950667 >> v2:172.21.15.77:3300/0 conn(0x7fc3b806cf10 0x7fc3b81449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 -- 172.21.15.77:0/1306950667 >> v2:172.21.15.77:3300/0 conn(0x7fc3b806cf10 msgr2=0x7fc3b81449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 --2- 172.21.15.77:0/1306950667 >> v2:172.21.15.77:3300/0 conn(0x7fc3b806cf10 0x7fc3b81449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 -- 172.21.15.77:0/1306950667 >> v1:172.21.15.77:6789/0 conn(0x7fc3b80b2fa0 legacy=0x7fc3b815c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fc3b659c640 1 -- 172.21.15.77:0/1306950667 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b80730d0 con 0x7fc3b80b4ac0 2024-05-15T12:09:53.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f7c1f413640 1 Processor -- start 2024-05-15T12:09:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4155968113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c055ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdc74065f70 tx=0x7fdc740a6490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1da1ab0ecb447f62 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fedaffff640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda00039b0 0x7feda0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7f962e59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 0x7f96300add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7f962e59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 0x7f96300add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57728/0 (socket says 172.21.15.77:57728) 2024-05-15T12:09:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7f962e59c640 1 -- 172.21.15.77:0/3703151749 learned_addr learned my addr 172.21.15.77:0/3703151749 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.612+0000 7fa771195640 1 -- start start 2024-05-15T12:09:53.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.613+0000 7fc3b659c640 1 --2- 172.21.15.77:0/1306950667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 0x7fc3b80735f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80b3be0 tx=0x7fc3a802e840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88bdccdf26b5ad44 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf85d9b640 1 --2- 172.21.15.77:0/2641690588 >> v2:172.21.15.77:3300/0 conn(0x7fcf8815c350 0x7fcf880d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedaf7fe640 1 -- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda00039b0 msgr2=0x7feda0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedaf7fe640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda00039b0 0x7feda0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedaf7fe640 1 -- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda00051c0 msgr2=0x7feda001c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedaf7fe640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda00051c0 0x7feda001c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedaf7fe640 1 -- 172.21.15.77:0/2403508533 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda0003520 con 0x7feda0004800 2024-05-15T12:09:53.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedb4edd640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda00051c0 0x7feda001c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf86d9d640 1 --2- 172.21.15.77:0/2641690588 >> v2:172.21.15.83:3300/0 conn(0x7fcf880d1690 0x7fcf8815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf880d1a70 con 0x7fcf88144ae0 2024-05-15T12:09:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcf8815cc00 con 0x7fcf8815c350 2024-05-15T12:09:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fcf88072850 con 0x7fcf880d1690 2024-05-15T12:09:53.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa771195640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa76c1634f0 0x7fa76c073e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa771195640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa76c167170 0x7fa76c1675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa771195640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c0b5c40 con 0x7fa76c167b10 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa771195640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa76c074380 con 0x7fa76c167170 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa771195640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fa76c06ddc0 con 0x7fa76c1634f0 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7f962e59c640 1 -- 172.21.15.77:0/3703151749 >> v2:172.21.15.77:3300/0 conn(0x7f96300b5760 msgr2=0x7f9630072120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7f962e59c640 1 --2- 172.21.15.77:0/3703151749 >> v2:172.21.15.77:3300/0 conn(0x7f96300b5760 0x7f9630072120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7f962e59c640 1 -- 172.21.15.77:0/3703151749 >> v1:172.21.15.77:6789/0 conn(0x7f9630072660 legacy=0x7f963006eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa76b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa76c167170 0x7fa76c1675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fdc79350640 1 -- 172.21.15.77:0/4155968113 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740b2070 con 0x7fdc6c00a320 2024-05-15T12:09:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fdc79350640 1 -- 172.21.15.77:0/4155968113 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc740ab7d0 con 0x7fdc6c00a320 2024-05-15T12:09:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fdc79350640 1 -- 172.21.15.77:0/4155968113 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740abc00 con 0x7fdc6c00a320 2024-05-15T12:09:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa76b7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa76c167170 0x7fa76c1675d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56138/0 (socket says 172.21.15.77:56138) 2024-05-15T12:09:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf86d9d640 1 -- 172.21.15.77:0/2641690588 >> v2:172.21.15.77:3300/0 conn(0x7fcf8815c350 msgr2=0x7fcf880d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf86d9d640 1 --2- 172.21.15.77:0/2641690588 >> v2:172.21.15.77:3300/0 conn(0x7fcf8815c350 0x7fcf880d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf86d9d640 1 -- 172.21.15.77:0/2641690588 >> v1:172.21.15.77:6789/0 conn(0x7fcf88144ae0 legacy=0x7fcf88072040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fcf86d9d640 1 -- 172.21.15.77:0/2641690588 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf88072b30 con 0x7fcf880d1690 2024-05-15T12:09:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa76b7fe640 1 -- 172.21.15.77:0/2252822289 learned_addr learned my addr 172.21.15.77:0/2252822289 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fa76bfff640 1 --2- 172.21.15.77:0/2252822289 >> v2:172.21.15.83:3300/0 conn(0x7fa76c1634f0 0x7fa76c073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fa76bfff640 1 -- 172.21.15.77:0/2252822289 >> v2:172.21.15.77:3300/0 conn(0x7fa76c167170 msgr2=0x7fa76c1675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fa76bfff640 1 --2- 172.21.15.77:0/2252822289 >> v2:172.21.15.77:3300/0 conn(0x7fa76c167170 0x7fa76c1675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fa76bfff640 1 -- 172.21.15.77:0/2252822289 >> v1:172.21.15.77:6789/0 conn(0x7fa76c167b10 legacy=0x7fa76c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7f962e59c640 1 -- 172.21.15.77:0/3703151749 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963015fbb0 con 0x7f963015b190 2024-05-15T12:09:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fa76affd640 1 -- 172.21.15.77:0/2252822289 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499488847 0 0) 0x7fa764001490 con 0x7fa76c167b10 2024-05-15T12:09:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fa76bfff640 1 -- 172.21.15.77:0/2252822289 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c167fa0 con 0x7fa76c1634f0 2024-05-15T12:09:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fc3b559a640 1 -- 172.21.15.77:0/1306950667 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a803d070 con 0x7fc3b80b4ac0 2024-05-15T12:09:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fc3b559a640 1 -- 172.21.15.77:0/1306950667 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3a8035670 con 0x7fc3b80b4ac0 2024-05-15T12:09:53.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fc3b559a640 1 -- 172.21.15.77:0/1306950667 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8035a80 con 0x7fc3b80b4ac0 2024-05-15T12:09:53.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 -- 172.21.15.77:0/1306950667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 msgr2=0x7fc3b80735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 --2- 172.21.15.77:0/1306950667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 0x7fc3b80735f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc3b80b3be0 tx=0x7fc3a802e840 comp rx=0 tx=0).stop 2024-05-15T12:09:53.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fdc7b354640 1 -- 172.21.15.77:0/4155968113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 msgr2=0x7fdc6c055ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fdc7b354640 1 --2- 172.21.15.77:0/4155968113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c055ce0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdc74065f70 tx=0x7fdc740a6490 comp rx=0 tx=0).stop 2024-05-15T12:09:53.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7eff77990640 1 -- start start 2024-05-15T12:09:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.614+0000 7fedb4edd640 1 -- 172.21.15.77:0/2403508533 reap_dead start 2024-05-15T12:09:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7eff77990640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff700b6180 0x7eff700cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7eff77990640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff700b2bb0 0x7eff700b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 -- 172.21.15.77:0/1306950667 shutdown_connections 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 --2- 172.21.15.77:0/1306950667 >> v2:172.21.15.77:3300/0 conn(0x7fc3b806cf10 0x7fc3b81449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 --2- 172.21.15.77:0/1306950667 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 0x7fc3b80735f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 -- 172.21.15.77:0/1306950667 >> 172.21.15.77:0/1306950667 conn(0x7fc3b806c3f0 msgr2=0x7fc3b806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fdc7b354640 1 -- 172.21.15.77:0/4155968113 shutdown_connections 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fdc7b354640 1 --2- 172.21.15.77:0/4155968113 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c055ce0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fdc7b354640 1 --2- 172.21.15.77:0/4155968113 >> v2:172.21.15.77:3300/0 conn(0x7fdc6c03a2c0 0x7fdc6c009de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fdc7b354640 1 -- 172.21.15.77:0/4155968113 >> 172.21.15.77:0/4155968113 conn(0x7fdc6c056cd0 msgr2=0x7fdc6c0570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fc3bcada640 1 -- 172.21.15.77:0/1306950667 shutdown_connections 2024-05-15T12:09:53.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7eff75f2d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff700b2bb0 0x7eff700b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7eff75f2d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff700b2bb0 0x7eff700b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56142/0 (socket says 172.21.15.77:56142) 2024-05-15T12:09:53.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7eff74f2b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7eff700b6180 0x7eff700cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7eff75f2d640 1 -- 172.21.15.77:0/1700036501 learned_addr learned my addr 172.21.15.77:0/1700036501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7fedaf7fe640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda0004800 0x7feda0004c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feda400c240 tx=0x7feda0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c012b34a972a488b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff7006ece0 con 0x7eff701636a0 2024-05-15T12:09:53.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7eff70072860 con 0x7eff700b2bb0 2024-05-15T12:09:53.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7eff7006efc0 con 0x7eff700b6180 2024-05-15T12:09:53.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fc3bcada640 1 -- 172.21.15.77:0/1306950667 wait complete. 2024-05-15T12:09:53.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.615+0000 7f7c1f413640 1 -- start start 2024-05-15T12:09:53.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7f962e59c640 1 --2- 172.21.15.77:0/3703151749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 0x7f96300add60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9620009870 tx=0x7f962002a150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5257c8beb945b0f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4007ce0 con 0x7feda0004800 2024-05-15T12:09:53.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda4005af0 con 0x7feda0004800 2024-05-15T12:09:53.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff75f2d640 1 -- 172.21.15.77:0/1700036501 >> v2:172.21.15.83:3300/0 conn(0x7eff700b6180 msgr2=0x7eff700cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff75f2d640 1 --2- 172.21.15.77:0/1700036501 >> v2:172.21.15.83:3300/0 conn(0x7eff700b6180 0x7eff700cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff75f2d640 1 -- 172.21.15.77:0/1700036501 >> v1:172.21.15.77:6789/0 conn(0x7eff701636a0 legacy=0x7eff7006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fedaeffd640 1 -- 172.21.15.77:0/2403508533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda4007070 con 0x7feda0004800 2024-05-15T12:09:53.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fdc7b354640 1 -- 172.21.15.77:0/4155968113 shutdown_connections 2024-05-15T12:09:53.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fdc7b354640 1 -- 172.21.15.77:0/4155968113 wait complete. 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7f962d59a640 1 -- 172.21.15.77:0/3703151749 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620037070 con 0x7f963015b190 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7f962d59a640 1 -- 172.21.15.77:0/3703151749 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9620032440 con 0x7f963015b190 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7eff75f2d640 1 -- 172.21.15.77:0/1700036501 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff7006f2a0 con 0x7eff700b2bb0 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fcf86d9d640 1 --2- 172.21.15.77:0/2641690588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf880d1690 0x7fcf8815d650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf88072750 tx=0x7fcf8002a7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9c6f965c526b95c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fcf8559a640 1 -- 172.21.15.77:0/2641690588 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80036070 con 0x7fcf880d1690 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fcf8559a640 1 -- 172.21.15.77:0/2641690588 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf80003b90 con 0x7fcf880d1690 2024-05-15T12:09:53.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.616+0000 7fcf8559a640 1 -- 172.21.15.77:0/2641690588 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000c040 con 0x7fcf880d1690 2024-05-15T12:09:53.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 -- 172.21.15.77:0/2403508533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda0004800 msgr2=0x7feda0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda0004800 0x7feda0004c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feda400c240 tx=0x7feda0005830 comp rx=0 tx=0).stop 2024-05-15T12:09:53.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fa76bfff640 1 --2- 172.21.15.77:0/2252822289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c073e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0b3870 tx=0x7fa76002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2af95321019c99eb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 -- 172.21.15.77:0/2403508533 shutdown_connections 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 --2- 172.21.15.77:0/2403508533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda0004800 0x7feda0004c80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 -- 172.21.15.77:0/2403508533 >> 172.21.15.77:0/2403508533 conn(0x7feda8009fe0 msgr2=0x7feda800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 -- 172.21.15.77:0/2403508533 shutdown_connections 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f962d59a640 1 -- 172.21.15.77:0/3703151749 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620032810 con 0x7f963015b190 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f962f59e640 1 -- 172.21.15.77:0/3703151749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 msgr2=0x7f96300add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f962f59e640 1 --2- 172.21.15.77:0/3703151749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 0x7f96300add60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9620009870 tx=0x7f962002a150 comp rx=0 tx=0).stop 2024-05-15T12:09:53.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fedb6940640 1 -- 172.21.15.77:0/2403508533 wait complete. 2024-05-15T12:09:53.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf880d1690 msgr2=0x7fcf8815d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7fcf8759e640 1 --2- 172.21.15.77:0/2641690588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf880d1690 0x7fcf8815d650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf88072750 tx=0x7fcf8002a7e0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f7c1f413640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c181608d0 0x7f7c18160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f7c1f413640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c180d19c0 0x7f7c180d1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f7c1f413640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c180d2cd0 con 0x7f7c180cfc00 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f7c1f413640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7c180d2fd0 con 0x7f7c180d19c0 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7f7c1f413640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7c180d2340 con 0x7f7c181608d0 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 shutdown_connections 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fcf8759e640 1 --2- 172.21.15.77:0/2641690588 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf880d1690 0x7fcf8815d650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fcf8759e640 1 --2- 172.21.15.77:0/2641690588 >> v2:172.21.15.77:3300/0 conn(0x7fcf8815c350 0x7fcf880d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 >> 172.21.15.77:0/2641690588 conn(0x7fcf8806c3f0 msgr2=0x7fcf8806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fc3bcada640 1 Processor -- start 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1dc10640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c180d19c0 0x7f7c180d1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1ec12640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7c180cfc00 0x7f7c180d0060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44332/0 (socket says 172.21.15.77:44332) 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1ec12640 1 -- 172.21.15.77:0/3533127340 learned_addr learned my addr 172.21.15.77:0/3533127340 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f962f59e640 1 -- 172.21.15.77:0/3703151749 shutdown_connections 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f962f59e640 1 --2- 172.21.15.77:0/3703151749 >> v2:172.21.15.77:3300/0 conn(0x7f96300b5760 0x7f9630072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f962f59e640 1 --2- 172.21.15.77:0/3703151749 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963015b190 0x7f96300add60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f962f59e640 1 -- 172.21.15.77:0/3703151749 >> 172.21.15.77:0/3703151749 conn(0x7f96300b2980 msgr2=0x7f96300b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.617+0000 7eff75f2d640 1 --2- 172.21.15.77:0/1700036501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff700b3040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff700b54e0 tx=0x7eff6002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61df4a440d8df04b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fa76affd640 1 -- 172.21.15.77:0/2252822289 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760037070 con 0x7fa76c1634f0 2024-05-15T12:09:53.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fdc7b354640 1 Processor -- start 2024-05-15T12:09:53.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fdc7b354640 1 -- start start 2024-05-15T12:09:53.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7eff67fff640 1 -- 172.21.15.77:0/1700036501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60037070 con 0x7eff700b2bb0 2024-05-15T12:09:53.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fa76affd640 1 -- 172.21.15.77:0/2252822289 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa760032440 con 0x7fa76c1634f0 2024-05-15T12:09:53.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1d40f640 1 -- 172.21.15.77:0/3533127340 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359854308 0 0) 0x7f7c180d2cd0 con 0x7f7c180cfc00 2024-05-15T12:09:53.640 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1d40f640 1 -- 172.21.15.77:0/3533127340 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c04003520 con 0x7f7c180cfc00 2024-05-15T12:09:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fa76affd640 1 -- 172.21.15.77:0/2252822289 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa760032810 con 0x7fa76c1634f0 2024-05-15T12:09:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7fc3bcada640 1 -- start start 2024-05-15T12:09:53.641 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1dc10640 1 -- 172.21.15.77:0/3533127340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c181608d0 msgr2=0x7f7c18160ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-15T12:09:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1dc10640 1 --2- 172.21.15.77:0/3533127340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c181608d0 0x7f7c18160ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1dc10640 1 -- 172.21.15.77:0/3533127340 >> v1:172.21.15.77:6789/0 conn(0x7f7c180cfc00 legacy=0x7f7c180d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f7c1dc10640 1 -- 172.21.15.77:0/3533127340 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c180d0770 con 0x7f7c180d19c0 2024-05-15T12:09:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7eff67fff640 1 -- 172.21.15.77:0/1700036501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff60032440 con 0x7eff700b2bb0 2024-05-15T12:09:53.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7eff67fff640 1 -- 172.21.15.77:0/1700036501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60032810 con 0x7eff700b2bb0 2024-05-15T12:09:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f962f59e640 1 -- 172.21.15.77:0/3703151749 shutdown_connections 2024-05-15T12:09:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.618+0000 7f962f59e640 1 -- 172.21.15.77:0/3703151749 wait complete. 2024-05-15T12:09:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3bcada640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3b806cf10 0x7fc3b8156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3bcada640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3b80b2fa0 0x7fc3b8152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 -- 172.21.15.77:0/2252822289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 msgr2=0x7fa76c073e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 --2- 172.21.15.77:0/2252822289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c073e40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa76c0b3870 tx=0x7fa76002a1a0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fedb6940640 1 Processor -- start 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 -- 172.21.15.77:0/2252822289 shutdown_connections 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 --2- 172.21.15.77:0/2252822289 >> v2:172.21.15.77:3300/0 conn(0x7fa76c167170 0x7fa76c1675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 --2- 172.21.15.77:0/2252822289 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c073e40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 -- 172.21.15.77:0/2252822289 >> 172.21.15.77:0/2252822289 conn(0x7fa76c0b2980 msgr2=0x7fa76c0b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3bcada640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 0x7fc3b81531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3b80b2fa0 0x7fc3b8152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3bcada640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b815d0e0 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 -- 172.21.15.77:0/2252822289 shutdown_connections 2024-05-15T12:09:53.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3b80b2fa0 0x7fc3b8152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56160/0 (socket says 172.21.15.77:56160) 2024-05-15T12:09:53.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 -- 172.21.15.77:0/543472427 learned_addr learned my addr 172.21.15.77:0/543472427 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3bcada640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8144ee0 con 0x7fc3b80b4ac0 2024-05-15T12:09:53.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3bcada640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc3b815d260 con 0x7fc3b806cf10 2024-05-15T12:09:53.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fa771195640 1 -- 172.21.15.77:0/2252822289 wait complete. 2024-05-15T12:09:53.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b6d9d640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 0x7fc3b81531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b659c640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3b806cf10 0x7fc3b8156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7b354640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c0dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7b354640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc6c03a2c0 0x7fdc6c04e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7b354640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc6c0e12f0 0x7fdc6c007e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7a352640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c0dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7a352640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c0dd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57744/0 (socket says 172.21.15.77:57744) 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7a352640 1 -- 172.21.15.77:0/4221875775 learned_addr learned my addr 172.21.15.77:0/4221875775 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc79b51640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc6c03a2c0 0x7fdc6c04e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 shutdown_connections 2024-05-15T12:09:53.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fcf8759e640 1 -- 172.21.15.77:0/2641690588 wait complete. 2024-05-15T12:09:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc6c0e12f0 0x7fdc6c007e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fdc7b354640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c0554e0 con 0x7fdc6c0e12f0 2024-05-15T12:09:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6c00a750 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fdc6c036100 con 0x7fdc6c00a320 2024-05-15T12:09:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fedb6940640 1 -- start start 2024-05-15T12:09:53.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 -- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3b806cf10 msgr2=0x7fc3b8156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3b806cf10 0x7fc3b8156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 -- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 msgr2=0x7fc3b81531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3b80b4ac0 0x7fc3b81531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.619+0000 7fc3b5d9b640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b8153a20 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fc3b5d9b640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3b80b2fa0 0x7fc3b8152ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0007ec0 tx=0x7fc3b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b001a070 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 msgr2=0x7eff700b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7eff77990640 1 --2- 172.21.15.77:0/1700036501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff700b3040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff700b54e0 tx=0x7eff6002a1f0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fc3bcada640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b8153d00 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3b0003b90 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7f962f59e640 1 Processor -- start 2024-05-15T12:09:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fc3bcada640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81542c0 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0004030 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7f962f59e640 1 -- start start 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 shutdown_connections 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7eff77990640 1 --2- 172.21.15.77:0/1700036501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff700b3040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7eff77990640 1 --2- 172.21.15.77:0/1700036501 >> v2:172.21.15.83:3300/0 conn(0x7eff700b6180 0x7eff700cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 >> 172.21.15.77:0/1700036501 conn(0x7eff7006c3f0 msgr2=0x7eff7006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fedb6940640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda0004800 0x7feda8033bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb6940640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda80e7f80 0x7feda80d8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb6940640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda80e8400 0x7feda80d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb6940640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feda8006770 con 0x7feda80e8400 2024-05-15T12:09:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb6940640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7feda8006ae0 con 0x7feda0004800 2024-05-15T12:09:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb6940640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7feda8006f70 con 0x7feda80e7f80 2024-05-15T12:09:53.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fa771195640 1 Processor -- start 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc79b51640 1 -- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 msgr2=0x7fdc6c0dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc79b51640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c0dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc79b51640 1 -- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc6c0e12f0 msgr2=0x7fdc6c007e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc79b51640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc6c0e12f0 0x7fdc6c007e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc79b51640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6c04c8d0 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.620+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc6c0e12f0 0x7fdc6c007e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc7a352640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fdc6c00a320 0x7fdc6c0dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc79b51640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc6c03a2c0 0x7fdc6c04e4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000e870 tx=0x7fdc7000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fa771195640 1 -- start start 2024-05-15T12:09:53.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda80e8400 0x7feda80d92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda80e8400 0x7feda80d92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56178/0 (socket says 172.21.15.77:56178) 2024-05-15T12:09:53.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 -- 172.21.15.77:0/4070154082 learned_addr learned my addr 172.21.15.77:0/4070154082 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70017070 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6c04cb70 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc6c04d130 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 -- 172.21.15.77:0/4070154082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda80e7f80 msgr2=0x7feda80d8d60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T12:09:53.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7feda80e7f80 0x7feda80d8d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 -- 172.21.15.77:0/4070154082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda0004800 msgr2=0x7feda8033bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T12:09:53.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7feda0004800 0x7feda8033bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fedb4edd640 1 -- 172.21.15.77:0/4070154082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda804a110 con 0x7feda80e8400 2024-05-15T12:09:53.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fc3bcada640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3b8154690 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 shutdown_connections 2024-05-15T12:09:53.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fcf8759e640 1 Processor -- start 2024-05-15T12:09:53.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962f59e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9630072660 0x7f9630154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962f59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300b5760 0x7f963009cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fcf8759e640 1 -- start start 2024-05-15T12:09:53.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962f59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963015b190 0x7f963009d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962f59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96300d0930 con 0x7f963015b190 2024-05-15T12:09:53.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962f59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f963006e2f0 con 0x7f96300b5760 2024-05-15T12:09:53.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962f59e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f963015f810 con 0x7f9630072660 2024-05-15T12:09:53.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7000ee60 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.621+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7000cb40 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fa771195640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c1fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fa771195640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76c167170 0x7fa76c156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fa771195640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c167b10 0x7fa76c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fa771195640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0b5530 con 0x7fa76c167170 2024-05-15T12:09:53.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fa771195640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0b5250 con 0x7fa76c1634f0 2024-05-15T12:09:53.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fa771195640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c1638d0 con 0x7fa76c167b10 2024-05-15T12:09:53.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7eff77990640 1 -- 172.21.15.77:0/1700036501 wait complete. 2024-05-15T12:09:53.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c1fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c1fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47584/0 (socket says 172.21.15.77:47584) 2024-05-15T12:09:53.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fa76bfff640 1 -- 172.21.15.77:0/512733206 learned_addr learned my addr 172.21.15.77:0/512733206 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f7c1dc10640 1 --2- 172.21.15.77:0/3533127340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180d1e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c080097a0 tx=0x7f7c0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4572cab5d16e55 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fa770994640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c167b10 0x7fa76c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc5c001030 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fa76b7fe640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76c167170 0x7fa76c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f7c1d40f640 1 -- 172.21.15.77:0/3533127340 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08037070 con 0x7f7c180d19c0 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963015b190 0x7f963009d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962ed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963015b190 0x7f963009d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56190/0 (socket says 172.21.15.77:56190) 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7f962ed9d640 1 -- 172.21.15.77:0/2996605634 learned_addr learned my addr 172.21.15.77:0/2996605634 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f962dd9b640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300b5760 0x7f963009cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f962ed9d640 1 -- 172.21.15.77:0/2996605634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9630072660 msgr2=0x7f9630154590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f962ed9d640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9630072660 0x7f9630154590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f962ed9d640 1 -- 172.21.15.77:0/2996605634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300b5760 msgr2=0x7f963009cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f962ed9d640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300b5760 0x7f963009cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f962ed9d640 1 -- 172.21.15.77:0/2996605634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963009d860 con 0x7f963015b190 2024-05-15T12:09:53.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fcf8759e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880d1690 0x7fcf881373a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f7c1d40f640 1 -- 172.21.15.77:0/3533127340 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c08032440 con 0x7f7c180d19c0 2024-05-15T12:09:53.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fcf8759e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf88144ae0 0x7fcf880b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.622+0000 7fedb4edd640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda80e8400 0x7feda80d92a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedb00752a0 tx=0x7fedb0074530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7f7c1d40f640 1 -- 172.21.15.77:0/3533127340 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08032810 con 0x7f7c180d19c0 2024-05-15T12:09:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fcf8659c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880d1690 0x7fcf881373a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf8659c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880d1690 0x7fcf881373a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57780/0 (socket says 172.21.15.77:57780) 2024-05-15T12:09:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf8659c640 1 -- 172.21.15.77:0/1231943150 learned_addr learned my addr 172.21.15.77:0/1231943150 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf8759e640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf8815c350 0x7fcf880b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb00516d0 con 0x7feda80e8400 2024-05-15T12:09:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedb0069ed0 con 0x7feda80e8400 2024-05-15T12:09:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedb006c5f0 con 0x7feda80e8400 2024-05-15T12:09:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.623+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3b001d070 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fa76b7fe640 1 -- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c167b10 msgr2=0x7fa76c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fa76b7fe640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa76c167b10 0x7fa76c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fa76b7fe640 1 -- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 msgr2=0x7fa76c1fd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fa76b7fe640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa76c1634f0 0x7fa76c1fd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fa76b7fe640 1 -- 172.21.15.77:0/512733206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c15c210 con 0x7fa76c167170 2024-05-15T12:09:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7f962ed9d640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963015b190 0x7f963009d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f962800c780 tx=0x7f962800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda804a3f0 con 0x7feda80e8400 2024-05-15T12:09:53.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda804a9b0 con 0x7feda80e8400 2024-05-15T12:09:53.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fa76b7fe640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76c167170 0x7fa76c156680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e850 tx=0x7fa75c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7eff77990640 1 Processor -- start 2024-05-15T12:09:53.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fc3a6ffd640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3980763a0 0x7fc398078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7eff77990640 1 -- start start 2024-05-15T12:09:53.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fc3b659c640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3980763a0 0x7fc398078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc7001a070 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628004b10 con 0x7f963015b190 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3b00977f0 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fc3a6ffd640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7fc39807e5c0 0x7fc3980809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3b0013e50 con 0x7fc39807e5c0 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc3b009e050 con 0x7fc3b80b2fa0 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf85d9b640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf88144ae0 0x7fcf880b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8806cf10 con 0x7fcf88144ae0 2024-05-15T12:09:53.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8815d130 con 0x7fcf8815c350 2024-05-15T12:09:53.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.624+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8806d090 con 0x7fcf880d1690 2024-05-15T12:09:53.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f963009bbd0 con 0x7f963015b190 2024-05-15T12:09:53.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9628004cb0 con 0x7f963015b190 2024-05-15T12:09:53.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fc3b659c640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3980763a0 0x7fc398078860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3a803a000 tx=0x7fc3a800f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fc3b6d9d640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7fc39807e5c0 0x7fc3980809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7eff77990640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff701667a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7eff77990640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff700b6180 0x7eff7014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7eff77990640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff701636a0 0x7eff700cec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7eff77990640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff70072cf0 con 0x7eff700b2bb0 2024-05-15T12:09:53.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fdc6affd640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdc580763d0 0x7fdc58078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdc70097320 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fdc7a352640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdc580763d0 0x7fdc58078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fdc6affd640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7fdc5807e5f0 0x7fdc58080a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc70008eb0 con 0x7fdc5807e5f0 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fdc7009e050 con 0x7fdc6c03a2c0 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7eff77990640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7eff70163a80 con 0x7eff701636a0 2024-05-15T12:09:53.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7eff77990640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7eff70072e70 con 0x7eff700b6180 2024-05-15T12:09:53.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c017070 con 0x7fa76c167170 2024-05-15T12:09:53.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c00c940 con 0x7fa76c167170 2024-05-15T12:09:53.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00ccf0 con 0x7fa76c167170 2024-05-15T12:09:53.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c15c4f0 con 0x7fa76c167170 2024-05-15T12:09:53.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c15cab0 con 0x7fa76c167170 2024-05-15T12:09:53.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fc3b6d9d640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7fc39807e5c0 0x7fc3980809e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962800aa90 con 0x7f963015b190 2024-05-15T12:09:53.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7eff75f2d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff701636a0 0x7eff700cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7eff75f2d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff701636a0 0x7eff700cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47618/0 (socket says 172.21.15.77:47618) 2024-05-15T12:09:53.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7eff75f2d640 1 -- 172.21.15.77:0/3024193420 learned_addr learned my addr 172.21.15.77:0/3024193420 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f963009c190 con 0x7f963015b190 2024-05-15T12:09:53.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7eff7572c640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff701667a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fedb006c790 con 0x7feda80e8400 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff75f2d640 1 -- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff700b6180 msgr2=0x7eff7014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff74f2b640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff700b6180 0x7eff7014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff75f2d640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff700b6180 0x7eff7014d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff75f2d640 1 -- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 msgr2=0x7eff701667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff75f2d640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff701667a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff75f2d640 1 -- 172.21.15.77:0/3024193420 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff70165700 con 0x7eff701636a0 2024-05-15T12:09:53.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa76c076760 con 0x7fa76c167170 2024-05-15T12:09:53.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7f7c1f413640 1 -- 172.21.15.77:0/3533127340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 msgr2=0x7f7c180d1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7f7c1f413640 1 --2- 172.21.15.77:0/3533127340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180d1e00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7c080097a0 tx=0x7f7c0802a1a0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== osd.6 v2:172.21.15.83:6809/151067659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3b0013e50 con 0x7fc39807e5c0 2024-05-15T12:09:53.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7fedacff9640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed940763a0 0x7fed94078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff74f2b640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7eff700b6180 0x7eff7014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:53.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff75f2d640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff701636a0 0x7eff700cec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff60009960 tx=0x7eff600046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff7572c640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff700b2bb0 0x7eff701667a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:53.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.625+0000 7fcf86d9d640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf8815c350 0x7fcf880b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fedb0112310 con 0x7feda80e8400 2024-05-15T12:09:53.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.626+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7fdc5807e5f0 0x7fdc58080a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7fdc7ab53640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7fdc5807e5f0 0x7fdc58080a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== osd.2 v2:172.21.15.77:6808/606387833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc70008eb0 con 0x7fdc5807e5f0 2024-05-15T12:09:53.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fdc7a352640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdc580763d0 0x7fdc58078890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc64001a70 tx=0x7fdc64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff60037040 con 0x7eff701636a0 2024-05-15T12:09:53.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff60042070 con 0x7eff701636a0 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff6003d820 con 0x7eff701636a0 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.627+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff701659e0 con 0x7eff701636a0 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff70165fa0 con 0x7eff701636a0 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fcf85d9b640 1 -- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880d1690 msgr2=0x7fcf881373a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fcf85d9b640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcf880d1690 0x7fcf881373a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fcf85d9b640 1 -- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf8815c350 msgr2=0x7fcf880b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fcf85d9b640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcf8815c350 0x7fcf880b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fcf85d9b640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8809ba30 con 0x7fcf88144ae0 2024-05-15T12:09:53.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7f7c1f413640 1 -- 172.21.15.77:0/3533127340 shutdown_connections 2024-05-15T12:09:53.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7f7c1f413640 1 --2- 172.21.15.77:0/3533127340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180d1e00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7f7c1f413640 1 --2- 172.21.15.77:0/3533127340 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c181608d0 0x7f7c18160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7f7c1f413640 1 -- 172.21.15.77:0/3533127340 >> 172.21.15.77:0/3533127340 conn(0x7f7c1809e2d0 msgr2=0x7f7c180d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fedb6940640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fed90001650 0x7fed90003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fedaffff640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed940763a0 0x7fed94078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 --> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fed90006bb0 con 0x7fed90001650 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fedaf7fe640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fed90001650 0x7fed90003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.628+0000 7fedaffff640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed940763a0 0x7fed94078860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0098a0 tx=0x7fed9c006ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fedaf7fe640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fed90001650 0x7fed90003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fcf85d9b640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf88144ae0 0x7fcf880b4a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00ea00 tx=0x7fcf7c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00de00 con 0x7fcf88144ae0 2024-05-15T12:09:53.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f962800ac30 con 0x7f963015b190 2024-05-15T12:09:53.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c010440 con 0x7fcf88144ae0 2024-05-15T12:09:53.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c010830 con 0x7fcf88144ae0 2024-05-15T12:09:53.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8809bd10 con 0x7fcf88144ae0 2024-05-15T12:09:53.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f963009c590 con 0x7f963015b190 2024-05-15T12:09:53.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7f7c1f413640 1 -- 172.21.15.77:0/3533127340 shutdown_connections 2024-05-15T12:09:53.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7eff700768e0 con 0x7eff701636a0 2024-05-15T12:09:53.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf881378e0 con 0x7fcf88144ae0 2024-05-15T12:09:53.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.629+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa75c01a070 con 0x7fa76c167170 2024-05-15T12:09:53.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7f9626ffd640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96100763a0 0x7f9610078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== osd.1 v2:172.21.15.77:6809/1670577123 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fed90006bb0 con 0x7fed90001650 2024-05-15T12:09:53.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fa768ff9640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa7580763a0 0x7fa758078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa75c097c20 con 0x7fa76c167170 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fa768ff9640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7fa75807e5c0 0x7fa7580809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 --> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa75c01fe70 con 0x7fa75807e5c0 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa75c098010 con 0x7fa76c167170 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7fa76bfff640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa7580763a0 0x7fa758078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.630+0000 7f7c1f413640 1 -- 172.21.15.77:0/3533127340 wait complete. 2024-05-15T12:09:53.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf880cd9d0 con 0x7fcf88144ae0 2024-05-15T12:09:53.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.631+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7eff6003d9c0 con 0x7eff701636a0 2024-05-15T12:09:53.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.631+0000 7eff65ffb640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7eff540763a0 0x7eff54078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff600b8b90 con 0x7eff701636a0 2024-05-15T12:09:53.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7eff65ffb640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7eff5407e5c0 0x7eff540809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9628096da0 con 0x7f963015b190 2024-05-15T12:09:53.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 --> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff54081090 con 0x7eff5407e5c0 2024-05-15T12:09:53.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7eff600b8f80 con 0x7eff701636a0 2024-05-15T12:09:53.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7f9626ffd640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7f961007e5c0 0x7f96100809e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 --> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f962800ee50 con 0x7f961007e5c0 2024-05-15T12:09:53.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f962809c060 con 0x7f963015b190 2024-05-15T12:09:53.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7eff74f2b640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7eff5407e5c0 0x7eff540809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7fa770994640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7fa75807e5c0 0x7fa7580809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7f962dd9b640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7f961007e5c0 0x7f96100809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7f962e59c640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96100763a0 0x7f9610078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7f7c1f413640 1 Processor -- start 2024-05-15T12:09:53.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fa76bfff640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa7580763a0 0x7fa758078860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa760009560 tx=0x7fa76002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7f962dd9b640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7f961007e5c0 0x7f96100809e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7f7c1f413640 1 -- start start 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7eff74f2b640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7eff5407e5c0 0x7eff540809e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7eff7572c640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7eff540763a0 0x7eff54078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.632+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf7c0109d0 con 0x7fcf88144ae0 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fcf76ffd640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcf680762d0 0x7fcf68078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcf7c097e30 con 0x7fcf88144ae0 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fcf8659c640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcf680762d0 0x7fcf68078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fcf76ffd640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7fcf6807e4f0 0x7fcf68080910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf7c008e50 con 0x7fcf6807e4f0 2024-05-15T12:09:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcf7c09a490 con 0x7fcf88144ae0 2024-05-15T12:09:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.634+0000 7fcf86d9d640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7fcf6807e4f0 0x7fcf68080910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.633+0000 7f962e59c640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96100763a0 0x7f9610078860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9620034000 tx=0x7f962002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.634+0000 7eff7572c640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7eff540763a0 0x7eff54078860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff6c007fd0 tx=0x7eff6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.634+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== osd.3 v2:172.21.15.77:6824/2819431659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff54081090 con 0x7eff5407e5c0 2024-05-15T12:09:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.634+0000 7f7c1f413640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c180cfc00 0x7f7c180b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7fcf8659c640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcf680762d0 0x7fcf68078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf78000f60 tx=0x7fcf78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1f413640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180ba050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7fcf86d9d640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7fcf6807e4f0 0x7fcf68080910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== osd.0 v2:172.21.15.77:6800/3927618642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f962800ee50 con 0x7f961007e5c0 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1e411640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c180cfc00 0x7f7c180b9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1e411640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c180cfc00 0x7f7c180b9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57806/0 (socket says 172.21.15.77:57806) 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1e411640 1 -- 172.21.15.77:0/3777218043 learned_addr learned my addr 172.21.15.77:0/3777218043 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1dc10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180ba050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1f413640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c181608d0 0x7f7c180ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7c180d0cd0 con 0x7f7c180d19c0 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7c180d09f0 con 0x7f7c181608d0 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7c180d0fb0 con 0x7f7c180cfc00 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.635+0000 7f7c1ec12640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c181608d0 0x7f7c180ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== osd.4 v2:172.21.15.83:6800/675760629 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf7c008e50 con 0x7fcf6807e4f0 2024-05-15T12:09:53.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7fa770994640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7fa75807e5c0 0x7fa7580809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7f7c1dc10640 1 -- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c180cfc00 msgr2=0x7f7c180b9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7f7c1dc10640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7c180cfc00 0x7f7c180b9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7f7c1dc10640 1 -- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c181608d0 msgr2=0x7f7c180ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7f7c1dc10640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7c181608d0 0x7f7c180ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.636+0000 7f7c1dc10640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c180ba6f0 con 0x7f7c180d19c0 2024-05-15T12:09:53.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.637+0000 7f7c1dc10640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180ba050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c08031000 tx=0x7f7c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.637+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== osd.5 v2:172.21.15.83:6808/2185384150 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa75c01fe70 con 0x7fa75807e5c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.637+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08037050 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.637+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c08038040 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.637+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c08037050 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.637+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c180ba9d0 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.640+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7c08045020 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.641+0000 7f7c0effd640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7bfc0766d0 0x7f7bfc078b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.641+0000 7f7c1e411640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7bfc0766d0 0x7f7bfc078b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.642+0000 7f7c1e411640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7bfc0766d0 0x7f7bfc078b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c10007370 tx=0x7f7c100095b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.642+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c181f68f0 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.642+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7c08043020 con 0x7f7c180d19c0 2024-05-15T12:09:53.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.644+0000 7f7c1f413640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f7c180b5820 0x7f7c180d4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.644+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c180cf120 con 0x7f7c180b5820 2024-05-15T12:09:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.644+0000 7f7c1ec12640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f7c180b5820 0x7f7c180d4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.647+0000 7f7c1ec12640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f7c180b5820 0x7f7c180d4ff0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.648+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== osd.7 v2:172.21.15.83:6824/3871315040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c180cf120 con 0x7f7c180b5820 2024-05-15T12:09:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.659+0000 7fc3bcada640 1 -- 172.21.15.77:0/543472427 --> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3b80768e0 con 0x7fc39807e5c0 2024-05-15T12:09:53.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.660+0000 7fc3a6ffd640 1 -- 172.21.15.77:0/543472427 <== osd.6 v2:172.21.15.83:6809/151067659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3b80768e0 con 0x7fc39807e5c0 2024-05-15T12:09:53.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.660+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7fc39807e5c0 msgr2=0x7fc3980809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7fc39807e5c0 0x7fc3980809e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3980763a0 msgr2=0x7fc398078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3980763a0 0x7fc398078860 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc3a803a000 tx=0x7fc3a800f040 comp rx=0 tx=0).stop 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3b80b2fa0 msgr2=0x7fc3b8152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 --2- 172.21.15.77:0/543472427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3b80b2fa0 0x7fc3b8152ca0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0007ec0 tx=0x7fc3b000e4b0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3b6d9d640 1 -- 172.21.15.77:0/543472427 reap_dead start 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 shutdown_connections 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 >> 172.21.15.77:0/543472427 conn(0x7fc3b806c3f0 msgr2=0x7fc3b813fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 --> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc5c002dd0 con 0x7fdc5807e5f0 2024-05-15T12:09:53.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.661+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 --> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fed90005c40 con 0x7fed90001650 2024-05-15T12:09:53.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.662+0000 7fdc6affd640 1 -- 172.21.15.77:0/4221875775 <== osd.2 v2:172.21.15.77:6808/606387833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc5c002dd0 con 0x7fdc5807e5f0 2024-05-15T12:09:53.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.662+0000 7fedacff9640 1 -- 172.21.15.77:0/4070154082 <== osd.1 v2:172.21.15.77:6809/1670577123 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fed90005c40 con 0x7fed90001650 2024-05-15T12:09:53.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.662+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 shutdown_connections 2024-05-15T12:09:53.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.662+0000 7fc3a4ff9640 1 -- 172.21.15.77:0/543472427 wait complete. 2024-05-15T12:09:53.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.662+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7fdc5807e5f0 msgr2=0x7fdc58080a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.662+0000 7fdc7b354640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7fdc5807e5f0 0x7fdc58080a10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fed90001650 msgr2=0x7fed90003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb6940640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fed90001650 0x7fed90003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdc580763d0 msgr2=0x7fdc58078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fdc580763d0 0x7fdc58078890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdc64001a70 tx=0x7fdc64009040 comp rx=0 tx=0).stop 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc6c03a2c0 msgr2=0x7fdc6c04e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 --2- 172.21.15.77:0/4221875775 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fdc6c03a2c0 0x7fdc6c04e4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000e870 tx=0x7fdc7000ed30 comp rx=0 tx=0).stop 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7ab53640 1 -- 172.21.15.77:0/4221875775 reap_dead start 2024-05-15T12:09:53.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 shutdown_connections 2024-05-15T12:09:53.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 >> 172.21.15.77:0/4221875775 conn(0x7fdc6c056cd0 msgr2=0x7fdc6c008b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed940763a0 msgr2=0x7fed94078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 shutdown_connections 2024-05-15T12:09:53.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fdc7b354640 1 -- 172.21.15.77:0/4221875775 wait complete. 2024-05-15T12:09:53.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb6940640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fed940763a0 0x7fed94078860 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0098a0 tx=0x7fed9c006ee0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda80e8400 msgr2=0x7feda80d92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb6940640 1 --2- 172.21.15.77:0/4070154082 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feda80e8400 0x7feda80d92a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedb00752a0 tx=0x7fedb0074530 comp rx=0 tx=0).stop 2024-05-15T12:09:53.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.663+0000 7fedb4edd640 1 -- 172.21.15.77:0/4070154082 reap_dead start 2024-05-15T12:09:53.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.664+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 shutdown_connections 2024-05-15T12:09:53.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.664+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 >> 172.21.15.77:0/4070154082 conn(0x7feda8009fe0 msgr2=0x7feda8036530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.664+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 shutdown_connections 2024-05-15T12:09:53.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.664+0000 7fedb6940640 1 -- 172.21.15.77:0/4070154082 wait complete. 2024-05-15T12:09:53.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.665+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 --> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa76c073680 con 0x7fa75807e5c0 2024-05-15T12:09:53.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.665+0000 7fa768ff9640 1 -- 172.21.15.77:0/512733206 <== osd.5 v2:172.21.15.83:6808/2185384150 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa76c073680 con 0x7fa75807e5c0 2024-05-15T12:09:53.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.666+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 --> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf88076760 con 0x7fcf6807e4f0 2024-05-15T12:09:53.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.666+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7fa75807e5c0 msgr2=0x7fa7580809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.666+0000 7fa771195640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7fa75807e5c0 0x7fa7580809e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa7580763a0 msgr2=0x7fa758078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa7580763a0 0x7fa758078860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa760009560 tx=0x7fa76002e000 comp rx=0 tx=0).stop 2024-05-15T12:09:53.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76c167170 msgr2=0x7fa76c156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 --2- 172.21.15.77:0/512733206 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa76c167170 0x7fa76c156680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00e850 tx=0x7fa75c00ed10 comp rx=0 tx=0).stop 2024-05-15T12:09:53.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa770994640 1 -- 172.21.15.77:0/512733206 reap_dead start 2024-05-15T12:09:53.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 --> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7eff7006feb0 con 0x7eff5407e5c0 2024-05-15T12:09:53.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 shutdown_connections 2024-05-15T12:09:53.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 >> 172.21.15.77:0/512733206 conn(0x7fa76c0b2980 msgr2=0x7fa76c06f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fcf76ffd640 1 -- 172.21.15.77:0/1231943150 <== osd.4 v2:172.21.15.83:6800/675760629 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf88076760 con 0x7fcf6807e4f0 2024-05-15T12:09:53.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 shutdown_connections 2024-05-15T12:09:53.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7fa771195640 1 -- 172.21.15.77:0/512733206 wait complete. 2024-05-15T12:09:53.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.667+0000 7eff65ffb640 1 -- 172.21.15.77:0/3024193420 <== osd.3 v2:172.21.15.77:6824/2819431659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7eff7006feb0 con 0x7eff5407e5c0 2024-05-15T12:09:53.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 --> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9630076760 con 0x7f961007e5c0 2024-05-15T12:09:53.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7fcf6807e4f0 msgr2=0x7fcf68080910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7fcf6807e4f0 0x7fcf68080910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7eff5407e5c0 msgr2=0x7eff540809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7eff77990640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7eff5407e5c0 0x7eff540809e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcf680762d0 msgr2=0x7fcf68078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcf680762d0 0x7fcf68078790 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcf78000f60 tx=0x7fcf78009040 comp rx=0 tx=0).stop 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf88144ae0 msgr2=0x7fcf880b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 --2- 172.21.15.77:0/1231943150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf88144ae0 0x7fcf880b4a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00ea00 tx=0x7fcf7c00eec0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf86d9d640 1 -- 172.21.15.77:0/1231943150 reap_dead start 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 shutdown_connections 2024-05-15T12:09:53.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 >> 172.21.15.77:0/1231943150 conn(0x7fcf8806c3f0 msgr2=0x7fcf8806c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7f9626ffd640 1 -- 172.21.15.77:0/2996605634 <== osd.0 v2:172.21.15.77:6800/3927618642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9630076760 con 0x7f961007e5c0 2024-05-15T12:09:53.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7eff540763a0 msgr2=0x7eff54078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.668+0000 7eff77990640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7eff540763a0 0x7eff54078860 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff6c007fd0 tx=0x7eff6c009040 comp rx=0 tx=0).stop 2024-05-15T12:09:53.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff701636a0 msgr2=0x7eff700cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff77990640 1 --2- 172.21.15.77:0/3024193420 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7eff701636a0 0x7eff700cec40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff60009960 tx=0x7eff600046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff75f2d640 1 -- 172.21.15.77:0/3024193420 reap_dead start 2024-05-15T12:09:53.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 shutdown_connections 2024-05-15T12:09:53.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 >> 172.21.15.77:0/3024193420 conn(0x7eff7006c3f0 msgr2=0x7eff700d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 shutdown_connections 2024-05-15T12:09:53.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7f961007e5c0 msgr2=0x7f96100809e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7f961007e5c0 0x7f96100809e0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96100763a0 msgr2=0x7f9610078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96100763a0 0x7f9610078860 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9620034000 tx=0x7f962002e000 comp rx=0 tx=0).stop 2024-05-15T12:09:53.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963015b190 msgr2=0x7f963009d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 --2- 172.21.15.77:0/2996605634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963015b190 0x7f963009d1c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f962800c780 tx=0x7f962800cc40 comp rx=0 tx=0).stop 2024-05-15T12:09:53.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7eff77990640 1 -- 172.21.15.77:0/3024193420 wait complete. 2024-05-15T12:09:53.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962ed9d640 1 -- 172.21.15.77:0/2996605634 reap_dead start 2024-05-15T12:09:53.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.669+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 shutdown_connections 2024-05-15T12:09:53.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.670+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 >> 172.21.15.77:0/2996605634 conn(0x7f96300b2980 msgr2=0x7f96300b08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.670+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 shutdown_connections 2024-05-15T12:09:53.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.670+0000 7f962f59e640 1 -- 172.21.15.77:0/2996605634 wait complete. 2024-05-15T12:09:53.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.670+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 shutdown_connections 2024-05-15T12:09:53.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.670+0000 7fcf8759e640 1 -- 172.21.15.77:0/1231943150 wait complete. 2024-05-15T12:09:53.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.676+0000 7f7c1f413640 1 -- 172.21.15.77:0/3777218043 --> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7c180d26e0 con 0x7f7c180b5820 2024-05-15T12:09:53.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.677+0000 7f7c0effd640 1 -- 172.21.15.77:0/3777218043 <== osd.7 v2:172.21.15.83:6824/3871315040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7c180d26e0 con 0x7f7c180b5820 2024-05-15T12:09:53.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.678+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f7c180b5820 msgr2=0x7f7c180d4ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.678+0000 7f7c0cff9640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f7c180b5820 0x7f7c180d4ff0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.678+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7bfc0766d0 msgr2=0x7f7bfc078b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.678+0000 7f7c0cff9640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7bfc0766d0 0x7f7bfc078b90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c10007370 tx=0x7f7c100095b0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 msgr2=0x7f7c180ba050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c0cff9640 1 --2- 172.21.15.77:0/3777218043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c180d19c0 0x7f7c180ba050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c08031000 tx=0x7f7c080046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c1ec12640 1 -- 172.21.15.77:0/3777218043 reap_dead start 2024-05-15T12:09:53.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 shutdown_connections 2024-05-15T12:09:53.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 >> 172.21.15.77:0/3777218043 conn(0x7f7c1809e2d0 msgr2=0x7f7c180b7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 shutdown_connections 2024-05-15T12:09:53.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.679+0000 7f7c0cff9640 1 -- 172.21.15.77:0/3777218043 wait complete. 2024-05-15T12:09:53.725 INFO:teuthology.orchestra.run.smithi077.stdout:64424509449 2024-05-15T12:09:53.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-15T12:09:53.727 INFO:teuthology.orchestra.run.smithi077.stdout:68719476745 2024-05-15T12:09:53.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T12:09:53.728 INFO:teuthology.orchestra.run.smithi077.stdout:60129542150 2024-05-15T12:09:53.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T12:09:53.729 INFO:teuthology.orchestra.run.smithi077.stdout:64424509448 2024-05-15T12:09:53.729 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-15T12:09:53.730 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2024-05-15T12:09:53.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T12:09:53.731 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-05-15T12:09:53.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T12:09:53.732 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2024-05-15T12:09:53.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T12:09:53.733 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2024-05-15T12:09:53.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-15T12:09:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.941+0000 7fbdb43e4640 1 Processor -- start 2024-05-15T12:09:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.941+0000 7fbdb43e4640 1 -- start start 2024-05-15T12:09:53.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.942+0000 7f56bd6e4640 1 Processor -- start 2024-05-15T12:09:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.942+0000 7f56bd6e4640 1 -- start start 2024-05-15T12:09:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.942+0000 7fbdb43e4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac0b6180 0x7fbdac0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb43e4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbdac0b2bb0 0x7fbdac0b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb43e4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdac06ece0 con 0x7fbdac1636a0 2024-05-15T12:09:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb43e4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbdac0b3550 con 0x7fbdac0b2bb0 2024-05-15T12:09:53.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb43e4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbdac072860 con 0x7fbdac0b6180 2024-05-15T12:09:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb2180640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbdac1636a0 0x7fbdac06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44346/0 (socket says 172.21.15.77:44346) 2024-05-15T12:09:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb2180640 1 -- 172.21.15.77:0/2816546579 learned_addr learned my addr 172.21.15.77:0/2816546579 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7f56bd6e4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f56b00df660 0x7f56b0050090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7f56bd6e4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 0x7f56b00505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7f56bd6e4640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b00dfa40 con 0x7f56b0034610 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.943+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352797240 0 0) 0x7fbdac06ece0 con 0x7fbdac1636a0 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb2981640 1 --2- 172.21.15.77:0/2816546579 >> v2:172.21.15.83:3300/0 conn(0x7fbdac0b2bb0 0x7fbdac0b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd98003520 con 0x7fbdac1636a0 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56bd6e4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56b0006b20 con 0x7f56b00e3130 2024-05-15T12:09:53.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56bd6e4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f56b00e3630 con 0x7f56b00df660 2024-05-15T12:09:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fb1d1ec8640 1 Processor -- start 2024-05-15T12:09:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fb1d1ec8640 1 -- start start 2024-05-15T12:09:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f4cbb59e640 1 Processor -- start 2024-05-15T12:09:53.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56b77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 0x7f56b00505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb197f640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac0b6180 0x7fbdac0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56b77fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 0x7f56b00505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56240/0 (socket says 172.21.15.77:56240) 2024-05-15T12:09:53.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f46f3478640 1 Processor -- start 2024-05-15T12:09:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f7560b27640 1 Processor -- start 2024-05-15T12:09:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f4cbb59e640 1 -- start start 2024-05-15T12:09:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56b77fe640 1 -- 172.21.15.77:0/1533272712 learned_addr learned my addr 172.21.15.77:0/1533272712 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56b7fff640 1 --2- 172.21.15.77:0/1533272712 >> v2:172.21.15.83:3300/0 conn(0x7f56b00df660 0x7f56b0050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 226173841 0 0) 0x7fbd98003520 con 0x7fbdac1636a0 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac0b6180 msgr2=0x7fbdac0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb117e640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac0b6180 0x7fbdac0cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 >> v2:172.21.15.83:3300/0 conn(0x7fbdac0b2bb0 msgr2=0x7fbdac0b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fbdb117e640 1 --2- 172.21.15.77:0/2816546579 >> v2:172.21.15.83:3300/0 conn(0x7fbdac0b2bb0 0x7fbdac0b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac06efc0 con 0x7fbdac1636a0 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fbda80016f0 con 0x7fbdac1636a0 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb2981640 1 --2- 172.21.15.77:0/2816546579 >> v2:172.21.15.83:3300/0 conn(0x7fbdac0b2bb0 0x7fbdac0b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 >> v1:172.21.15.77:6789/0 conn(0x7fbdac1636a0 legacy=0x7fbdac06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd98003a50 0x7fbd98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd98004800 0x7fbd98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd980051c0 0x7fbd9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd98003a50 0x7fbd98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac072860 con 0x7fbd980051c0 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9800c030 con 0x7fbd98004800 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9800c230 con 0x7fbd98003a50 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f56b7fff640 1 -- 172.21.15.77:0/1533272712 >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 msgr2=0x7f56b00505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7f56b7fff640 1 --2- 172.21.15.77:0/1533272712 >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 0x7f56b00505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7f56b7fff640 1 -- 172.21.15.77:0/1533272712 >> v1:172.21.15.83:6789/0 conn(0x7f56b0034610 legacy=0x7f56b00532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7f56b7fff640 1 -- 172.21.15.77:0/1533272712 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b00e3910 con 0x7f56b00df660 2024-05-15T12:09:53.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f56b77fe640 1 --2- 172.21.15.77:0/1533272712 >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 0x7f56b00505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fb1d1ec8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc06c3f0 0x7fb1cc163ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fb1d1ec8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb1cc06c7d0 0x7fb1cc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fb1d1ec8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1cc0740b0 0x7fb1cc1676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fb1d1ec8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb1cc163ff0 con 0x7fb1cc0740b0 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fb1d1ec8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb1cc164d90 con 0x7fb1cc06c7d0 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7fb1d1ec8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc164210 con 0x7fb1cc06c3f0 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1cc0740b0 0x7fb1cc1676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cbfff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1cc0740b0 0x7fb1cc1676c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56270/0 (socket says 172.21.15.77:56270) 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cbfff640 1 -- 172.21.15.77:0/1039576852 learned_addr learned my addr 172.21.15.77:0/1039576852 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7f53ed2d1640 1 Processor -- start 2024-05-15T12:09:53.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f56b7fff640 1 --2- 172.21.15.77:0/1533272712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b0050090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56b000df00 tx=0x7f56a402e4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba3d358d28200bb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f53ed2d1640 1 -- start start 2024-05-15T12:09:53.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f4cbb59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cb4050170 0x7f4cb40e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cb7fe640 1 --2- 172.21.15.77:0/1039576852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc06c3f0 0x7fb1cc163ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7f7560b27640 1 -- start start 2024-05-15T12:09:53.947 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f4cbb59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4cb4053090 0x7f4cb4005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.945+0000 7f46f3478640 1 -- start start 2024-05-15T12:09:53.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f3478640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46ec15b1f0 0x7f46ec0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f4cbb59e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb40df4d0 con 0x7f4cb40df0f0 2024-05-15T12:09:53.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f4cbb59e640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb40535e0 con 0x7f4cb4050170 2024-05-15T12:09:53.948 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f4cbb59e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb40538c0 con 0x7f4cb4053090 2024-05-15T12:09:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fca4df8e640 1 Processor -- start 2024-05-15T12:09:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.944+0000 7fca4df8e640 1 -- start start 2024-05-15T12:09:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fca4df8e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fca48163b50 0x7fca48072040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fca4cf8c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fca480d06a0 0x7fca480cb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44362/0 (socket says 172.21.15.77:44362) 2024-05-15T12:09:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fca4cf8c640 1 -- 172.21.15.77:0/2491248776 learned_addr learned my addr 172.21.15.77:0/2491248776 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.949 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca480cbb30 con 0x7fca480d06a0 2024-05-15T12:09:53.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca480cbe10 con 0x7fca48072580 2024-05-15T12:09:53.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fca480d0a80 con 0x7fca48163b50 2024-05-15T12:09:53.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fbdb197f640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd98004800 0x7fbd98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f3478640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f46ec0d17d0 0x7f46ec0ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f3478640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec06e0a0 0x7f46ec0cf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f3478640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec0cd450 con 0x7f46ec0d17d0 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f3478640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f46ec0726c0 con 0x7f46ec15b1f0 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f3478640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec0708b0 con 0x7f46ec06e0a0 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f2476640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46ec15b1f0 0x7f46ec0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f7560b27640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f75540e32f0 0x7f75540572e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f7560b27640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75540e36d0 con 0x7f7554054300 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f7560b27640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7554057b30 con 0x7f7554053740 2024-05-15T12:09:53.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f7560b27640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7554057e10 con 0x7f75540e32f0 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1caffd640 1 --2- 172.21.15.77:0/1039576852 >> v2:172.21.15.83:3300/0 conn(0x7fb1cc06c7d0 0x7fb1cc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cb7fe640 1 -- 172.21.15.77:0/1039576852 >> v2:172.21.15.83:3300/0 conn(0x7fb1cc06c7d0 msgr2=0x7fb1cc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cb7fe640 1 --2- 172.21.15.77:0/1039576852 >> v2:172.21.15.83:3300/0 conn(0x7fb1cc06c7d0 0x7fb1cc0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cb7fe640 1 -- 172.21.15.77:0/1039576852 >> v2:172.21.15.77:3300/0 conn(0x7fb1cc0740b0 msgr2=0x7fb1cc1676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cb7fe640 1 --2- 172.21.15.77:0/1039576852 >> v2:172.21.15.77:3300/0 conn(0x7fb1cc0740b0 0x7fb1cc1676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7fb1cb7fe640 1 -- 172.21.15.77:0/1039576852 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc1644f0 con 0x7fb1cc06c3f0 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f4cb9d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cb4050170 0x7f4cb40e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f4cb9d9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cb4050170 0x7f4cb40e00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56276/0 (socket says 172.21.15.77:56276) 2024-05-15T12:09:53.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f4cb9d9b640 1 -- 172.21.15.77:0/826773288 learned_addr learned my addr 172.21.15.77:0/826773288 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fca47fff640 1 --2- 172.21.15.77:0/2491248776 >> v2:172.21.15.77:3300/0 conn(0x7fca48163b50 0x7fca48072040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fca477fe640 1 -- 172.21.15.77:0/2491248776 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208865087 0 0) 0x7fca480cbb30 con 0x7fca480d06a0 2024-05-15T12:09:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f2476640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46ec15b1f0 0x7f46ec0702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47676/0 (socket says 172.21.15.77:47676) 2024-05-15T12:09:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.946+0000 7f46f2476640 1 -- 172.21.15.77:0/1993433037 learned_addr learned my addr 172.21.15.77:0/1993433037 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f1c75640 1 --2- 172.21.15.77:0/1993433037 >> v2:172.21.15.77:3300/0 conn(0x7f46ec0d17d0 0x7f46ec0ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fca477fe640 1 -- 172.21.15.77:0/2491248776 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003520 con 0x7fca480d06a0 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2180640 1 -- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd98004800 msgr2=0x7fbd98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbd98004800 0x7fbd98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2180640 1 -- 172.21.15.77:0/2816546579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd980051c0 msgr2=0x7fbd9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2981640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd980051c0 0x7fbd9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd980051c0 0x7fbd9800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2180640 1 -- 172.21.15.77:0/2816546579 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd98003520 con 0x7fbd98003a50 2024-05-15T12:09:53.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fbdb2981640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd980051c0 0x7fbd9800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f56b6ffd640 1 -- 172.21.15.77:0/1533272712 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a403a070 con 0x7f56b00df660 2024-05-15T12:09:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f56b6ffd640 1 -- 172.21.15.77:0/1533272712 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a400b650 con 0x7f56b00df660 2024-05-15T12:09:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fca47fff640 1 -- 172.21.15.77:0/2491248776 >> v1:172.21.15.83:6789/0 conn(0x7fca48072580 legacy=0x7fca480ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fca47fff640 1 -- 172.21.15.77:0/2491248776 >> v1:172.21.15.77:6789/0 conn(0x7fca480d06a0 legacy=0x7fca480cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7fca47fff640 1 -- 172.21.15.77:0/2491248776 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca480cc0f0 con 0x7fca48163b50 2024-05-15T12:09:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f4cbad9d640 1 --2- 172.21.15.77:0/826773288 >> v2:172.21.15.83:3300/0 conn(0x7f4cb4053090 0x7f4cb4005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f53ed2d1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e806f260 0x7f53e816e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f53ed2d1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e80b5c40 con 0x7f53e81634f0 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f53ed2d1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53e8167f90 con 0x7f53e8073e40 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f53ed2d1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f53e806ddc0 con 0x7f53e806f260 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53e77fe640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f53e8073e40 0x7f53e8167880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37202/0 (socket says 172.21.15.77:37202) 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53e77fe640 1 -- 172.21.15.77:0/2730408865 learned_addr learned my addr 172.21.15.77:0/2730408865 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53ecad0640 1 --2- 172.21.15.77:0/2730408865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e806f260 0x7f53e816e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f2c77640 1 --2- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec06e0a0 0x7f46ec0cf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f2476640 1 -- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec06e0a0 msgr2=0x7f46ec0cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f2476640 1 --2- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec06e0a0 0x7f46ec0cf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f2476640 1 -- 172.21.15.77:0/1993433037 >> v2:172.21.15.77:3300/0 conn(0x7f46ec0d17d0 msgr2=0x7f46ec0ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f2476640 1 --2- 172.21.15.77:0/1993433037 >> v2:172.21.15.77:3300/0 conn(0x7f46ec0d17d0 0x7f46ec0ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f46f2476640 1 -- 172.21.15.77:0/1993433037 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec072910 con 0x7f46ec15b1f0 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f755affd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f7554053740 0x7f7554053bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37178/0 (socket says 172.21.15.77:37178) 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f755affd640 1 -- 172.21.15.77:0/1469596502 learned_addr learned my addr 172.21.15.77:0/1469596502 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:53.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.947+0000 7f755b7fe640 1 --2- 172.21.15.77:0/1469596502 >> v2:172.21.15.77:3300/0 conn(0x7f75540e32f0 0x7f75540572e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7fb1cb7fe640 1 --2- 172.21.15.77:0/1039576852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc06c3f0 0x7fb1cc163ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0d2fd0 tx=0x7fb1bc02a0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a71eed3ba258be50 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f56bd6e4640 1 -- 172.21.15.77:0/1533272712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 msgr2=0x7f56b0050090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cb959a640 1 -- 172.21.15.77:0/826773288 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 808235111 0 0) 0x7f4cb40df4d0 con 0x7f4cb40df0f0 2024-05-15T12:09:53.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cb959a640 1 -- 172.21.15.77:0/826773288 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ca4005730 con 0x7f4cb40df0f0 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f56bd6e4640 1 --2- 172.21.15.77:0/1533272712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b0050090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f56b000df00 tx=0x7f56a402e4c0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd98003a50 0x7fbd98003e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c190 tx=0x7fbd98005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb6714b7eba263e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cbad9d640 1 -- 172.21.15.77:0/826773288 >> v2:172.21.15.77:3300/0 conn(0x7f4cb4050170 msgr2=0x7f4cb40e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cbad9d640 1 --2- 172.21.15.77:0/826773288 >> v2:172.21.15.77:3300/0 conn(0x7f4cb4050170 0x7f4cb40e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cbad9d640 1 -- 172.21.15.77:0/826773288 >> v1:172.21.15.83:6789/0 conn(0x7f4cb40df0f0 legacy=0x7f4cb404fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cb959a640 1 -- 172.21.15.77:0/826773288 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3272358638 0 0) 0x7f4ca4005730 con 0x7f4cb40df0f0 2024-05-15T12:09:53.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f4cbad9d640 1 -- 172.21.15.77:0/826773288 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb4053ba0 con 0x7f4cb4053090 2024-05-15T12:09:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426666101 0 0) 0x7f53d8001110 con 0x7f53e81634f0 2024-05-15T12:09:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d0003520 con 0x7f53e81634f0 2024-05-15T12:09:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2042421986 0 0) 0x7f53e8167f90 con 0x7f53e8073e40 2024-05-15T12:09:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d8001110 con 0x7f53e8073e40 2024-05-15T12:09:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f755b7fe640 1 -- 172.21.15.77:0/1469596502 >> v1:172.21.15.83:6789/0 conn(0x7f7554053740 legacy=0x7f7554053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f755b7fe640 1 -- 172.21.15.77:0/1469596502 >> v1:172.21.15.77:6789/0 conn(0x7f7554054300 legacy=0x7f755403c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f56bd6e4640 1 -- 172.21.15.77:0/1533272712 shutdown_connections 2024-05-15T12:09:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f56bd6e4640 1 --2- 172.21.15.77:0/1533272712 >> v2:172.21.15.77:3300/0 conn(0x7f56b00e3130 0x7f56b00505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f56bd6e4640 1 --2- 172.21.15.77:0/1533272712 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b0050090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f46f2476640 1 --2- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec15b1f0 0x7f46ec0702d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46ec06dff0 tx=0x7f46e400a4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5972b69d0e9c82bb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f56bd6e4640 1 -- 172.21.15.77:0/1533272712 >> 172.21.15.77:0/1533272712 conn(0x7f56b0055350 msgr2=0x7f56b0055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8007cc0 con 0x7fbd98003a50 2024-05-15T12:09:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7fb1ca7fc640 1 -- 172.21.15.77:0/1039576852 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc037070 con 0x7fb1cc06c3f0 2024-05-15T12:09:53.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8005af0 con 0x7fbd98003a50 2024-05-15T12:09:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f56bd6e4640 1 -- 172.21.15.77:0/1533272712 shutdown_connections 2024-05-15T12:09:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fbdb117e640 1 -- 172.21.15.77:0/2816546579 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8007070 con 0x7fbd98003a50 2024-05-15T12:09:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f755b7fe640 1 -- 172.21.15.77:0/1469596502 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75540580f0 con 0x7f75540e32f0 2024-05-15T12:09:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53ecad0640 1 -- 172.21.15.77:0/2730408865 >> v1:172.21.15.83:6789/0 conn(0x7f53e8073e40 legacy=0x7f53e8167880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53ecad0640 1 -- 172.21.15.77:0/2730408865 >> v1:172.21.15.77:6789/0 conn(0x7f53e81634f0 legacy=0x7f53e8167170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7f53ecad0640 1 -- 172.21.15.77:0/2730408865 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e80b4f70 con 0x7f53e806f260 2024-05-15T12:09:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.948+0000 7fca47fff640 1 --2- 172.21.15.77:0/2491248776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca48163b50 0x7fca48072040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca300097a0 tx=0x7fca3002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5c8e13c577b8b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f56bd6e4640 1 -- 172.21.15.77:0/1533272712 wait complete. 2024-05-15T12:09:53.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fb1ca7fc640 1 -- 172.21.15.77:0/1039576852 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1bc02adf0 con 0x7fb1cc06c3f0 2024-05-15T12:09:53.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fca477fe640 1 -- 172.21.15.77:0/2491248776 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30037070 con 0x7fca48163b50 2024-05-15T12:09:53.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fca477fe640 1 -- 172.21.15.77:0/2491248776 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca30032440 con 0x7fca48163b50 2024-05-15T12:09:53.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fca477fe640 1 -- 172.21.15.77:0/2491248776 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30032810 con 0x7fca48163b50 2024-05-15T12:09:53.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f46f1474640 1 -- 172.21.15.77:0/1993433037 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4038070 con 0x7f46ec15b1f0 2024-05-15T12:09:53.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f46f1474640 1 -- 172.21.15.77:0/1993433037 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4030480 con 0x7f46ec15b1f0 2024-05-15T12:09:53.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f46f1474640 1 -- 172.21.15.77:0/1993433037 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e40308b0 con 0x7f46ec15b1f0 2024-05-15T12:09:53.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7fb1ca7fc640 1 -- 172.21.15.77:0/1039576852 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc037070 con 0x7fb1cc06c3f0 2024-05-15T12:09:53.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f53ecad0640 1 --2- 172.21.15.77:0/2730408865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e806f260 0x7f53e816e2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009dc0 tx=0x7f53e002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72f4d3da032f892d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.949+0000 7f755b7fe640 1 --2- 172.21.15.77:0/1469596502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540e32f0 0x7f75540572e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7550009720 tx=0x7f755002a030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88e92c7ae5644d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0007740 con 0x7f53e806f260 2024-05-15T12:09:53.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 -- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec15b1f0 msgr2=0x7f46ec0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 --2- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec15b1f0 0x7f46ec0702d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46ec06dff0 tx=0x7f46e400a4c0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd98003a50 msgr2=0x7fbd98003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2816546579 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbd98003a50 0x7fbd98003e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c190 tx=0x7fbd98005830 comp rx=0 tx=0).stop 2024-05-15T12:09:53.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f755a7fc640 1 -- 172.21.15.77:0/1469596502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550037070 con 0x7f75540e32f0 2024-05-15T12:09:53.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f755a7fc640 1 -- 172.21.15.77:0/1469596502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755002ad40 con 0x7f75540e32f0 2024-05-15T12:09:53.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/1039576852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc06c3f0 msgr2=0x7fb1cc163ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca48163b50 msgr2=0x7fca48072040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 --2- 172.21.15.77:0/2491248776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca48163b50 0x7fca48072040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca300097a0 tx=0x7fca3002a1a0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 -- 172.21.15.77:0/1993433037 shutdown_connections 2024-05-15T12:09:53.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 --2- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec06e0a0 0x7f46ec0cf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 --2- 172.21.15.77:0/1993433037 >> v2:172.21.15.77:3300/0 conn(0x7f46ec0d17d0 0x7f46ec0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 --2- 172.21.15.77:0/1993433037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec15b1f0 0x7f46ec0702d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb2981640 1 -- 172.21.15.77:0/2816546579 reap_dead start 2024-05-15T12:09:53.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e00078e0 con 0x7f53e806f260 2024-05-15T12:09:53.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 -- 172.21.15.77:0/1993433037 >> 172.21.15.77:0/1993433037 conn(0x7f46ec0d0cb0 msgr2=0x7f46ec0d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f755a7fc640 1 -- 172.21.15.77:0/1469596502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550032660 con 0x7f75540e32f0 2024-05-15T12:09:53.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f4cbad9d640 1 --2- 172.21.15.77:0/826773288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4053090 0x7f4cb4005fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000b60 tx=0x7f4cbc0a65b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb781a0f2612d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2816546579 shutdown_connections 2024-05-15T12:09:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2816546579 >> 172.21.15.77:0/2816546579 conn(0x7fbdac06c3f0 msgr2=0x7fbdac06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f53e6ffd640 1 -- 172.21.15.77:0/2730408865 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0007740 con 0x7f53e806f260 2024-05-15T12:09:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 shutdown_connections 2024-05-15T12:09:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 --2- 172.21.15.77:0/2491248776 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca48163b50 0x7fca48072040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 >> 172.21.15.77:0/2491248776 conn(0x7fca480d0cb0 msgr2=0x7fca480d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 -- 172.21.15.77:0/1993433037 shutdown_connections 2024-05-15T12:09:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7f46f3478640 1 -- 172.21.15.77:0/1993433037 wait complete. 2024-05-15T12:09:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/1039576852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc06c3f0 0x7fb1cc163ab0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0d2fd0 tx=0x7fb1bc02a0a0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2816546579 shutdown_connections 2024-05-15T12:09:53.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/1039576852 shutdown_connections 2024-05-15T12:09:53.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/1039576852 >> v2:172.21.15.77:3300/0 conn(0x7fb1cc0740b0 0x7fb1cc1676c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/1039576852 >> v2:172.21.15.83:3300/0 conn(0x7fb1cc06c7d0 0x7fb1cc0707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/1039576852 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc06c3f0 0x7fb1cc163ab0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/1039576852 >> 172.21.15.77:0/1039576852 conn(0x7fb1cc0d1fa0 msgr2=0x7fb1cc0d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/1039576852 shutdown_connections 2024-05-15T12:09:53.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2816546579 wait complete. 2024-05-15T12:09:53.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f7560b27640 1 -- 172.21.15.77:0/1469596502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540e32f0 msgr2=0x7f75540572e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f7560b27640 1 --2- 172.21.15.77:0/1469596502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540e32f0 0x7f75540572e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7550009720 tx=0x7f755002a030 comp rx=0 tx=0).stop 2024-05-15T12:09:53.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f56bd6e4640 1 Processor -- start 2024-05-15T12:09:53.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f7560b27640 1 -- 172.21.15.77:0/1469596502 shutdown_connections 2024-05-15T12:09:53.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f7560b27640 1 --2- 172.21.15.77:0/1469596502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75540e32f0 0x7f75540572e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f53ed2d1640 1 -- 172.21.15.77:0/2730408865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e806f260 msgr2=0x7f53e816e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/2730408865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e806f260 0x7f53e816e2f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009dc0 tx=0x7f53e002a6d0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f7560b27640 1 -- 172.21.15.77:0/1469596502 >> 172.21.15.77:0/1469596502 conn(0x7f7554058ee0 msgr2=0x7f75540592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 shutdown_connections 2024-05-15T12:09:53.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fca4df8e640 1 -- 172.21.15.77:0/2491248776 wait complete. 2024-05-15T12:09:53.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f56bd6e4640 1 -- start start 2024-05-15T12:09:53.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f53ed2d1640 1 -- 172.21.15.77:0/2730408865 shutdown_connections 2024-05-15T12:09:53.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/2730408865 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e806f260 0x7f53e816e2f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f53ed2d1640 1 -- 172.21.15.77:0/2730408865 >> 172.21.15.77:0/2730408865 conn(0x7f53e80b2980 msgr2=0x7f53e80b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f4cb959a640 1 -- 172.21.15.77:0/826773288 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0b2070 con 0x7f4cb4053090 2024-05-15T12:09:53.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f53ed2d1640 1 -- 172.21.15.77:0/2730408865 shutdown_connections 2024-05-15T12:09:53.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.951+0000 7f4cb959a640 1 -- 172.21.15.77:0/826773288 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc0ab630 con 0x7f4cb4053090 2024-05-15T12:09:53.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7f46f3478640 1 Processor -- start 2024-05-15T12:09:53.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7f46f3478640 1 -- start start 2024-05-15T12:09:53.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7fca4df8e640 1 Processor -- start 2024-05-15T12:09:53.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7fca4df8e640 1 -- start start 2024-05-15T12:09:53.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7f4cb959a640 1 -- 172.21.15.77:0/826773288 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac0016f0 con 0x7f4cb4053090 2024-05-15T12:09:53.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.950+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/1039576852 wait complete. 2024-05-15T12:09:53.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7fb1d1ec8640 1 Processor -- start 2024-05-15T12:09:53.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7f53ed2d1640 1 -- 172.21.15.77:0/2730408865 wait complete. 2024-05-15T12:09:53.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7fbdb43e4640 1 Processor -- start 2024-05-15T12:09:53.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7fbdb43e4640 1 -- start start 2024-05-15T12:09:53.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7fb1d1ec8640 1 -- start start 2024-05-15T12:09:53.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7f4cbb59e640 1 -- 172.21.15.77:0/826773288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4053090 msgr2=0x7f4cb4005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.952+0000 7f4cbb59e640 1 --2- 172.21.15.77:0/826773288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4053090 0x7f4cb4005fd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000b60 tx=0x7f4cbc0a65b0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f56bd6e4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 0x7f56b00e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f4cbb59e640 1 -- 172.21.15.77:0/826773288 shutdown_connections 2024-05-15T12:09:53.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f4cbb59e640 1 --2- 172.21.15.77:0/826773288 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4053090 0x7f4cb4005fd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f4cbb59e640 1 --2- 172.21.15.77:0/826773288 >> v2:172.21.15.77:3300/0 conn(0x7f4cb4050170 0x7f4cb40e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f4cbb59e640 1 -- 172.21.15.77:0/826773288 >> 172.21.15.77:0/826773288 conn(0x7f4cb4009fa0 msgr2=0x7f4cb400a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:53.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f7560b27640 1 -- 172.21.15.77:0/1469596502 shutdown_connections 2024-05-15T12:09:53.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f56bd6e4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b00da3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f7560b27640 1 -- 172.21.15.77:0/1469596502 wait complete. 2024-05-15T12:09:53.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f56bd6e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b00e3130 0x7f56b00365e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f3478640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 0x7f46ec157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f3478640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46ec0d17d0 0x7f46ec1580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f56b7fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 0x7f56b00e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f56b7fff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 0x7f56b00e25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57868/0 (socket says 172.21.15.77:57868) 2024-05-15T12:09:53.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f3478640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec15b1f0 0x7f46ec15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f2476640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 0x7f46ec157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f2476640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 0x7f46ec157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47690/0 (socket says 172.21.15.77:47690) 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f2476640 1 -- 172.21.15.77:0/1634166642 learned_addr learned my addr 172.21.15.77:0/1634166642 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec15b5d0 con 0x7f46ec0d17d0 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46ec0cf100 con 0x7f46ec06e0a0 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f1c75640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46ec0d17d0 0x7f46ec1580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f46ec06e510 con 0x7f46ec15b1f0 2024-05-15T12:09:53.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f53ed2d1640 1 Processor -- start 2024-05-15T12:09:53.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7fca4df8e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 0x7fca48139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7fca4df8e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca480d06a0 0x7fca48165950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f56bd6e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56b0054fb0 con 0x7f56b00e3130 2024-05-15T12:09:53.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7fca4df8e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca48163b50 0x7fca480af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f56bd6e4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f56b00e3ed0 con 0x7f56b00df660 2024-05-15T12:09:53.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4df8e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fca480ccbd0 con 0x7fca480d06a0 2024-05-15T12:09:53.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 0x7fca48139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 0x7fca48139ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57888/0 (socket says 172.21.15.77:57888) 2024-05-15T12:09:53.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f56bd6e4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f56b0055130 con 0x7f56b0034610 2024-05-15T12:09:53.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4df8e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fca480cc740 con 0x7fca48163b50 2024-05-15T12:09:53.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fca480ccd50 con 0x7fca48072580 2024-05-15T12:09:53.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 -- 172.21.15.77:0/4078854322 learned_addr learned my addr 172.21.15.77:0/4078854322 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca47fff640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca480d06a0 0x7fca48165950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4d78d640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca48163b50 0x7fca480af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f56b7fff640 1 -- 172.21.15.77:0/64382541 learned_addr learned my addr 172.21.15.77:0/64382541 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1d1ec8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1cc06c3f0 0x7fb1cc1fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2476640 1 -- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec15b1f0 msgr2=0x7f46ec15ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.953+0000 7f46f2c77640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec15b1f0 0x7f46ec15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2476640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec15b1f0 0x7f46ec15ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2476640 1 -- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46ec0d17d0 msgr2=0x7f46ec1580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2476640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46ec0d17d0 0x7f46ec1580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2476640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ec158940 con 0x7f46ec06e0a0 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1d1ec8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1cc06c7d0 0x7fb1cc162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 -- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca48163b50 msgr2=0x7fca480af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca48163b50 0x7fca480af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 -- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca480d06a0 msgr2=0x7fca48165950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca480d06a0 0x7fca48165950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 -- 172.21.15.77:0/4078854322 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4813e310 con 0x7fca48072580 2024-05-15T12:09:53.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2c77640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec15b1f0 0x7f46ec15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:53.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1d1ec8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc0740b0 0x7fb1cc1fca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1cb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1cc06c3f0 0x7fb1cc1fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1cb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1cc06c3f0 0x7fb1cc1fd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56352/0 (socket says 172.21.15.77:56352) 2024-05-15T12:09:53.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1cb7fe640 1 -- 172.21.15.77:0/3534554406 learned_addr learned my addr 172.21.15.77:0/3534554406 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f56bcee3640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b00e3130 0x7f56b00365e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f4cbb59e640 1 -- 172.21.15.77:0/826773288 shutdown_connections 2024-05-15T12:09:53.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f46f2476640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 0x7f46ec157480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46e400c040 tx=0x7f46e4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc070d30 con 0x7fb1cc06c3f0 2024-05-15T12:09:53.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fb1caffd640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1cc06c7d0 0x7fb1cc162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7fca4cf8c640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 0x7fca48139ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c500 tx=0x7fca3800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:53.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb1cc164ab0 con 0x7fb1cc06c7d0 2024-05-15T12:09:53.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f7560b27640 1 Processor -- start 2024-05-15T12:09:53.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4038050 con 0x7f46ec06e0a0 2024-05-15T12:09:53.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb1cc06cc50 con 0x7fb1cc0740b0 2024-05-15T12:09:53.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4044070 con 0x7f46ec06e0a0 2024-05-15T12:09:53.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f56b7fff640 1 -- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 msgr2=0x7f56b00da3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ec158c20 con 0x7f46ec06e0a0 2024-05-15T12:09:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f53ed2d1640 1 -- start start 2024-05-15T12:09:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ed2d1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e806f260 0x7f53e81638d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ed2d1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e8073e40 0x7f53e8150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ed2d1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e81634f0 0x7f53e80d0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ed2d1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80b4c90 con 0x7f53e806f260 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ed2d1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f53e80b5530 con 0x7f53e81634f0 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ed2d1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f53e80742a0 con 0x7f53e8073e40 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fb1cbfff640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc0740b0 0x7fb1cc1fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4030830 con 0x7f46ec06e0a0 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ec1591e0 con 0x7f46ec06e0a0 2024-05-15T12:09:53.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f7560b27640 1 -- start start 2024-05-15T12:09:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.954+0000 7f4cbb59e640 1 -- 172.21.15.77:0/826773288 wait complete. 2024-05-15T12:09:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e806f260 0x7f53e81638d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53e7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e806f260 0x7f53e81638d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56360/0 (socket says 172.21.15.77:56360) 2024-05-15T12:09:53.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53e7fff640 1 -- 172.21.15.77:0/4070950428 learned_addr learned my addr 172.21.15.77:0/4070950428 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fbdb43e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 0x7fbdac15ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fbdb43e4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac156d60 0x7fbdac158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fbdb43e4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdac0736a0 0x7fbdac073b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fbdb43e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac163a80 con 0x7fbdac14d300 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fbdb43e4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbdac0724f0 con 0x7fbdac0736a0 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fbdb43e4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbdac0cd900 con 0x7fbdac156d60 2024-05-15T12:09:53.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38017070 con 0x7fca48072580 2024-05-15T12:09:53.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fb1cbfff640 1 -- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1cc06c7d0 msgr2=0x7fb1cc162710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca38005ce0 con 0x7fca48072580 2024-05-15T12:09:53.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38007270 con 0x7fca48072580 2024-05-15T12:09:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53e77fe640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e8073e40 0x7f53e8150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f53ecad0640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e81634f0 0x7f53e80d0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f53ecad0640 1 -- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e8073e40 msgr2=0x7f53e8150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f53ecad0640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e8073e40 0x7f53e8150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fb1cbfff640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1cc06c7d0 0x7fb1cc162710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:53.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f53ecad0640 1 -- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e806f260 msgr2=0x7f53e81638d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 0x7fbdac15ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fb1cbfff640 1 -- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1cc06c3f0 msgr2=0x7fb1cc1fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f53ecad0640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e806f260 0x7f53e81638d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 0x7fbdac15ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56376/0 (socket says 172.21.15.77:56376) 2024-05-15T12:09:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 -- 172.21.15.77:0/2079910451 learned_addr learned my addr 172.21.15.77:0/2079910451 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2981640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdac0736a0 0x7fbdac073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4813e5f0 con 0x7fca48072580 2024-05-15T12:09:54.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fb1cbfff640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1cc06c3f0 0x7fb1cc1fd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f53ecad0640 1 -- 172.21.15.77:0/4070950428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53e8164120 con 0x7f53e81634f0 2024-05-15T12:09:54.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4813ebb0 con 0x7fca48072580 2024-05-15T12:09:54.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f4cbb59e640 1 Processor -- start 2024-05-15T12:09:54.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f4cbb59e640 1 -- start start 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.955+0000 7f56b77fe640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b00da3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f56b7fff640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b00da3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f56b7fff640 1 -- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b00e3130 msgr2=0x7f56b00365e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f56b7fff640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b00e3130 0x7f56b00365e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7f56b7fff640 1 -- 172.21.15.77:0/64382541 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b00dad20 con 0x7f56b0034610 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f7560b27640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7554053740 0x7f75540c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f56b77fe640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b00da3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:54.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f7560b27640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 0x7f75540dbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f56bcee3640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b00e3130 0x7f56b00365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:54.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f56b7fff640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 0x7f56b00e25f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f56a400dcb0 tx=0x7f56a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7fb1cbfff640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc0aa5c0 con 0x7fb1cc0740b0 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ec074230 con 0x7f46ec06e0a0 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f7560b27640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75540e32f0 0x7f75540d94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7554053740 0x7f75540c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755b7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7554053740 0x7f75540c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47736/0 (socket says 172.21.15.77:47736) 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 0x7f75540dbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 -- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac156d60 msgr2=0x7fbdac158500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac156d60 0x7fbdac158500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 -- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdac0736a0 msgr2=0x7fbdac073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f7560b27640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7554058bd0 con 0x7f7554054300 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f7560b27640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7554057820 con 0x7f7554053740 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f7560b27640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f75540510a0 con 0x7f75540e32f0 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 0x7f75540dbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56378/0 (socket says 172.21.15.77:56378) 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755b7fe640 1 -- 172.21.15.77:0/3198932148 learned_addr learned my addr 172.21.15.77:0/3198932148 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdac0736a0 0x7fbdac073b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.956+0000 7fbdb2180640 1 -- 172.21.15.77:0/2079910451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdac1571e0 con 0x7fbdac14d300 2024-05-15T12:09:54.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4045020 con 0x7f56b0034610 2024-05-15T12:09:54.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56a4040470 con 0x7f56b0034610 2024-05-15T12:09:54.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a403a040 con 0x7f56b0034610 2024-05-15T12:09:54.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f53ecad0640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e81634f0 0x7f53e80d0c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53e0031000 tx=0x7f53e0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7fb1cbfff640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc0740b0 0x7fb1cc1fca40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e870 tx=0x7fb1c000ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0017070 con 0x7fb1cc0740b0 2024-05-15T12:09:54.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1c000c940 con 0x7fb1cc0740b0 2024-05-15T12:09:54.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f4cbb59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4050170 0x7f4cb40c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbb59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb4053090 0x7f4cb40dcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f56bd6e4640 1 -- 172.21.15.77:0/64382541 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b00352b0 con 0x7f56b0034610 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f56bd6e4640 1 -- 172.21.15.77:0/64382541 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b0035870 con 0x7f56b0034610 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 -- 172.21.15.77:0/3198932148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75540e32f0 msgr2=0x7f75540d94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75540e32f0 0x7f75540d94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 -- 172.21.15.77:0/3198932148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7554053740 msgr2=0x7f75540c9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7554053740 0x7f75540c9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f755affd640 1 -- 172.21.15.77:0/3198932148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7554051340 con 0x7f7554054300 2024-05-15T12:09:54.009 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f755affd640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 0x7f75540dbc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f754800c530 tx=0x7f754800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000cd10 con 0x7fb1cc0740b0 2024-05-15T12:09:54.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc0aa8a0 con 0x7fb1cc0740b0 2024-05-15T12:09:54.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1cc14ffc0 con 0x7fb1cc0740b0 2024-05-15T12:09:54.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbb59e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cb40df0f0 0x7f4cb40dd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cb9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb4053090 0x7f4cb40dcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cb9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb4053090 0x7f4cb40dcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56384/0 (socket says 172.21.15.77:56384) 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbad9d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cb40df0f0 0x7f4cb40dd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbad9d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cb40df0f0 0x7f4cb40dd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57932/0 (socket says 172.21.15.77:57932) 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbad9d640 1 -- 172.21.15.77:0/799400249 learned_addr learned my addr 172.21.15.77:0/799400249 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb400aac0 con 0x7f4cb4053090 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4054160 con 0x7f4cb4050170 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb400ac40 con 0x7f4cb40df0f0 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.957+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f46e40309d0 con 0x7f46ec06e0a0 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f46e2ffd640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46d00763d0 0x7f46d0078890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.011 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f46e40b8710 con 0x7f46ec06e0a0 2024-05-15T12:09:54.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548018070 con 0x7f7554054300 2024-05-15T12:09:54.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75480074e0 con 0x7f7554054300 2024-05-15T12:09:54.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7554051620 con 0x7f7554054300 2024-05-15T12:09:54.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75540c9540 con 0x7f7554054300 2024-05-15T12:09:54.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f4cba59c640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4050170 0x7f4cb40c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.012 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.958+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7548018070 con 0x7f7554054300 2024-05-15T12:09:54.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7fbdb2180640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 0x7fbdac15ca60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c1f0 tx=0x7fbdac0727d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca480768e0 con 0x7fca48072580 2024-05-15T12:09:54.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fca3801a070 con 0x7fca48072580 2024-05-15T12:09:54.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f4cba59c640 1 -- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cb40df0f0 msgr2=0x7f4cb40dd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f4cba59c640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cb40df0f0 0x7f4cb40dd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f4cba59c640 1 -- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb4053090 msgr2=0x7f4cb40dcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f4cba59c640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb4053090 0x7f4cb40dcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f4cba59c640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb404cae0 con 0x7f4cb4050170 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f4cba59c640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4050170 0x7f4cb40c9d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00c460 tx=0x7f4cac00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b0005710 con 0x7f56b0034610 2024-05-15T12:09:54.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7f46f1c75640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46d00763d0 0x7f46d0078890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc0768e0 con 0x7fb1cc0740b0 2024-05-15T12:09:54.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda8043070 con 0x7fbdac14d300 2024-05-15T12:09:54.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.959+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda8038040 con 0x7fbdac14d300 2024-05-15T12:09:54.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdac14d6e0 con 0x7fbdac14d300 2024-05-15T12:09:54.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda80072b0 con 0x7fbdac14d300 2024-05-15T12:09:54.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdac157740 con 0x7fbdac14d300 2024-05-15T12:09:54.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7f46f1c75640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46d00763d0 0x7f46d0078890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46ec15d8b0 tx=0x7f46dc00f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7fca457fa640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fca280763a0 0x7fca28078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fca380968b0 con 0x7fca48072580 2024-05-15T12:09:54.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7554005700 con 0x7f7554054300 2024-05-15T12:09:54.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.961+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb1c001a070 con 0x7fb1cc0740b0 2024-05-15T12:09:54.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.960+0000 7fca47fff640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fca280763a0 0x7fca28078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.961+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56a4048020 con 0x7f56b0034610 2024-05-15T12:09:54.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.961+0000 7fca47fff640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fca280763a0 0x7fca28078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca30034000 tx=0x7fca3002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.961+0000 7fb1b3fff640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb1b8076320 0x7fb1b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.961+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75480047e0 con 0x7f7554054300 2024-05-15T12:09:54.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.961+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdac0768e0 con 0x7fbdac14d300 2024-05-15T12:09:54.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1c0097a20 con 0x7fb1cc0740b0 2024-05-15T12:09:54.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7fb1cb7fe640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb1b8076320 0x7fb1b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f7547fff640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75400764d0 0x7f7540078990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f56b4ff9640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f569c076350 0x7f569c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7548096670 con 0x7f7554054300 2024-05-15T12:09:54.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f755b7fe640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75400764d0 0x7f7540078990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbda8046070 con 0x7fbdac14d300 2024-05-15T12:09:54.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7fb1cb7fe640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb1b8076320 0x7fb1b80787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc000c00 tx=0x7fb1bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f56b77fe640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f569c076350 0x7f569c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56a40bcd10 con 0x7f56b0034610 2024-05-15T12:09:54.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7f755b7fe640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75400764d0 0x7f7540078990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f755002a070 tx=0x7f755002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.962+0000 7fbda2ffd640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd90076300 0x7fbd900787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7fbdb197f640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd90076300 0x7fbd900787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbda80b7020 con 0x7fbdac14d300 2024-05-15T12:09:54.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f56b77fe640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f569c076350 0x7f569c078810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56b0178a20 tx=0x7f56ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e003f070 con 0x7f53e81634f0 2024-05-15T12:09:54.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac016020 con 0x7f4cb4050170 2024-05-15T12:09:54.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e0031c90 con 0x7f53e81634f0 2024-05-15T12:09:54.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7fbdb197f640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd90076300 0x7fbd900787c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdac1fc890 tx=0x7fbd9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cac012870 con 0x7f4cb4050170 2024-05-15T12:09:54.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f46ec074230 con 0x7f46ec06e0a0 2024-05-15T12:09:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.963+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cac012ca0 con 0x7f4cb4050170 2024-05-15T12:09:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.964+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb404cdc0 con 0x7f4cb4050170 2024-05-15T12:09:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.964+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb404d380 con 0x7f4cb4050170 2024-05-15T12:09:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.964+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e0007740 con 0x7f53e81634f0 2024-05-15T12:09:54.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.964+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53e8164400 con 0x7f53e81634f0 2024-05-15T12:09:54.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.964+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53e81649c0 con 0x7f53e81634f0 2024-05-15T12:09:54.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.965+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fca3805fc30 con 0x7fca48072580 2024-05-15T12:09:54.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.965+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb40052b0 con 0x7f4cb4050170 2024-05-15T12:09:54.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.965+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53e8076760 con 0x7f53e81634f0 2024-05-15T12:09:54.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.966+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cac019020 con 0x7f4cb4050170 2024-05-15T12:09:54.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.966+0000 7f4caaffd640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c9c0763a0 0x7f4c9c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.966+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4cac097290 con 0x7f4cb4050170 2024-05-15T12:09:54.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.966+0000 7f4cb9d9b640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c9c0763a0 0x7f4c9c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.026 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.966+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f53e003b410 con 0x7f53e81634f0 2024-05-15T12:09:54.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.967+0000 7f4cb9d9b640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c9c0763a0 0x7f4c9c078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4004d90 tx=0x7f4cb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.967+0000 7f53e4ff9640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f53d4076320 0x7f53d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:54.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.967+0000 7f53e7fff640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f53d4076320 0x7f53d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:54.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.967+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f53e00b89b0 con 0x7f53e81634f0 2024-05-15T12:09:54.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.967+0000 7f53e7fff640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f53d4076320 0x7f53d40787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53d8007fd0 tx=0x7f53d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.968+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f754805ff70 con 0x7f7554054300 2024-05-15T12:09:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.971+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4cac020030 con 0x7f4cb4050170 2024-05-15T12:09:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.972+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56a404f030 con 0x7f56b0034610 2024-05-15T12:09:54.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.973+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbdac1571e0 con 0x7fbdac14d300 2024-05-15T12:09:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.974+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb1c0060ea0 con 0x7fb1cc0740b0 2024-05-15T12:09:54.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:53.975+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f53e00824b0 con 0x7f53e81634f0 2024-05-15T12:09:54.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.398+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fca480cd3d0 con 0x7fca48072580 2024-05-15T12:09:54.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.399+0000 7fca457fa640 1 -- 172.21.15.77:0/4078854322 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca38063f30 con 0x7fca48072580 2024-05-15T12:09:54.394 INFO:teuthology.orchestra.run.smithi077.stdout:64424509447 2024-05-15T12:09:54.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.400+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f75540dc5b0 con 0x7f7554054300 2024-05-15T12:09:54.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.400+0000 7f46f3478640 1 -- 172.21.15.77:0/1634166642 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f46ec0768e0 con 0x7f46ec06e0a0 2024-05-15T12:09:54.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.400+0000 7f7547fff640 1 -- 172.21.15.77:0/3198932148 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f754805f870 con 0x7f7554054300 2024-05-15T12:09:54.395 INFO:teuthology.orchestra.run.smithi077.stdout:60129542151 2024-05-15T12:09:54.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.401+0000 7f46e2ffd640 1 -- 172.21.15.77:0/1634166642 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f46e404e020 con 0x7f46ec06e0a0 2024-05-15T12:09:54.396 INFO:teuthology.orchestra.run.smithi077.stdout:60129542151 2024-05-15T12:09:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fca280763a0 msgr2=0x7fca28078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fca280763a0 0x7fca28078860 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fca30034000 tx=0x7fca3002e000 comp rx=0 tx=0).stop 2024-05-15T12:09:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 msgr2=0x7fca48139ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 0x7fca48139ac0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fca3800c500 tx=0x7fca3800c9c0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 shutdown_connections 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fca280763a0 0x7fca28078860 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.403+0000 7fca4df8e640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fca48163b50 0x7fca480af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7fca4df8e640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca480d06a0 0x7fca48165950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7fca4df8e640 1 --2- 172.21.15.77:0/4078854322 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fca48072580 0x7fca48139ac0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 >> 172.21.15.77:0/4078854322 conn(0x7fca480d0cb0 msgr2=0x7fca480b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75400764d0 msgr2=0x7f7540078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7f7560b27640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75400764d0 0x7f7540078990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f755002a070 tx=0x7f755002e000 comp rx=0 tx=0).stop 2024-05-15T12:09:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 shutdown_connections 2024-05-15T12:09:54.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7fca4df8e640 1 -- 172.21.15.77:0/4078854322 wait complete. 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 msgr2=0x7f75540dbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.404+0000 7f7560b27640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 0x7f75540dbc10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f754800c530 tx=0x7f754800c9f0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 shutdown_connections 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75400764d0 0x7f7540078990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75540e32f0 0x7f75540d94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7554054300 0x7f75540dbc10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 --2- 172.21.15.77:0/3198932148 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7554053740 0x7f75540c9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 >> 172.21.15.77:0/3198932148 conn(0x7f7554058ee0 msgr2=0x7f75540e3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 shutdown_connections 2024-05-15T12:09:54.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f7560b27640 1 -- 172.21.15.77:0/3198932148 wait complete. 2024-05-15T12:09:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f46e0ff9640 1 -- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46d00763d0 msgr2=0x7f46d0078890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f46e0ff9640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46d00763d0 0x7f46d0078890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46ec15d8b0 tx=0x7f46dc00f040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f46e0ff9640 1 -- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 msgr2=0x7f46ec157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.405+0000 7f46e0ff9640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 0x7f46ec157480 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46e400c040 tx=0x7f46e4004a40 comp rx=0 tx=0).stop 2024-05-15T12:09:54.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.406+0000 7f46e0ff9640 1 -- 172.21.15.77:0/1634166642 shutdown_connections 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.406+0000 7f46e0ff9640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46d00763d0 0x7f46d0078890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.406+0000 7f46e0ff9640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46ec15b1f0 0x7f46ec15ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.406+0000 7f46e0ff9640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f46ec0d17d0 0x7f46ec1580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.406+0000 7f46e0ff9640 1 --2- 172.21.15.77:0/1634166642 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46ec06e0a0 0x7f46ec157480 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.406+0000 7f46e0ff9640 1 -- 172.21.15.77:0/1634166642 >> 172.21.15.77:0/1634166642 conn(0x7f46ec0d0cb0 msgr2=0x7f46ec0b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.407+0000 7f46e0ff9640 1 -- 172.21.15.77:0/1634166642 shutdown_connections 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.407+0000 7f46e0ff9640 1 -- 172.21.15.77:0/1634166642 wait complete. 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.407+0000 7f4cbb59e640 1 -- 172.21.15.77:0/799400249 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4cb4037990 con 0x7f4cb4050170 2024-05-15T12:09:54.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.408+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f56b00343f0 con 0x7f56b0034610 2024-05-15T12:09:54.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.408+0000 7f4caaffd640 1 -- 172.21.15.77:0/799400249 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4cac060c60 con 0x7f4cb4050170 2024-05-15T12:09:54.405 INFO:teuthology.orchestra.run.smithi077.stdout:60129542151 2024-05-15T12:09:54.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.408+0000 7f56b4ff9640 1 -- 172.21.15.77:0/64382541 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56a4086770 con 0x7f56b0034610 2024-05-15T12:09:54.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.409+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbdac06feb0 con 0x7fbdac14d300 2024-05-15T12:09:54.406 INFO:teuthology.orchestra.run.smithi077.stdout:64424509448 2024-05-15T12:09:54.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.409+0000 7fbda2ffd640 1 -- 172.21.15.77:0/2079910451 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbda80016b0 con 0x7fbdac14d300 2024-05-15T12:09:54.406 INFO:teuthology.orchestra.run.smithi077.stdout:68719476743 2024-05-15T12:09:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f569c076350 msgr2=0x7f569c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f569c076350 0x7f569c078810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56b0178a20 tx=0x7f56ac008040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 msgr2=0x7f56b00e25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 0x7f56b00e25f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f56a400dcb0 tx=0x7f56a40046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 shutdown_connections 2024-05-15T12:09:54.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f569c076350 0x7f569c078810 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f56b0178a20 tx=0x7f56ac008040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b00e3130 0x7f56b00365e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b00df660 0x7f56b00da3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 --2- 172.21.15.77:0/64382541 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b0034610 0x7f56b00e25f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.412+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 >> 172.21.15.77:0/64382541 conn(0x7f56b0055350 msgr2=0x7f56b00394c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f4ca8ff9640 1 -- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c9c0763a0 msgr2=0x7f4c9c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f4ca8ff9640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c9c0763a0 0x7f4c9c078860 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4004d90 tx=0x7f4cb0008040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f4ca8ff9640 1 -- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4050170 msgr2=0x7f4cb40c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f4ca8ff9640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4050170 0x7f4cb40c9d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4cac00c460 tx=0x7f4cac00c920 comp rx=0 tx=0).stop 2024-05-15T12:09:54.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb1cc073b40 con 0x7fb1cc0740b0 2024-05-15T12:09:54.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f53e806ec60 con 0x7f53e81634f0 2024-05-15T12:09:54.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 shutdown_connections 2024-05-15T12:09:54.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd90076300 msgr2=0x7fbd900787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f56a27fc640 1 -- 172.21.15.77:0/64382541 wait complete. 2024-05-15T12:09:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd90076300 0x7fbd900787c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbdac1fc890 tx=0x7fbd9c008040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 msgr2=0x7fbdac15ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 0x7fbdac15ca60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbda800c1f0 tx=0x7fbdac0727d0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 shutdown_connections 2024-05-15T12:09:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbd90076300 0x7fbd900787c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbdac156d60 0x7fbdac158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbdac0736a0 0x7fbdac073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 --2- 172.21.15.77:0/2079910451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdac14d300 0x7fbdac15ca60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 >> 172.21.15.77:0/2079910451 conn(0x7fbdac06c3f0 msgr2=0x7fbdac0cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 shutdown_connections 2024-05-15T12:09:54.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7fb1b3fff640 1 -- 172.21.15.77:0/3534554406 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb1c00651a0 con 0x7fb1cc0740b0 2024-05-15T12:09:54.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.413+0000 7f53e4ff9640 1 -- 172.21.15.77:0/4070950428 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53e0081db0 con 0x7f53e81634f0 2024-05-15T12:09:54.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7fbdb43e4640 1 -- 172.21.15.77:0/2079910451 wait complete. 2024-05-15T12:09:54.413 INFO:teuthology.orchestra.run.smithi077.stdout:60129542149 2024-05-15T12:09:54.413 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 -- 172.21.15.77:0/799400249 shutdown_connections 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4c9c0763a0 0x7f4c9c078860 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cb40df0f0 0x7f4cb40dd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb4053090 0x7f4cb40dcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 --2- 172.21.15.77:0/799400249 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cb4050170 0x7f4cb40c9d70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 -- 172.21.15.77:0/799400249 >> 172.21.15.77:0/799400249 conn(0x7f4cb4009fa0 msgr2=0x7f4cb40e1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 -- 172.21.15.77:0/799400249 shutdown_connections 2024-05-15T12:09:54.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.414+0000 7f4ca8ff9640 1 -- 172.21.15.77:0/799400249 wait complete. 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.417+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f53d4076320 msgr2=0x7f53d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.417+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f53d4076320 0x7f53d40787e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53d8007fd0 tx=0x7f53d8009040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.417+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e81634f0 msgr2=0x7f53e80d0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.417+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e81634f0 0x7f53e80d0c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f53e0031000 tx=0x7f53e0004a40 comp rx=0 tx=0).stop 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb1b8076320 msgr2=0x7fb1b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb1b8076320 0x7fb1b80787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc000c00 tx=0x7fb1bc02e000 comp rx=0 tx=0).stop 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc0740b0 msgr2=0x7fb1cc1fca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:54.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc0740b0 0x7fb1cc1fca40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e870 tx=0x7fb1c000ec70 comp rx=0 tx=0).stop 2024-05-15T12:09:54.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 shutdown_connections 2024-05-15T12:09:54.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f53d4076320 0x7f53d40787e0 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f53d8007fd0 tx=0x7f53d8009040 comp rx=0 tx=0).stop 2024-05-15T12:09:54.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f53e8073e40 0x7f53e8150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f53e81634f0 0x7f53e80d0c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 --2- 172.21.15.77:0/4070950428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53e806f260 0x7f53e81638d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 >> 172.21.15.77:0/4070950428 conn(0x7f53e80b2980 msgr2=0x7f53e80b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 shutdown_connections 2024-05-15T12:09:54.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb1b8076320 0x7fb1b80787e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb1cc0740b0 0x7fb1cc1fca40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb1cc06c7d0 0x7fb1cc162710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 --2- 172.21.15.77:0/3534554406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1cc06c3f0 0x7fb1cc1fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:54.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 >> 172.21.15.77:0/3534554406 conn(0x7fb1cc0d1fa0 msgr2=0x7fb1cc070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:54.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 shutdown_connections 2024-05-15T12:09:54.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7fb1d1ec8640 1 -- 172.21.15.77:0/3534554406 wait complete. 2024-05-15T12:09:54.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 shutdown_connections 2024-05-15T12:09:54.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:54.418+0000 7f53ed2d1640 1 -- 172.21.15.77:0/4070950428 wait complete. 2024-05-15T12:09:54.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.5 2024-05-15T12:09:54.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2024-05-15T12:09:54.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2024-05-15T12:09:54.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.6 2024-05-15T12:09:54.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476743 for osd.2 2024-05-15T12:09:54.432 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.3 2024-05-15T12:09:54.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2024-05-15T12:09:54.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.1 2024-05-15T12:09:55.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-15T12:09:55.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-15T12:09:55.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-15T12:09:55.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-15T12:09:55.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-15T12:09:55.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-15T12:09:55.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-15T12:09:55.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-15T12:09:55.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.592+0000 7f939080b640 1 Processor -- start 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.592+0000 7f939080b640 1 -- start start 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.593+0000 7f939080b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93840532b0 0x7f9384038740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.593+0000 7f939080b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f93840e78d0 0x7f9384038c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.593+0000 7f939080b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9384054300 con 0x7f93840e74f0 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.593+0000 7f939080b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9384051b40 con 0x7f93840532b0 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.593+0000 7f939080b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f9384054570 con 0x7f93840e78d0 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93840532b0 0x7f9384038740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93840532b0 0x7f9384038740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56394/0 (socket says 172.21.15.77:56394) 2024-05-15T12:09:55.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 -- 172.21.15.77:0/3500473245 learned_addr learned my addr 172.21.15.77:0/3500473245 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 -- 172.21.15.77:0/3500473245 >> v2:172.21.15.83:3300/0 conn(0x7f93840e78d0 msgr2=0x7f9384038c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T12:09:55.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 --2- 172.21.15.77:0/3500473245 >> v2:172.21.15.83:3300/0 conn(0x7f93840e78d0 0x7f9384038c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 -- 172.21.15.77:0/3500473245 >> v1:172.21.15.83:6789/0 conn(0x7f93840e74f0 legacy=0x7f9384007c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.594+0000 7f938affd640 1 -- 172.21.15.77:0/3500473245 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9384054890 con 0x7f93840532b0 2024-05-15T12:09:55.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.596+0000 7f938affd640 1 --2- 172.21.15.77:0/3500473245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f9384038740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f938c0520e0 tx=0x7f938c0a66c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5b245dfff6f9b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.596+0000 7f938a7fc640 1 -- 172.21.15.77:0/3500473245 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0b2070 con 0x7f93840532b0 2024-05-15T12:09:55.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.596+0000 7f938a7fc640 1 -- 172.21.15.77:0/3500473245 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0ab7d0 con 0x7f93840532b0 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.597+0000 7f939080b640 1 -- 172.21.15.77:0/3500473245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 msgr2=0x7f9384038740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.597+0000 7f939080b640 1 --2- 172.21.15.77:0/3500473245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f9384038740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f938c0520e0 tx=0x7f938c0a66c0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.598+0000 7f939080b640 1 -- 172.21.15.77:0/3500473245 shutdown_connections 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.598+0000 7f939080b640 1 --2- 172.21.15.77:0/3500473245 >> v2:172.21.15.83:3300/0 conn(0x7f93840e78d0 0x7f9384038c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.598+0000 7f939080b640 1 --2- 172.21.15.77:0/3500473245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f9384038740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.598+0000 7f939080b640 1 -- 172.21.15.77:0/3500473245 >> 172.21.15.77:0/3500473245 conn(0x7f9384053740 msgr2=0x7f9384053b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.599+0000 7f939080b640 1 -- 172.21.15.77:0/3500473245 shutdown_connections 2024-05-15T12:09:55.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.599+0000 7f939080b640 1 -- 172.21.15.77:0/3500473245 wait complete. 2024-05-15T12:09:55.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.601+0000 7f939080b640 1 Processor -- start 2024-05-15T12:09:55.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.601+0000 7f939080b640 1 -- start start 2024-05-15T12:09:55.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.602+0000 7f939080b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f93840cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f938b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f93840cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f938b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f93840cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56400/0 (socket says 172.21.15.77:56400) 2024-05-15T12:09:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f938b7fe640 1 -- 172.21.15.77:0/1791175808 learned_addr learned my addr 172.21.15.77:0/1791175808 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f939080b640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93840e74f0 0x7f93840e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f939080b640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93840e78d0 0x7f93840cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9384051870 con 0x7f93840532b0 2024-05-15T12:09:55.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.603+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f93840516f0 con 0x7f93840e74f0 2024-05-15T12:09:55.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.604+0000 7f938affd640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93840e74f0 0x7f93840e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.604+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f938404a260 con 0x7f93840e78d0 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.604+0000 7f938affd640 1 -- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93840e78d0 msgr2=0x7f93840cd210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.604+0000 7f938affd640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93840e78d0 0x7f93840cd210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.604+0000 7f938affd640 1 -- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 msgr2=0x7f93840cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.604+0000 7f938affd640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f93840cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.605+0000 7f938affd640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93840d0660 con 0x7f93840e74f0 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.605+0000 7f938b7fe640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f93840cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.605+0000 7f938affd640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93840e74f0 0x7f93840e3f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f938c06aea0 tx=0x7f938c064250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.605+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0bd020 con 0x7f93840e74f0 2024-05-15T12:09:55.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.606+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93840e6670 con 0x7f93840e74f0 2024-05-15T12:09:55.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.606+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93840e6c30 con 0x7f93840e74f0 2024-05-15T12:09:55.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.606+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c0b8670 con 0x7f93840e74f0 2024-05-15T12:09:55.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.606+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c0b2040 con 0x7f93840e74f0 2024-05-15T12:09:55.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.608+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9384005700 con 0x7f93840e74f0 2024-05-15T12:09:55.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.610+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f938c0c0020 con 0x7f93840e74f0 2024-05-15T12:09:55.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.611+0000 7f9377fff640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f93700763a0 0x7f9370078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.611+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f938c1346d0 con 0x7f93840e74f0 2024-05-15T12:09:55.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.611+0000 7f938b7fe640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f93700763a0 0x7f9370078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.612+0000 7f938b7fe640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f93700763a0 0x7f9370078860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9380001cd0 tx=0x7f9380009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.615+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f938c069040 con 0x7f93840e74f0 2024-05-15T12:09:55.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.647+0000 7f4cffa64640 1 Processor -- start 2024-05-15T12:09:55.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7f4cffa64640 1 -- start start 2024-05-15T12:09:55.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7fbe93ca0640 1 Processor -- start 2024-05-15T12:09:55.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7fbe93ca0640 1 -- start start 2024-05-15T12:09:55.644 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f4cffa64640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4cf0054450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f4cffa64640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4cf00380b0 0x7f4cf0038560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f4cffa64640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf0007840 con 0x7f4cf000ab00 2024-05-15T12:09:55.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.647+0000 7f963c8f0640 1 Processor -- start 2024-05-15T12:09:55.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.647+0000 7f963c8f0640 1 -- start start 2024-05-15T12:09:55.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f4cffa64640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf0006090 con 0x7f4cf00380b0 2024-05-15T12:09:55.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f4cffa64640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf0006370 con 0x7f4cf0053ff0 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7f963c8f0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f963000b1c0 0x7f963003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7f963c8f0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f963003adf0 0x7f9630007c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7f963c8f0640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f963000cb20 con 0x7f96300e0010 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7f963c8f0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f96300565c0 con 0x7f963003adf0 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.648+0000 7f963c8f0640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f96300568a0 con 0x7f963000b1c0 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f963003adf0 0x7f9630007c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f963003adf0 0x7f9630007c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56412/0 (socket says 172.21.15.77:56412) 2024-05-15T12:09:55.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 -- 172.21.15.77:0/238011242 learned_addr learned my addr 172.21.15.77:0/238011242 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963659c640 1 --2- 172.21.15.77:0/238011242 >> v2:172.21.15.83:3300/0 conn(0x7f963000b1c0 0x7f963003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 -- 172.21.15.77:0/238011242 >> v2:172.21.15.83:3300/0 conn(0x7f963000b1c0 msgr2=0x7f963003a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 --2- 172.21.15.77:0/238011242 >> v2:172.21.15.83:3300/0 conn(0x7f963000b1c0 0x7f963003a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 -- 172.21.15.77:0/238011242 >> v1:172.21.15.83:6789/0 conn(0x7f96300e0010 legacy=0x7f9630008f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f963759e640 1 -- 172.21.15.77:0/238011242 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f963000cda0 con 0x7f963003adf0 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f4cfe001640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4cf00380b0 0x7f4cf0038560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe93ca0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe840537a0 0x7fbe84053b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f4cfd800640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f4cf000ab00 0x7f4cf0007130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37232/0 (socket says 172.21.15.77:37232) 2024-05-15T12:09:55.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f4cfd800640 1 -- 172.21.15.77:0/145399239 learned_addr learned my addr 172.21.15.77:0/145399239 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:55.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe93ca0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840581a0 con 0x7fbe84006200 2024-05-15T12:09:55.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f4cfcfff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4cf0054450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f963759e640 1 --2- 172.21.15.77:0/238011242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f9630007c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f96380520e0 tx=0x7f96380a6660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9c8571118a25f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe93ca0640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840540c0 con 0x7fbe84006690 2024-05-15T12:09:55.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe93ca0640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbe84007890 con 0x7fbe840537a0 2024-05-15T12:09:55.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe91a3c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe840537a0 0x7fbe84053b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f9635d9b640 1 -- 172.21.15.77:0/238011242 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96380b2070 con 0x7f963003adf0 2024-05-15T12:09:55.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f9635d9b640 1 -- 172.21.15.77:0/238011242 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96380ab7d0 con 0x7f963003adf0 2024-05-15T12:09:55.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f9635d9b640 1 -- 172.21.15.77:0/238011242 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96380abc40 con 0x7f963003adf0 2024-05-15T12:09:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe91a3c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbe840537a0 0x7fbe84053b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47796/0 (socket says 172.21.15.77:47796) 2024-05-15T12:09:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3018706490 learned_addr learned my addr 172.21.15.77:0/3018706490 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7fbe9123b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbe84006200 0x7fbe84057380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44402/0 (socket says 172.21.15.77:44402) 2024-05-15T12:09:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3018706490 >> v1:172.21.15.83:6789/0 conn(0x7fbe84006690 legacy=0x7fbe84057a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f231e30f640 1 Processor -- start 2024-05-15T12:09:55.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3018706490 >> v1:172.21.15.77:6789/0 conn(0x7fbe84006200 legacy=0x7fbe84057380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7fc12e52f640 1 Processor -- start 2024-05-15T12:09:55.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3018706490 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe84006c80 con 0x7fbe840537a0 2024-05-15T12:09:55.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f963c8f0640 1 -- 172.21.15.77:0/238011242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 msgr2=0x7f9630007c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f963c8f0640 1 --2- 172.21.15.77:0/238011242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f9630007c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f96380520e0 tx=0x7f96380a6660 comp rx=0 tx=0).stop 2024-05-15T12:09:55.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7fc12e52f640 1 -- start start 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983273261 0 0) 0x7f4cf0007840 con 0x7f4cf000ab00 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ce4003520 con 0x7f4cf000ab00 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 535335774 0 0) 0x7f4ce4003520 con 0x7f4cf000ab00 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 msgr2=0x7f4cf0054450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4cf0054450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 >> v2:172.21.15.83:3300/0 conn(0x7f4cf00380b0 msgr2=0x7f4cf0038560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 --2- 172.21.15.77:0/145399239 >> v2:172.21.15.83:3300/0 conn(0x7f4cf00380b0 0x7f4cf0038560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0006650 con 0x7f4cf000ab00 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f4cf40016f0 con 0x7f4cf000ab00 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 >> v1:172.21.15.83:6789/0 conn(0x7f4cf000ab00 legacy=0x7f4cf0007130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ce4003a50 0x7f4ce4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4ce4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce4004d40 0x7f4ce40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0006090 con 0x7f4ce4004d40 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0006370 con 0x7f4ce4003a50 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4ce401ca90 con 0x7f4cf0053ff0 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4cfe001640 1 --2- 172.21.15.77:0/145399239 >> v2:172.21.15.83:3300/0 conn(0x7f4cf00380b0 0x7f4cf0038560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4cfd800640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ce4003a50 0x7f4ce4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4ce4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.651+0000 7f4cfe001640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce4004d40 0x7f4ce40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f4cfcfff640 1 -- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ce4003a50 msgr2=0x7f4ce4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4ce4003a50 0x7f4ce4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f4cfcfff640 1 -- 172.21.15.77:0/145399239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce4004d40 msgr2=0x7f4ce40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce4004d40 0x7f4ce40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f4cfcfff640 1 -- 172.21.15.77:0/145399239 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce4003520 con 0x7f4cf0053ff0 2024-05-15T12:09:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f4cfe001640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ce4004d40 0x7f4ce40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:55.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.649+0000 7f75e5074640 1 Processor -- start 2024-05-15T12:09:55.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.650+0000 7f75e5074640 1 -- start start 2024-05-15T12:09:55.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f963c8f0640 1 -- 172.21.15.77:0/238011242 shutdown_connections 2024-05-15T12:09:55.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f963c8f0640 1 --2- 172.21.15.77:0/238011242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f9630007c00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f963c8f0640 1 --2- 172.21.15.77:0/238011242 >> v2:172.21.15.83:3300/0 conn(0x7f963000b1c0 0x7f963003a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f963c8f0640 1 -- 172.21.15.77:0/238011242 >> 172.21.15.77:0/238011242 conn(0x7f963001ef60 msgr2=0x7f9630055c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75e5074640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f75e015de90 0x7f75e0163bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f963c8f0640 1 -- 172.21.15.77:0/238011242 shutdown_connections 2024-05-15T12:09:55.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f963c8f0640 1 -- 172.21.15.77:0/238011242 wait complete. 2024-05-15T12:09:55.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75e5074640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e01640f0 0x7f75e00b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75e5074640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75e01646e0 con 0x7f75e015dab0 2024-05-15T12:09:55.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75e5074640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f75e01649c0 con 0x7f75e015de90 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75e5074640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f75e006e5f0 con 0x7f75e01640f0 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75ded9d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f75e015dab0 0x7f75e006edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37240/0 (socket says 172.21.15.77:37240) 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75ded9d640 1 -- 172.21.15.77:0/732427644 learned_addr learned my addr 172.21.15.77:0/732427644 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75df59e640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e01640f0 0x7f75e00b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1335188015 0 0) 0x7f75e01646e0 con 0x7f75e015dab0 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f75c4003520 con 0x7f75e015dab0 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7fbe91a3c640 1 --2- 172.21.15.77:0/3018706490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe840537a0 0x7fbe84053b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098a0 tx=0x7fbe8802a200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3551564a08ab8961 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f231e30f640 1 -- start start 2024-05-15T12:09:55.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7fbe90a3a640 1 -- 172.21.15.77:0/3018706490 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88037070 con 0x7fbe840537a0 2024-05-15T12:09:55.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7fbe90a3a640 1 -- 172.21.15.77:0/3018706490 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88032440 con 0x7fbe840537a0 2024-05-15T12:09:55.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7fbe90a3a640 1 -- 172.21.15.77:0/3018706490 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88037070 con 0x7fbe840537a0 2024-05-15T12:09:55.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7fc12e52f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120006a20 0x7fc120006eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f58b222a640 1 Processor -- start 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.652+0000 7f75de59c640 1 --2- 172.21.15.77:0/732427644 >> v2:172.21.15.83:3300/0 conn(0x7f75e015de90 0x7f75e0163bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3578411823 0 0) 0x7f75c4003520 con 0x7f75e015dab0 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e01640f0 msgr2=0x7f75e00b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e01640f0 0x7f75e00b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 >> v2:172.21.15.83:3300/0 conn(0x7f75e015de90 msgr2=0x7f75e0163bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 --2- 172.21.15.77:0/732427644 >> v2:172.21.15.83:3300/0 conn(0x7f75e015de90 0x7f75e0163bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e006e8d0 con 0x7f75e015dab0 2024-05-15T12:09:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f75d8001a70 con 0x7f75e015dab0 2024-05-15T12:09:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 >> v1:172.21.15.83:6789/0 conn(0x7f75e015dab0 legacy=0x7f75e006edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7fc12e52f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc120053710 con 0x7fc1200eacf0 2024-05-15T12:09:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7fc12e52f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1200539f0 con 0x7fc120005ed0 2024-05-15T12:09:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7fc12e52f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc120054320 con 0x7fc120006a20 2024-05-15T12:09:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3018706490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe840537a0 msgr2=0x7fbe84053b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7fc12d52d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc1200eacf0 0x7fc12004fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44412/0 (socket says 172.21.15.77:44412) 2024-05-15T12:09:55.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3018706490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe840537a0 0x7fbe84053b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbe880098a0 tx=0x7fbe8802a200 comp rx=0 tx=0).stop 2024-05-15T12:09:55.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc12d52d640 1 -- 172.21.15.77:0/1976059276 learned_addr learned my addr 172.21.15.77:0/1976059276 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:55.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc12dd2e640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120006a20 0x7fc120006eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517642246 0 0) 0x7fc120053710 con 0x7fc1200eacf0 2024-05-15T12:09:55.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc114003520 con 0x7fc1200eacf0 2024-05-15T12:09:55.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231e30f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 0x7f2310006eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231e30f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2310053710 con 0x7f23100eacf0 2024-05-15T12:09:55.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231e30f640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23100539f0 con 0x7f2310005ed0 2024-05-15T12:09:55.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231e30f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f2310054320 con 0x7f2310006a20 2024-05-15T12:09:55.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f58b222a640 1 -- start start 2024-05-15T12:09:55.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3018706490 shutdown_connections 2024-05-15T12:09:55.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3018706490 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe840537a0 0x7fbe84053b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3018706490 >> 172.21.15.77:0/3018706490 conn(0x7fbe8403aa30 msgr2=0x7fbe8403ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039136964 0 0) 0x7fc114003520 con 0x7fc1200eacf0 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120006a20 msgr2=0x7fc120006eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120006a20 0x7fc120006eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 >> v1:172.21.15.83:6789/0 conn(0x7fc120005ed0 legacy=0x7fc120006310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc120053cd0 con 0x7fc1200eacf0 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fc1240016f0 con 0x7fc1200eacf0 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231db0e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 0x7f2310006eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231db0e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 0x7f2310006eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:57982/0 (socket says 172.21.15.77:57982) 2024-05-15T12:09:55.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f231db0e640 1 -- 172.21.15.77:0/3965468604 learned_addr learned my addr 172.21.15.77:0/3965468604 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 >> v1:172.21.15.77:6789/0 conn(0x7fc1200eacf0 legacy=0x7fc12004fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114003a30 0x7fc114003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc114004800 0x7fc114004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc114005210 0x7fc11400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc120054320 con 0x7fc114003a30 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc11400c0f0 con 0x7fc114004800 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc11400c2f0 con 0x7fc114005210 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75c4004800 0x7f75c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c4005210 0x7f75c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75e01649c0 con 0x7f75c4005210 2024-05-15T12:09:55.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f75e006e5f0 con 0x7f75c4003a50 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f75c400c1c0 con 0x7f75c4004800 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75ded9d640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.653+0000 7f75df59e640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c4005210 0x7f75c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f75ded9d640 1 -- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75c4004800 msgr2=0x7f75c4004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f75ded9d640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75c4004800 0x7f75c4004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f75ded9d640 1 -- 172.21.15.77:0/732427644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c4005210 msgr2=0x7f75c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f75ded9d640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75c4005210 0x7f75c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.654+0000 7f75ded9d640 1 -- 172.21.15.77:0/732427644 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75c4003520 con 0x7f75c4003a50 2024-05-15T12:09:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3018706490 shutdown_connections 2024-05-15T12:09:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc114004800 0x7fc114004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12d52d640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114003a30 0x7fc114003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f963c8f0640 1 Processor -- start 2024-05-15T12:09:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58b222a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f58ac0b39e0 0x7f58ac0d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58b222a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ac0cd230 con 0x7f58ac163940 2024-05-15T12:09:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58b222a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58ac0cb600 con 0x7f58ac06a640 2024-05-15T12:09:55.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58b222a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f58ac0cf0f0 con 0x7f58ac0b39e0 2024-05-15T12:09:55.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3018706490 wait complete. 2024-05-15T12:09:55.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12dd2e640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc114005210 0x7fc11400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f963c8f0640 1 -- start start 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f231db0e640 1 -- 172.21.15.77:0/3965468604 >> v1:172.21.15.83:6789/0 conn(0x7f2310005ed0 legacy=0x7f2310006310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f231db0e640 1 -- 172.21.15.77:0/3965468604 >> v1:172.21.15.77:6789/0 conn(0x7f23100eacf0 legacy=0x7f231004fa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f231db0e640 1 -- 172.21.15.77:0/3965468604 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2310053cd0 con 0x7f2310006a20 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58aaffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f58ac06a640 0x7f58ac0cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37270/0 (socket says 172.21.15.77:37270) 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58aaffd640 1 -- 172.21.15.77:0/3298900958 learned_addr learned my addr 172.21.15.77:0/3298900958 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f58abfff640 1 --2- 172.21.15.77:0/3298900958 >> v2:172.21.15.77:3300/0 conn(0x7f58ac0b39e0 0x7f58ac0d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f75ded9d640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75c4003e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75d800a7f0 tx=0x7f75c4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f29a3fdd106333 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d800a410 con 0x7f75c4003a50 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f75ddd9b640 1 -- 172.21.15.77:0/732427644 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d802f070 con 0x7f75c4003a50 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12cd2c640 1 -- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc114005210 msgr2=0x7fc11400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc114005210 0x7fc11400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12cd2c640 1 -- 172.21.15.77:0/1976059276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114003a30 msgr2=0x7fc114003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114003a30 0x7fc114003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7fc12cd2c640 1 -- 172.21.15.77:0/1976059276 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc114003520 con 0x7fc114004800 2024-05-15T12:09:55.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.655+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4ce4004800 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009ac0 tx=0x7f4ce4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8521d80ad01cf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8036070 con 0x7f4cf0053ff0 2024-05-15T12:09:55.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f231db0e640 1 --2- 172.21.15.77:0/3965468604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 0x7f2310006eb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23140098a0 tx=0x7f231402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6674a74fcf57bcd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f4ceffff640 1 -- 172.21.15.77:0/145399239 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8031400 con 0x7f4cf0053ff0 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f58aa7fc640 1 -- 172.21.15.77:0/3298900958 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875754129 0 0) 0x7f58ac0cb600 con 0x7f58ac06a640 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f58abfff640 1 -- 172.21.15.77:0/3298900958 >> v1:172.21.15.83:6789/0 conn(0x7f58ac06a640 legacy=0x7f58ac0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f58abfff640 1 -- 172.21.15.77:0/3298900958 >> v1:172.21.15.77:6789/0 conn(0x7f58ac163940 legacy=0x7f58ac0b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f58abfff640 1 -- 172.21.15.77:0/3298900958 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac0cf340 con 0x7f58ac0b39e0 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f230ffff640 1 -- 172.21.15.77:0/3965468604 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314037070 con 0x7f2310006a20 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f230ffff640 1 -- 172.21.15.77:0/3965468604 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2314032440 con 0x7f2310006a20 2024-05-15T12:09:55.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f230ffff640 1 -- 172.21.15.77:0/3965468604 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2314032810 con 0x7f2310006a20 2024-05-15T12:09:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f75e5074640 1 -- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 msgr2=0x7f75c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f75e5074640 1 --2- 172.21.15.77:0/732427644 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75c4003e70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75d800a7f0 tx=0x7f75c4005830 comp rx=0 tx=0).stop 2024-05-15T12:09:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963c8f0640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963000b1c0 0x7f96300db280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.656+0000 7f75df59e640 1 -- 172.21.15.77:0/732427644 reap_dead start 2024-05-15T12:09:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f75e5074640 1 -- 172.21.15.77:0/732427644 shutdown_connections 2024-05-15T12:09:55.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f75e5074640 1 -- 172.21.15.77:0/732427644 >> 172.21.15.77:0/732427644 conn(0x7f75e006c3f0 msgr2=0x7f75e006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cffa64640 1 -- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 msgr2=0x7f4ce4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cffa64640 1 --2- 172.21.15.77:0/145399239 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf0053ff0 0x7f4ce4004800 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009ac0 tx=0x7f4ce4005830 comp rx=0 tx=0).stop 2024-05-15T12:09:55.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cfe001640 1 -- 172.21.15.77:0/145399239 reap_dead start 2024-05-15T12:09:55.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc114004800 0x7fc114004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1180017e0 tx=0x7fc114005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac15029c7e924d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cffa64640 1 -- 172.21.15.77:0/145399239 shutdown_connections 2024-05-15T12:09:55.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cffa64640 1 -- 172.21.15.77:0/145399239 >> 172.21.15.77:0/145399239 conn(0x7f4cf0009fe0 msgr2=0x7f4cf000a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963c8f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f96300dd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cffa64640 1 -- 172.21.15.77:0/145399239 shutdown_connections 2024-05-15T12:09:55.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118037070 con 0x7fc114004800 2024-05-15T12:09:55.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f75e5074640 1 -- 172.21.15.77:0/732427644 shutdown_connections 2024-05-15T12:09:55.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f75e5074640 1 -- 172.21.15.77:0/732427644 wait complete. 2024-05-15T12:09:55.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc11802ac30 con 0x7fc114004800 2024-05-15T12:09:55.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7fc11ffff640 1 -- 172.21.15.77:0/1976059276 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118001430 con 0x7fc114004800 2024-05-15T12:09:55.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f58abfff640 1 --2- 172.21.15.77:0/3298900958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0d0b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009a30 tx=0x7f58a002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39a48df3de8730 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7fbe93ca0640 1 Processor -- start 2024-05-15T12:09:55.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f231e30f640 1 -- 172.21.15.77:0/3965468604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 msgr2=0x7f2310006eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f231e30f640 1 --2- 172.21.15.77:0/3965468604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 0x7f2310006eb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23140098a0 tx=0x7f231402a1a0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f58aa7fc640 1 -- 172.21.15.77:0/3298900958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0037070 con 0x7f58ac0b39e0 2024-05-15T12:09:55.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f58aa7fc640 1 -- 172.21.15.77:0/3298900958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a002ad20 con 0x7f58ac0b39e0 2024-05-15T12:09:55.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f231e30f640 1 -- 172.21.15.77:0/3965468604 shutdown_connections 2024-05-15T12:09:55.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f231e30f640 1 --2- 172.21.15.77:0/3965468604 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2310006a20 0x7f2310006eb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f231e30f640 1 -- 172.21.15.77:0/3965468604 >> 172.21.15.77:0/3965468604 conn(0x7f2310009fa0 msgr2=0x7f231000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f58aa7fc640 1 -- 172.21.15.77:0/3298900958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a0032660 con 0x7f58ac0b39e0 2024-05-15T12:09:55.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963c8f0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300e0010 0x7f96300dda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963c8f0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96300e03f0 con 0x7f963003adf0 2024-05-15T12:09:55.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f231e30f640 1 -- 172.21.15.77:0/3965468604 shutdown_connections 2024-05-15T12:09:55.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963c8f0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9630053490 con 0x7f96300e0010 2024-05-15T12:09:55.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963c8f0640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f963003b600 con 0x7f963000b1c0 2024-05-15T12:09:55.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f96300dd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f96300dd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56448/0 (socket says 172.21.15.77:56448) 2024-05-15T12:09:55.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963659c640 1 -- 172.21.15.77:0/3600848695 learned_addr learned my addr 172.21.15.77:0/3600848695 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f9636d9d640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963000b1c0 0x7f96300db280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f963759e640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300e0010 0x7f96300dda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963659c640 1 -- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963000b1c0 msgr2=0x7f96300db280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963659c640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963000b1c0 0x7f96300db280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963659c640 1 -- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300e0010 msgr2=0x7f96300dda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7fc12e52f640 1 -- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc114004800 msgr2=0x7fc114004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7fc12e52f640 1 --2- 172.21.15.77:0/1976059276 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc114004800 0x7fc114004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc1180017e0 tx=0x7fc114005830 comp rx=0 tx=0).stop 2024-05-15T12:09:55.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7fc12dd2e640 1 -- 172.21.15.77:0/1976059276 reap_dead start 2024-05-15T12:09:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963659c640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300e0010 0x7f96300dda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7fc12e52f640 1 -- 172.21.15.77:0/1976059276 shutdown_connections 2024-05-15T12:09:55.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7fc12e52f640 1 -- 172.21.15.77:0/1976059276 >> 172.21.15.77:0/1976059276 conn(0x7fc120009fa0 msgr2=0x7fc12000a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963659c640 1 -- 172.21.15.77:0/3600848695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96300dc890 con 0x7f963003adf0 2024-05-15T12:09:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963759e640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300e0010 0x7f96300dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f963659c640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f96300dd500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f962c013d40 tx=0x7f962c009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c009da0 con 0x7f963003adf0 2024-05-15T12:09:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7fc12e52f640 1 -- 172.21.15.77:0/1976059276 shutdown_connections 2024-05-15T12:09:55.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.657+0000 7f4cffa64640 1 -- 172.21.15.77:0/145399239 wait complete. 2024-05-15T12:09:55.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7fc12e52f640 1 -- 172.21.15.77:0/1976059276 wait complete. 2024-05-15T12:09:55.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f962c013020 con 0x7f963003adf0 2024-05-15T12:09:55.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 -- 172.21.15.77:0/3298900958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac0b39e0 msgr2=0x7f58ac0d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 --2- 172.21.15.77:0/3298900958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0d0b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009a30 tx=0x7f58a002a2a0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c013410 con 0x7f963003adf0 2024-05-15T12:09:55.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.658+0000 7f231e30f640 1 -- 172.21.15.77:0/3965468604 wait complete. 2024-05-15T12:09:55.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 -- 172.21.15.77:0/3298900958 shutdown_connections 2024-05-15T12:09:55.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 --2- 172.21.15.77:0/3298900958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0d0b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 -- 172.21.15.77:0/3298900958 >> 172.21.15.77:0/3298900958 conn(0x7f58ac0b2ec0 msgr2=0x7f58ac0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:55.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f963c8f0640 1 -- 172.21.15.77:0/3600848695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96300dcb70 con 0x7f963003adf0 2024-05-15T12:09:55.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 -- 172.21.15.77:0/3298900958 shutdown_connections 2024-05-15T12:09:55.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f4cffa64640 1 Processor -- start 2024-05-15T12:09:55.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f963c8f0640 1 -- 172.21.15.77:0/3600848695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96300dd130 con 0x7f963003adf0 2024-05-15T12:09:55.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f4cffa64640 1 -- start start 2024-05-15T12:09:55.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f231e30f640 1 Processor -- start 2024-05-15T12:09:55.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7fc12e52f640 1 Processor -- start 2024-05-15T12:09:55.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cffa64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0053ff0 0x7f4cf00d9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9630005700 con 0x7f963003adf0 2024-05-15T12:09:55.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.660+0000 7f231e30f640 1 -- start start 2024-05-15T12:09:55.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f58b222a640 1 -- 172.21.15.77:0/3298900958 wait complete. 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cffa64640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf00d91b0 0x7f4cf00cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231e30f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2310005ed0 0x7f2310188e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231e30f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2310006a20 0x7f231002b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231e30f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23100eacf0 0x7f231002e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231e30f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f23100547b0 con 0x7f2310005ed0 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231e30f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2310050190 con 0x7f2310006a20 2024-05-15T12:09:55.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231e30f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f2310054930 con 0x7f23100eacf0 2024-05-15T12:09:55.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f58b222a640 1 Processor -- start 2024-05-15T12:09:55.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cffa64640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf0049620 0x7f4cf004a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cffa64640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0038aa0 con 0x7f4cf0053ff0 2024-05-15T12:09:55.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cffa64640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf0053390 con 0x7f4cf0049620 2024-05-15T12:09:55.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cffa64640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf0038c20 con 0x7f4cf00d91b0 2024-05-15T12:09:55.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7fc12e52f640 1 -- start start 2024-05-15T12:09:55.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7fbe93ca0640 1 -- start start 2024-05-15T12:09:55.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231db0e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23100eacf0 0x7f231002e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231db0e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23100eacf0 0x7f231002e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:58010/0 (socket says 172.21.15.77:58010) 2024-05-15T12:09:55.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f231db0e640 1 -- 172.21.15.77:0/4156740978 learned_addr learned my addr 172.21.15.77:0/4156740978 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cfd800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0053ff0 0x7f4cf00d9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cfd800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0053ff0 0x7f4cf00d9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56470/0 (socket says 172.21.15.77:56470) 2024-05-15T12:09:55.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cfd800640 1 -- 172.21.15.77:0/2739017522 learned_addr learned my addr 172.21.15.77:0/2739017522 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f58b222a640 1 -- start start 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf00d91b0 0x7f4cf00cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f4cfe001640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf0049620 0x7f4cf004a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f75e5074640 1 Processor -- start 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.659+0000 7f75e5074640 1 -- start start 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.660+0000 7f75e5074640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75e014b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.660+0000 7f75e5074640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e0147f60 0x7f75e0143c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.660+0000 7f75e5074640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 0x7f75e0162180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f75ded9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75e014b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.661+0000 7f75ded9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75e014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47836/0 (socket says 172.21.15.77:47836) 2024-05-15T12:09:55.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f75de59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e0147f60 0x7f75e0143c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f4cfcfff640 1 -- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf0049620 msgr2=0x7f4cf004a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f231d30d640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2310005ed0 0x7f2310188e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.696 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f231cb0c640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2310006a20 0x7f231002b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf0049620 0x7f4cf004a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12e52f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 0x7fc1200de700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12e52f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120180c90 0x7fc120181110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12e52f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120181650 0x7fc120034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12e52f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1200547b0 con 0x7fc114004800 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12e52f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc120050190 con 0x7fc120181650 2024-05-15T12:09:55.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12e52f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc120054930 con 0x7fc120180c90 2024-05-15T12:09:55.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f4cfcfff640 1 -- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0053ff0 msgr2=0x7f4cf00d9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0053ff0 0x7f4cf00d9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12d52d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 0x7fc1200de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f4cfcfff640 1 -- 172.21.15.77:0/2739017522 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf0048580 con 0x7f4cf00d91b0 2024-05-15T12:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7fc12d52d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 0x7fc1200de700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56480/0 (socket says 172.21.15.77:56480) 2024-05-15T12:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f58b222a640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 0x7f58ac147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f75e5074640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f75e00b2d30 con 0x7f75e0144180 2024-05-15T12:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.662+0000 7f75e5074640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f75e00b2bb0 con 0x7f75c4003a50 2024-05-15T12:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75e5074640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f75e00b2eb0 con 0x7f75e0147f60 2024-05-15T12:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe93ca0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 0x7fbe84051a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58b222a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fc12d52d640 1 -- 172.21.15.77:0/874570116 learned_addr learned my addr 172.21.15.77:0/874570116 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 0x7f75e0162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f231d30d640 1 -- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23100eacf0 msgr2=0x7f231002e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f231d30d640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23100eacf0 0x7f231002e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f231d30d640 1 -- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2310006a20 msgr2=0x7f231002b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f231d30d640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2310006a20 0x7f231002b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f231d30d640 1 -- 172.21.15.77:0/4156740978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23100e2cc0 con 0x7f2310005ed0 2024-05-15T12:09:55.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe93ca0640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe84006690 0x7fbe84179da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58b222a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac163940 0x7f58ac160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 0x7f75e0162180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56458/0 (socket says 172.21.15.77:56458) 2024-05-15T12:09:55.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 -- 172.21.15.77:0/2472059674 learned_addr learned my addr 172.21.15.77:0/2472059674 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58b222a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac0cd4b0 con 0x7f58ac163940 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58b222a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f58ac09aa30 con 0x7f58ac0b39e0 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58b222a640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f58ac163d20 con 0x7f58ac06a640 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 0x7f58ac147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe91a3c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 0x7fbe84051a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe91a3c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 0x7fbe84051a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47858/0 (socket says 172.21.15.77:47858) 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3553243658 learned_addr learned my addr 172.21.15.77:0/3553243658 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f4cfcfff640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf00d91b0 0x7f4cf00cfdf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8031000 tx=0x7f4ce8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 0x7f58ac147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:58048/0 (socket says 172.21.15.77:58048) 2024-05-15T12:09:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 -- 172.21.15.77:0/1629831714 learned_addr learned my addr 172.21.15.77:0/1629831714 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58aaffd640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840537a0 0x7fbe84052920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe9123b640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe84006690 0x7fbe84179da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84007520 con 0x7fbe840537a0 2024-05-15T12:09:55.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58abfff640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac163940 0x7f58ac160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbe84007240 con 0x7fbe84006200 2024-05-15T12:09:55.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fbe9223d640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840537a0 0x7fbe84052920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 -- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e0147f60 msgr2=0x7f75e0143c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e0147f60 0x7f75e0143c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 -- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 msgr2=0x7f75e014b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75e014b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 -- 172.21.15.77:0/2472059674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e0148400 con 0x7f75e0144180 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120180c90 0x7fc120181110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7fc12dd2e640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120181650 0x7fc120034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8040020 con 0x7f4cf00d91b0 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f962c0135b0 con 0x7f963003adf0 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 -- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58ac0b39e0 msgr2=0x7f58ac0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 -- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac163940 msgr2=0x7f58ac160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac163940 0x7f58ac160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 -- 172.21.15.77:0/1629831714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac0b5ff0 con 0x7f58ac06a640 2024-05-15T12:09:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75df59e640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 0x7f75e0162180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75e0072020 tx=0x7f75d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f58ab7fe640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 0x7f58ac147f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c7a0 tx=0x7f589c00cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f75ded9d640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75e014b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-05-15T12:09:55.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840544f0 con 0x7fbe84006690 2024-05-15T12:09:55.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f58abfff640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac163940 0x7f58ac160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:55.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f961f7fe640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96240763a0 0x7f9624078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c017070 con 0x7f58ac06a640 2024-05-15T12:09:55.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f962c097fb0 con 0x7f963003adf0 2024-05-15T12:09:55.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f9636d9d640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96240763a0 0x7f9624078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f589c005480 con 0x7f58ac06a640 2024-05-15T12:09:55.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589c0037f0 con 0x7f58ac06a640 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58ac0b62d0 con 0x7f58ac06a640 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58ac0b6890 con 0x7f58ac06a640 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7f9636d9d640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96240763a0 0x7f9624078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9628004fb0 tx=0x7f9628007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.663+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf0048860 con 0x7f4cf00d91b0 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf0048e20 con 0x7f4cf00d91b0 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8037040 con 0x7f4cf00d91b0 2024-05-15T12:09:55.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8036030 con 0x7f4cf00d91b0 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7f231d30d640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2310005ed0 0x7f2310188e30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f231806abe0 tx=0x7f2318069fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7fc12d52d640 1 -- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120180c90 msgr2=0x7fc120181110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7fc12d52d640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120180c90 0x7fc120181110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7fc12d52d640 1 -- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120181650 msgr2=0x7fc120034ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7fc12d52d640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120181650 0x7fc120034ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.664+0000 7fc12d52d640 1 -- 172.21.15.77:0/874570116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12004c560 con 0x7fc114004800 2024-05-15T12:09:55.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8005290 con 0x7f4cf00d91b0 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fc12d52d640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 0x7fc1200de700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc124001160 tx=0x7fc1240077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe84006690 msgr2=0x7fbe84179da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fbe91a3c640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe84006690 0x7fbe84179da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840537a0 msgr2=0x7fbe84052920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fbe91a3c640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840537a0 0x7fbe84052920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fbe91a3c640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe84052e60 con 0x7fbe84006200 2024-05-15T12:09:55.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58ac0768e0 con 0x7f58ac06a640 2024-05-15T12:09:55.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.665+0000 7fbe9223d640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840537a0 0x7fbe84052920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:55.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7fbe91a3c640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 0x7fbe84051a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe8802a240 tx=0x7fbe880046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88042070 con 0x7fbe84006200 2024-05-15T12:09:55.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88030750 con 0x7fbe84006200 2024-05-15T12:09:55.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f589c01a070 con 0x7f58ac06a640 2024-05-15T12:09:55.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe88037070 con 0x7fbe84006200 2024-05-15T12:09:55.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe840de0b0 con 0x7fbe84006200 2024-05-15T12:09:55.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.666+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe84050790 con 0x7fbe84006200 2024-05-15T12:09:55.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4ce8043020 con 0x7f4cf00d91b0 2024-05-15T12:09:55.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f5893fff640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5898076320 0x7f58980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f58aaffd640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5898076320 0x7f58980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f589c096ab0 con 0x7f58ac06a640 2024-05-15T12:09:55.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f4cedffb640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4cdc076350 0x7f4cdc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f4cfd800640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4cdc076350 0x7f4cdc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce80b7b30 con 0x7f4cf00d91b0 2024-05-15T12:09:55.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.667+0000 7f58aaffd640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5898076320 0x7f58980787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58ac1fc890 tx=0x7f58a40018c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.668+0000 7f4cfd800640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4cdc076350 0x7f4cdc078810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001860 tx=0x7f4cf40014b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.668+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe88045070 con 0x7fbe84006200 2024-05-15T12:09:55.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.668+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe840052b0 con 0x7fbe84006200 2024-05-15T12:09:55.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.668+0000 7fbe827fc640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe700762d0 0x7fbe70078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbe8807d290 con 0x7fbe84006200 2024-05-15T12:09:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0004020 con 0x7f75e0144180 2024-05-15T12:09:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f231806db60 con 0x7f2310005ed0 2024-05-15T12:09:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e01486e0 con 0x7f75e0144180 2024-05-15T12:09:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23100e2fa0 con 0x7f2310005ed0 2024-05-15T12:09:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231806dd20 con 0x7f2310005ed0 2024-05-15T12:09:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12400f930 con 0x7fc114004800 2024-05-15T12:09:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e0148ca0 con 0x7f75e0144180 2024-05-15T12:09:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc124018070 con 0x7fc114004800 2024-05-15T12:09:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f962c061980 con 0x7f963003adf0 2024-05-15T12:09:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12400fd10 con 0x7fc114004800 2024-05-15T12:09:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc12004c7e0 con 0x7fc114004800 2024-05-15T12:09:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7fbe9123b640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe700762d0 0x7fbe70078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318074400 con 0x7f2310005ed0 2024-05-15T12:09:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.669+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23100e3560 con 0x7f2310005ed0 2024-05-15T12:09:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.670+0000 7fbe9123b640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe700762d0 0x7fbe70078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe84176ed0 tx=0x7fbe7c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.670+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75d00041c0 con 0x7f75e0144180 2024-05-15T12:09:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.670+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0004370 con 0x7f75e0144180 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.670+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc12004cda0 con 0x7fc114004800 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.671+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23100052b0 con 0x7f2310005ed0 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.671+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f23180745a0 con 0x7f2310005ed0 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.672+0000 7f230dffb640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22fc076300 0x7f22fc0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.672+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2318112f20 con 0x7f2310005ed0 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.673+0000 7f231cb0c640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22fc076300 0x7f22fc0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.673+0000 7f231cb0c640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22fc076300 0x7f22fc0787c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23100379b0 tx=0x7f2308009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.671+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4ce804a030 con 0x7f4cf00d91b0 2024-05-15T12:09:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.671+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc005290 con 0x7f75e0144180 2024-05-15T12:09:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.672+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f75d001b030 con 0x7f75e0144180 2024-05-15T12:09:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.673+0000 7f75d77fe640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75c8076300 0x7f75c80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.673+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f75d0096d40 con 0x7f75e0144180 2024-05-15T12:09:55.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.673+0000 7f75ded9d640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75c8076300 0x7f75c80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.672+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1200052b0 con 0x7fc114004800 2024-05-15T12:09:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.674+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc12401d460 con 0x7fc114004800 2024-05-15T12:09:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.674+0000 7f75ded9d640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75c8076300 0x7f75c80787c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75d8033000 tx=0x7f75d8007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.674+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe88080ca0 con 0x7fbe84006200 2024-05-15T12:09:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.674+0000 7fc11dffb640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc10c0763a0 0x7fc10c078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.674+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc124098100 con 0x7fc114004800 2024-05-15T12:09:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.674+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc10c0763a0 0x7fc10c078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.675+0000 7fc12cd2c640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc10c0763a0 0x7fc10c078860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc114004780 tx=0x7fc11802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.675+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f58ac0cd230 con 0x7f58ac06a640 2024-05-15T12:09:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.682+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2318090030 con 0x7f2310005ed0 2024-05-15T12:09:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.691+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f75d0022020 con 0x7f75e0144180 2024-05-15T12:09:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:55.700+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc12004c560 con 0x7fc114004800 2024-05-15T12:09:56.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.040+0000 7f939080b640 1 -- 172.21.15.77:0/1791175808 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9384008f60 con 0x7f93840e74f0 2024-05-15T12:09:56.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.041+0000 7f9377fff640 1 -- 172.21.15.77:0/1791175808 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f938c0fe010 con 0x7f93840e74f0 2024-05-15T12:09:56.035 INFO:teuthology.orchestra.run.smithi077.stdout:64424509448 2024-05-15T12:09:56.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.044+0000 7f9375ffb640 1 -- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f93700763a0 msgr2=0x7f9370078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.044+0000 7f9375ffb640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f93700763a0 0x7f9370078860 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9380001cd0 tx=0x7f9380009040 comp rx=0 tx=0).stop 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.044+0000 7f9375ffb640 1 -- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93840e74f0 msgr2=0x7f93840e3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.044+0000 7f9375ffb640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93840e74f0 0x7f93840e3f70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f938c06aea0 tx=0x7f938c064250 comp rx=0 tx=0).stop 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.044+0000 7f9375ffb640 1 -- 172.21.15.77:0/1791175808 shutdown_connections 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f93700763a0 0x7f9370078860 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93840e78d0 0x7f93840cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93840e74f0 0x7f93840e3f70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 --2- 172.21.15.77:0/1791175808 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93840532b0 0x7f93840cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 -- 172.21.15.77:0/1791175808 >> 172.21.15.77:0/1791175808 conn(0x7f9384053740 msgr2=0x7f938404cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 -- 172.21.15.77:0/1791175808 shutdown_connections 2024-05-15T12:09:56.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.045+0000 7f9375ffb640 1 -- 172.21.15.77:0/1791175808 wait complete. 2024-05-15T12:09:56.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.5 2024-05-15T12:09:56.057 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.081+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbe8403e000 con 0x7fbe84006200 2024-05-15T12:09:56.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.081+0000 7fbe827fc640 1 -- 172.21.15.77:0/3553243658 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe880899c0 con 0x7fbe84006200 2024-05-15T12:09:56.076 INFO:teuthology.orchestra.run.smithi077.stdout:55834574856 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe700762d0 msgr2=0x7fbe70078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe700762d0 0x7fbe70078790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbe84176ed0 tx=0x7fbe7c009060 comp rx=0 tx=0).stop 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 msgr2=0x7fbe84051a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 0x7fbe84051a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe8802a240 tx=0x7fbe880046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 shutdown_connections 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe700762d0 0x7fbe70078790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe84006690 0x7fbe84179da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840537a0 0x7fbe84052920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 --2- 172.21.15.77:0/3553243658 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe84006200 0x7fbe84051a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 >> 172.21.15.77:0/3553243658 conn(0x7fbe8403aa30 msgr2=0x7fbe8404f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 shutdown_connections 2024-05-15T12:09:56.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.084+0000 7fbe93ca0640 1 -- 172.21.15.77:0/3553243658 wait complete. 2024-05-15T12:09:56.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.089+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f4cd8005850 con 0x7f4cf00d91b0 2024-05-15T12:09:56.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.090+0000 7f4cedffb640 1 -- 172.21.15.77:0/2739017522 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ce8080f20 con 0x7f4cf00d91b0 2024-05-15T12:09:56.085 INFO:teuthology.orchestra.run.smithi077.stdout:68719476745 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.093+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4cdc076350 msgr2=0x7f4cdc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.093+0000 7f4cffa64640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4cdc076350 0x7f4cdc078810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001860 tx=0x7f4cf40014b0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.093+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf00d91b0 msgr2=0x7f4cf00cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.093+0000 7f4cffa64640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf00d91b0 0x7f4cf00cfdf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8031000 tx=0x7f4ce8004730 comp rx=0 tx=0).stop 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 shutdown_connections 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4cdc076350 0x7f4cdc078810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4cf00d91b0 0x7f4cf00cfdf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4cf0049620 0x7f4cf004a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 --2- 172.21.15.77:0/2739017522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cf0053ff0 0x7f4cf00d9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 >> 172.21.15.77:0/2739017522 conn(0x7f4cf0009fe0 msgr2=0x7f4cf00535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 shutdown_connections 2024-05-15T12:09:56.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.094+0000 7f4cffa64640 1 -- 172.21.15.77:0/2739017522 wait complete. 2024-05-15T12:09:56.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-05-15T12:09:56.091 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.103+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f963003b920 con 0x7f963003adf0 2024-05-15T12:09:56.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.103+0000 7f961f7fe640 1 -- 172.21.15.77:0/3600848695 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f962c061280 con 0x7f963003adf0 2024-05-15T12:09:56.098 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2024-05-15T12:09:56.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.106+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f58ac0b3620 con 0x7f58ac06a640 2024-05-15T12:09:56.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.106+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96240763a0 msgr2=0x7f9624078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.106+0000 7f961d7fa640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96240763a0 0x7f9624078860 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9628004fb0 tx=0x7f9628007e30 comp rx=0 tx=0).stop 2024-05-15T12:09:56.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 msgr2=0x7f96300dd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f96300dd500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f962c013d40 tx=0x7f962c009490 comp rx=0 tx=0).stop 2024-05-15T12:09:56.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476745 got 68719476745 for osd.2 2024-05-15T12:09:56.103 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 shutdown_connections 2024-05-15T12:09:56.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96240763a0 0x7f9624078860 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96300e0010 0x7f96300dda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f963003adf0 0x7f96300dd500 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 --2- 172.21.15.77:0/3600848695 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f963000b1c0 0x7f96300db280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 >> 172.21.15.77:0/3600848695 conn(0x7f963001ef60 msgr2=0x7f96300e4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f5893fff640 1 -- 172.21.15.77:0/1629831714 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f589c05fea0 con 0x7f58ac06a640 2024-05-15T12:09:56.104 INFO:teuthology.orchestra.run.smithi077.stdout:64424509449 2024-05-15T12:09:56.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 shutdown_connections 2024-05-15T12:09:56.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f961d7fa640 1 -- 172.21.15.77:0/3600848695 wait complete. 2024-05-15T12:09:56.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.107+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f75bc005850 con 0x7f75e0144180 2024-05-15T12:09:56.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.108+0000 7f75d77fe640 1 -- 172.21.15.77:0/2472059674 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f75d0060730 con 0x7f75e0144180 2024-05-15T12:09:56.105 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2024-05-15T12:09:56.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75c8076300 msgr2=0x7f75c80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75c8076300 0x7f75c80787c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75d8033000 tx=0x7f75d8007000 comp rx=0 tx=0).stop 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 msgr2=0x7f75e0162180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 0x7f75e0162180 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f75e0072020 tx=0x7f75d000c8f0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 shutdown_connections 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f75c8076300 0x7f75c80787c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f75e0147f60 0x7f75e0143c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f75e0144180 0x7f75e0162180 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 --2- 172.21.15.77:0/2472059674 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f75c4003a50 0x7f75e014b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 >> 172.21.15.77:0/2472059674 conn(0x7f75e006c3f0 msgr2=0x7f75e006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 shutdown_connections 2024-05-15T12:09:56.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f75e5074640 1 -- 172.21.15.77:0/2472059674 wait complete. 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5898076320 msgr2=0x7f58980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5898076320 0x7f58980787e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f58ac1fc890 tx=0x7f58a40018c0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 msgr2=0x7f58ac147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 0x7f58ac147f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c7a0 tx=0x7f589c00cc60 comp rx=0 tx=0).stop 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 shutdown_connections 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5898076320 0x7f58980787e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.110+0000 7f58b222a640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f58ac163940 0x7f58ac160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.111+0000 7f58b222a640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f58ac0b39e0 0x7f58ac0b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.111+0000 7f58b222a640 1 --2- 172.21.15.77:0/1629831714 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f58ac06a640 0x7f58ac147f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.111+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 >> 172.21.15.77:0/1629831714 conn(0x7f58ac0b2ec0 msgr2=0x7f58ac162690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.111+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 shutdown_connections 2024-05-15T12:09:56.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.111+0000 7f58b222a640 1 -- 172.21.15.77:0/1629831714 wait complete. 2024-05-15T12:09:56.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.118+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f2310048060 con 0x7f2310005ed0 2024-05-15T12:09:56.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.118+0000 7f230dffb640 1 -- 172.21.15.77:0/4156740978 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f23180dc870 con 0x7f2310005ed0 2024-05-15T12:09:56.113 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2024-05-15T12:09:56.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-05-15T12:09:56.116 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.121+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc12004a0a0 con 0x7fc114004800 2024-05-15T12:09:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22fc076300 msgr2=0x7f22fc0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22fc076300 0x7f22fc0787c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23100379b0 tx=0x7f2308009040 comp rx=0 tx=0).stop 2024-05-15T12:09:56.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2310005ed0 msgr2=0x7f2310188e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2310005ed0 0x7f2310188e30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f231806abe0 tx=0x7f2318069fb0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7fc11dffb640 1 -- 172.21.15.77:0/874570116 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc124061ad0 con 0x7fc114004800 2024-05-15T12:09:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 shutdown_connections 2024-05-15T12:09:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22fc076300 0x7f22fc0787c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f23100eacf0 0x7f231002e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2310006a20 0x7f231002b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 --2- 172.21.15.77:0/4156740978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2310005ed0 0x7f2310188e30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 >> 172.21.15.77:0/4156740978 conn(0x7f2310009fa0 msgr2=0x7f23100056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.118 INFO:teuthology.orchestra.run.smithi077.stdout:60129542150 2024-05-15T12:09:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 shutdown_connections 2024-05-15T12:09:56.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.122+0000 7f231e30f640 1 -- 172.21.15.77:0/4156740978 wait complete. 2024-05-15T12:09:56.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.3 2024-05-15T12:09:56.120 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc10c0763a0 msgr2=0x7fc10c078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc10c0763a0 0x7fc10c078860 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc114004780 tx=0x7fc11802e000 comp rx=0 tx=0).stop 2024-05-15T12:09:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 msgr2=0x7fc1200de700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 0x7fc1200de700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc124001160 tx=0x7fc1240077a0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 shutdown_connections 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc10c0763a0 0x7fc10c078860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc120180c90 0x7fc120181110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120181650 0x7fc120034ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 --2- 172.21.15.77:0/874570116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc114004800 0x7fc1200de700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 >> 172.21.15.77:0/874570116 conn(0x7fc120009fa0 msgr2=0x7fc120004b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 shutdown_connections 2024-05-15T12:09:56.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.124+0000 7fc12e52f640 1 -- 172.21.15.77:0/874570116 wait complete. 2024-05-15T12:09:56.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2024-05-15T12:09:56.124 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.4 2024-05-15T12:09:56.130 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.1 2024-05-15T12:09:56.131 DEBUG:teuthology.parallel:result is None 2024-05-15T12:09:56.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T12:09:56.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:56.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.276+0000 7fb4ff904640 1 Processor -- start 2024-05-15T12:09:56.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.277+0000 7fb4ff904640 1 -- start start 2024-05-15T12:09:56.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.277+0000 7fb4ff904640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb4f80d3fd0 0x7fb4f80d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.277+0000 7fb4ff904640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4f815f840 0x7fb4f80d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.277+0000 7fb4ff904640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4f80d0dd0 con 0x7fb4f815f460 2024-05-15T12:09:56.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.277+0000 7fb4ff904640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f80d19e0 con 0x7fb4f815f840 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.277+0000 7fb4ff904640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb4f80d10b0 con 0x7fb4f80d3fd0 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4f815f840 0x7fb4f80d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4f815f840 0x7fb4f80d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56506/0 (socket says 172.21.15.77:56506) 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 -- 172.21.15.77:0/3293360717 learned_addr learned my addr 172.21.15.77:0/3293360717 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fce9f640 1 --2- 172.21.15.77:0/3293360717 >> v2:172.21.15.83:3300/0 conn(0x7fb4f80d3fd0 0x7fb4f80d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 -- 172.21.15.77:0/3293360717 >> v2:172.21.15.83:3300/0 conn(0x7fb4f80d3fd0 msgr2=0x7fb4f80d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 --2- 172.21.15.77:0/3293360717 >> v2:172.21.15.83:3300/0 conn(0x7fb4f80d3fd0 0x7fb4f80d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 -- 172.21.15.77:0/3293360717 >> v1:172.21.15.83:6789/0 conn(0x7fb4f815f460 legacy=0x7fb4f80d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 -- 172.21.15.77:0/3293360717 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f80d1390 con 0x7fb4f815f840 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.278+0000 7fb4fdea1640 1 --2- 172.21.15.77:0/3293360717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f80d05a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80b6590 tx=0x7fb4f002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f50ace4b5f2b6d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4effff640 1 -- 172.21.15.77:0/3293360717 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0036070 con 0x7fb4f815f840 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4effff640 1 -- 172.21.15.77:0/3293360717 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f0031600 con 0x7fb4f815f840 2024-05-15T12:09:56.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4effff640 1 -- 172.21.15.77:0/3293360717 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f00319d0 con 0x7fb4f815f840 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 -- 172.21.15.77:0/3293360717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 msgr2=0x7fb4f80d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 --2- 172.21.15.77:0/3293360717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f80d05a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80b6590 tx=0x7fb4f002a610 comp rx=0 tx=0).stop 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 -- 172.21.15.77:0/3293360717 shutdown_connections 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 --2- 172.21.15.77:0/3293360717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f80d05a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 --2- 172.21.15.77:0/3293360717 >> v2:172.21.15.83:3300/0 conn(0x7fb4f80d3fd0 0x7fb4f80d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 -- 172.21.15.77:0/3293360717 >> 172.21.15.77:0/3293360717 conn(0x7fb4f808ec10 msgr2=0x7fb4f809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 -- 172.21.15.77:0/3293360717 shutdown_connections 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.279+0000 7fb4ff904640 1 -- 172.21.15.77:0/3293360717 wait complete. 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.280+0000 7fb4ff904640 1 Processor -- start 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 -- start start 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f80d3fd0 0x7fb4f80ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f815f460 0x7fb4f80cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f8154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f80b4a00 con 0x7fb4f815f840 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f80d0ae0 con 0x7fb4f815f460 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4ff904640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f80b4b80 con 0x7fb4f80d3fd0 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4fdea1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f8154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4fdea1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f8154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56512/0 (socket says 172.21.15.77:56512) 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.281+0000 7fb4fdea1640 1 -- 172.21.15.77:0/2972146133 learned_addr learned my addr 172.21.15.77:0/2972146133 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fce9f640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f815f460 0x7fb4f80cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fd6a0640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f80d3fd0 0x7fb4f80ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fdea1640 1 -- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f80d3fd0 msgr2=0x7fb4f80ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fdea1640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f80d3fd0 0x7fb4f80ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fdea1640 1 -- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f815f460 msgr2=0x7fb4f80cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fdea1640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f815f460 0x7fb4f80cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fdea1640 1 -- 172.21.15.77:0/2972146133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f80c8a80 con 0x7fb4f815f840 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4fdea1640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f8154590 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009f40 tx=0x7fb4f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0036050 con 0x7fb4f815f840 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f0042070 con 0x7fb4f815f840 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f80c8d60 con 0x7fb4f815f840 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0009510 con 0x7fb4f815f840 2024-05-15T12:09:56.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.282+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f80c9320 con 0x7fb4f815f840 2024-05-15T12:09:56.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.283+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f806a640 con 0x7fb4f815f840 2024-05-15T12:09:56.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.284+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb4f0007bd0 con 0x7fb4f815f840 2024-05-15T12:09:56.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.284+0000 7fb4edffb640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4dc0762d0 0x7fb4dc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.284+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb4f00b85f0 con 0x7fb4f815f840 2024-05-15T12:09:56.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.284+0000 7fb4fd6a0640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4dc0762d0 0x7fb4dc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.285+0000 7fb4fd6a0640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4dc0762d0 0x7fb4dc078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4007fd0 tx=0x7fb4f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.289+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb4f0081f50 con 0x7fb4f815f840 2024-05-15T12:09:56.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.466+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4f80b5030 con 0x7fb4dc0762d0 2024-05-15T12:09:56.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.472+0000 7fb4edffb640 1 -- 172.21.15.77:0/2972146133 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251822 (secure 0 0 0) 0x7fb4f80b5030 con 0x7fb4dc0762d0 2024-05-15T12:09:56.469 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:56.471 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4dc0762d0 msgr2=0x7fb4dc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4dc0762d0 0x7fb4dc078790 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4007fd0 tx=0x7fb4f4009040 comp rx=0 tx=0).stop 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 msgr2=0x7fb4f8154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f8154590 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0009f40 tx=0x7fb4f0004a40 comp rx=0 tx=0).stop 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 shutdown_connections 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4dc0762d0 0x7fb4dc078790 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4f815f840 0x7fb4f8154590 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb4f815f460 0x7fb4f80cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 --2- 172.21.15.77:0/2972146133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb4f80d3fd0 0x7fb4f80ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 >> 172.21.15.77:0/2972146133 conn(0x7fb4f808ec10 msgr2=0x7fb4f80d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 shutdown_connections 2024-05-15T12:09:56.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.475+0000 7fb4ff904640 1 -- 172.21.15.77:0/2972146133 wait complete. 2024-05-15T12:09:56.481 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-15T12:09:56.246052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2924544,"data_stored":1769772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.583848"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301762+0000","last_change":"2024-05-15T12:09:43.688570+0000","last_active":"2024-05-15T12:09:45.301762+0000","last_peered":"2024-05-15T12:09:45.301762+0000","last_clean":"2024-05-15T12:09:45.301762+0000","last_became_active":"2024-05-15T12:09:43.688306+0000","last_became_peered":"2024-05-15T12:09:43.688306+0000","last_unstale":"2024-05-15T12:09:45.301762+0000","last_undegraded":"2024-05-15T12:09:45.301762+0000","last_fullsized":"2024-05-15T12:09:45.301762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:05:52.845647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665728+0000","last_change":"2024-05-15T12:09:43.684869+0000","last_active":"2024-05-15T12:09:44.665728+0000","last_peered":"2024-05-15T12:09:44.665728+0000","last_clean":"2024-05-15T12:09:44.665728+0000","last_became_active":"2024-05-15T12:09:43.684509+0000","last_became_peered":"2024-05-15T12:09:43.684509+0000","last_unstale":"2024-05-15T12:09:44.665728+0000","last_undegraded":"2024-05-15T12:09:44.665728+0000","last_fullsized":"2024-05-15T12:09:44.665728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665257+0000","last_change":"2024-05-15T12:09:43.689819+0000","last_active":"2024-05-15T12:09:44.665257+0000","last_peered":"2024-05-15T12:09:44.665257+0000","last_clean":"2024-05-15T12:09:44.665257+0000","last_became_active":"2024-05-15T12:09:43.689562+0000","last_became_peered":"2024-05-15T12:09:43.689562+0000","last_unstale":"2024-05-15T12:09:44.665257+0000","last_undegraded":"2024-05-15T12:09:44.665257+0000","last_fullsized":"2024-05-15T12:09:44.665257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570774+0000","last_change":"2024-05-15T12:09:43.682424+0000","last_active":"2024-05-15T12:09:45.570774+0000","last_peered":"2024-05-15T12:09:45.570774+0000","last_clean":"2024-05-15T12:09:45.570774+0000","last_became_active":"2024-05-15T12:09:43.680716+0000","last_became_peered":"2024-05-15T12:09:43.680716+0000","last_unstale":"2024-05-15T12:09:45.570774+0000","last_undegraded":"2024-05-15T12:09:45.570774+0000","last_fullsized":"2024-05-15T12:09:45.570774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301439+0000","last_change":"2024-05-15T12:09:43.687774+0000","last_active":"2024-05-15T12:09:45.301439+0000","last_peered":"2024-05-15T12:09:45.301439+0000","last_clean":"2024-05-15T12:09:45.301439+0000","last_became_active":"2024-05-15T12:09:43.687470+0000","last_became_peered":"2024-05-15T12:09:43.687470+0000","last_unstale":"2024-05-15T12:09:45.301439+0000","last_undegraded":"2024-05-15T12:09:45.301439+0000","last_fullsized":"2024-05-15T12:09:45.301439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570334+0000","last_change":"2024-05-15T12:09:43.679941+0000","last_active":"2024-05-15T12:09:45.570334+0000","last_peered":"2024-05-15T12:09:45.570334+0000","last_clean":"2024-05-15T12:09:45.570334+0000","last_became_active":"2024-05-15T12:09:43.679673+0000","last_became_peered":"2024-05-15T12:09:43.679673+0000","last_unstale":"2024-05-15T12:09:45.570334+0000","last_undegraded":"2024-05-15T12:09:45.570334+0000","last_fullsized":"2024-05-15T12:09:45.570334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301315+0000","last_change":"2024-05-15T12:09:43.690274+0000","last_active":"2024-05-15T12:09:45.301315+0000","last_peered":"2024-05-15T12:09:45.301315+0000","last_clean":"2024-05-15T12:09:45.301315+0000","last_became_active":"2024-05-15T12:09:43.689924+0000","last_became_peered":"2024-05-15T12:09:43.689924+0000","last_unstale":"2024-05-15T12:09:45.301315+0000","last_undegraded":"2024-05-15T12:09:45.301315+0000","last_fullsized":"2024-05-15T12:09:45.301315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664987+0000","last_change":"2024-05-15T12:09:43.687337+0000","last_active":"2024-05-15T12:09:44.664987+0000","last_peered":"2024-05-15T12:09:44.664987+0000","last_clean":"2024-05-15T12:09:44.664987+0000","last_became_active":"2024-05-15T12:09:43.687077+0000","last_became_peered":"2024-05-15T12:09:43.687077+0000","last_unstale":"2024-05-15T12:09:44.664987+0000","last_undegraded":"2024-05-15T12:09:44.664987+0000","last_fullsized":"2024-05-15T12:09:44.664987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301648+0000","last_change":"2024-05-15T12:09:43.690965+0000","last_active":"2024-05-15T12:09:45.301648+0000","last_peered":"2024-05-15T12:09:45.301648+0000","last_clean":"2024-05-15T12:09:45.301648+0000","last_became_active":"2024-05-15T12:09:43.690543+0000","last_became_peered":"2024-05-15T12:09:43.690543+0000","last_unstale":"2024-05-15T12:09:45.301648+0000","last_undegraded":"2024-05-15T12:09:45.301648+0000","last_fullsized":"2024-05-15T12:09:45.301648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:10:52.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301466+0000","last_change":"2024-05-15T12:09:43.687426+0000","last_active":"2024-05-15T12:09:45.301466+0000","last_peered":"2024-05-15T12:09:45.301466+0000","last_clean":"2024-05-15T12:09:45.301466+0000","last_became_active":"2024-05-15T12:09:43.687081+0000","last_became_peered":"2024-05-15T12:09:43.687081+0000","last_unstale":"2024-05-15T12:09:45.301466+0000","last_undegraded":"2024-05-15T12:09:45.301466+0000","last_fullsized":"2024-05-15T12:09:45.301466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:09.653727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301460+0000","last_change":"2024-05-15T12:09:43.690220+0000","last_active":"2024-05-15T12:09:45.301460+0000","last_peered":"2024-05-15T12:09:45.301460+0000","last_clean":"2024-05-15T12:09:45.301460+0000","last_became_active":"2024-05-15T12:09:43.689961+0000","last_became_peered":"2024-05-15T12:09:43.689961+0000","last_unstale":"2024-05-15T12:09:45.301460+0000","last_undegraded":"2024-05-15T12:09:45.301460+0000","last_fullsized":"2024-05-15T12:09:45.301460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:39:03.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570134+0000","last_change":"2024-05-15T12:09:43.690439+0000","last_active":"2024-05-15T12:09:45.570134+0000","last_peered":"2024-05-15T12:09:45.570134+0000","last_clean":"2024-05-15T12:09:45.570134+0000","last_became_active":"2024-05-15T12:09:43.690122+0000","last_became_peered":"2024-05-15T12:09:43.690122+0000","last_unstale":"2024-05-15T12:09:45.570134+0000","last_undegraded":"2024-05-15T12:09:45.570134+0000","last_fullsized":"2024-05-15T12:09:45.570134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569946+0000","last_change":"2024-05-15T12:09:43.677396+0000","last_active":"2024-05-15T12:09:45.569946+0000","last_peered":"2024-05-15T12:09:45.569946+0000","last_clean":"2024-05-15T12:09:45.569946+0000","last_became_active":"2024-05-15T12:09:43.677134+0000","last_became_peered":"2024-05-15T12:09:43.677134+0000","last_unstale":"2024-05-15T12:09:45.569946+0000","last_undegraded":"2024-05-15T12:09:45.569946+0000","last_fullsized":"2024-05-15T12:09:45.569946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:14.148993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664971+0000","last_change":"2024-05-15T12:09:43.692214+0000","last_active":"2024-05-15T12:09:44.664971+0000","last_peered":"2024-05-15T12:09:44.664971+0000","last_clean":"2024-05-15T12:09:44.664971+0000","last_became_active":"2024-05-15T12:09:43.691930+0000","last_became_peered":"2024-05-15T12:09:43.691930+0000","last_unstale":"2024-05-15T12:09:44.664971+0000","last_undegraded":"2024-05-15T12:09:44.664971+0000","last_fullsized":"2024-05-15T12:09:44.664971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569783+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:45.569783+0000","last_peered":"2024-05-15T12:09:45.569783+0000","last_clean":"2024-05-15T12:09:45.569783+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:45.569783+0000","last_undegraded":"2024-05-15T12:09:45.569783+0000","last_fullsized":"2024-05-15T12:09:45.569783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:46.388308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570602+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:45.570602+0000","last_peered":"2024-05-15T12:09:45.570602+0000","last_clean":"2024-05-15T12:09:45.570602+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:45.570602+0000","last_undegraded":"2024-05-15T12:09:45.570602+0000","last_fullsized":"2024-05-15T12:09:45.570602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:00.031488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569769+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:45.569769+0000","last_peered":"2024-05-15T12:09:45.569769+0000","last_clean":"2024-05-15T12:09:45.569769+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:45.569769+0000","last_undegraded":"2024-05-15T12:09:45.569769+0000","last_fullsized":"2024-05-15T12:09:45.569769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570373+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:45.570373+0000","last_peered":"2024-05-15T12:09:45.570373+0000","last_clean":"2024-05-15T12:09:45.570373+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:45.570373+0000","last_undegraded":"2024-05-15T12:09:45.570373+0000","last_fullsized":"2024-05-15T12:09:45.570373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:51:48.147256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301507+0000","last_change":"2024-05-15T12:09:43.689570+0000","last_active":"2024-05-15T12:09:45.301507+0000","last_peered":"2024-05-15T12:09:45.301507+0000","last_clean":"2024-05-15T12:09:45.301507+0000","last_became_active":"2024-05-15T12:09:43.689307+0000","last_became_peered":"2024-05-15T12:09:43.689307+0000","last_unstale":"2024-05-15T12:09:45.301507+0000","last_undegraded":"2024-05-15T12:09:45.301507+0000","last_fullsized":"2024-05-15T12:09:45.301507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:49.540352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665508+0000","last_change":"2024-05-15T12:09:43.682377+0000","last_active":"2024-05-15T12:09:44.665508+0000","last_peered":"2024-05-15T12:09:44.665508+0000","last_clean":"2024-05-15T12:09:44.665508+0000","last_became_active":"2024-05-15T12:09:43.681994+0000","last_became_peered":"2024-05-15T12:09:43.681994+0000","last_unstale":"2024-05-15T12:09:44.665508+0000","last_undegraded":"2024-05-15T12:09:44.665508+0000","last_fullsized":"2024-05-15T12:09:44.665508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569477+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:45.569477+0000","last_peered":"2024-05-15T12:09:45.569477+0000","last_clean":"2024-05-15T12:09:45.569477+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:45.569477+0000","last_undegraded":"2024-05-15T12:09:45.569477+0000","last_fullsized":"2024-05-15T12:09:45.569477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665400+0000","last_change":"2024-05-15T12:09:43.684244+0000","last_active":"2024-05-15T12:09:44.665400+0000","last_peered":"2024-05-15T12:09:44.665400+0000","last_clean":"2024-05-15T12:09:44.665400+0000","last_became_active":"2024-05-15T12:09:43.683969+0000","last_became_peered":"2024-05-15T12:09:43.683969+0000","last_unstale":"2024-05-15T12:09:44.665400+0000","last_undegraded":"2024-05-15T12:09:44.665400+0000","last_fullsized":"2024-05-15T12:09:44.665400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570957+0000","last_change":"2024-05-15T12:09:43.680234+0000","last_active":"2024-05-15T12:09:45.570957+0000","last_peered":"2024-05-15T12:09:45.570957+0000","last_clean":"2024-05-15T12:09:45.570957+0000","last_became_active":"2024-05-15T12:09:43.679005+0000","last_became_peered":"2024-05-15T12:09:43.679005+0000","last_unstale":"2024-05-15T12:09:45.570957+0000","last_undegraded":"2024-05-15T12:09:45.570957+0000","last_fullsized":"2024-05-15T12:09:45.570957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569504+0000","last_change":"2024-05-15T12:09:43.679589+0000","last_active":"2024-05-15T12:09:45.569504+0000","last_peered":"2024-05-15T12:09:45.569504+0000","last_clean":"2024-05-15T12:09:45.569504+0000","last_became_active":"2024-05-15T12:09:43.679299+0000","last_became_peered":"2024-05-15T12:09:43.679299+0000","last_unstale":"2024-05-15T12:09:45.569504+0000","last_undegraded":"2024-05-15T12:09:45.569504+0000","last_fullsized":"2024-05-15T12:09:45.569504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569877+0000","last_change":"2024-05-15T12:09:43.690523+0000","last_active":"2024-05-15T12:09:45.569877+0000","last_peered":"2024-05-15T12:09:45.569877+0000","last_clean":"2024-05-15T12:09:45.569877+0000","last_became_active":"2024-05-15T12:09:43.690212+0000","last_became_peered":"2024-05-15T12:09:43.690212+0000","last_unstale":"2024-05-15T12:09:45.569877+0000","last_undegraded":"2024-05-15T12:09:45.569877+0000","last_fullsized":"2024-05-15T12:09:45.569877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665359+0000","last_change":"2024-05-15T12:09:43.682107+0000","last_active":"2024-05-15T12:09:44.665359+0000","last_peered":"2024-05-15T12:09:44.665359+0000","last_clean":"2024-05-15T12:09:44.665359+0000","last_became_active":"2024-05-15T12:09:43.681812+0000","last_became_peered":"2024-05-15T12:09:43.681812+0000","last_unstale":"2024-05-15T12:09:44.665359+0000","last_undegraded":"2024-05-15T12:09:44.665359+0000","last_fullsized":"2024-05-15T12:09:44.665359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569621+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:45.569621+0000","last_peered":"2024-05-15T12:09:45.569621+0000","last_clean":"2024-05-15T12:09:45.569621+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:45.569621+0000","last_undegraded":"2024-05-15T12:09:45.569621+0000","last_fullsized":"2024-05-15T12:09:45.569621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:17.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569080+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:45.569080+0000","last_peered":"2024-05-15T12:09:45.569080+0000","last_clean":"2024-05-15T12:09:45.569080+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:45.569080+0000","last_undegraded":"2024-05-15T12:09:45.569080+0000","last_fullsized":"2024-05-15T12:09:45.569080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570107+0000","last_change":"2024-05-15T12:09:43.681262+0000","last_active":"2024-05-15T12:09:45.570107+0000","last_peered":"2024-05-15T12:09:45.570107+0000","last_clean":"2024-05-15T12:09:45.570107+0000","last_became_active":"2024-05-15T12:09:43.680971+0000","last_became_peered":"2024-05-15T12:09:43.680971+0000","last_unstale":"2024-05-15T12:09:45.570107+0000","last_undegraded":"2024-05-15T12:09:45.570107+0000","last_fullsized":"2024-05-15T12:09:45.570107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665379+0000","last_change":"2024-05-15T12:09:42.676644+0000","last_active":"2024-05-15T12:09:44.665379+0000","last_peered":"2024-05-15T12:09:44.665379+0000","last_clean":"2024-05-15T12:09:44.665379+0000","last_became_active":"2024-05-15T12:09:42.676347+0000","last_became_peered":"2024-05-15T12:09:42.676347+0000","last_unstale":"2024-05-15T12:09:44.665379+0000","last_undegraded":"2024-05-15T12:09:44.665379+0000","last_fullsized":"2024-05-15T12:09:44.665379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569732+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:45.569732+0000","last_peered":"2024-05-15T12:09:45.569732+0000","last_clean":"2024-05-15T12:09:45.569732+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:45.569732+0000","last_undegraded":"2024-05-15T12:09:45.569732+0000","last_fullsized":"2024-05-15T12:09:45.569732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569824+0000","last_change":"2024-05-15T12:09:42.683878+0000","last_active":"2024-05-15T12:09:45.569824+0000","last_peered":"2024-05-15T12:09:45.569824+0000","last_clean":"2024-05-15T12:09:45.569824+0000","last_became_active":"2024-05-15T12:09:42.683562+0000","last_became_peered":"2024-05-15T12:09:42.683562+0000","last_unstale":"2024-05-15T12:09:45.569824+0000","last_undegraded":"2024-05-15T12:09:45.569824+0000","last_fullsized":"2024-05-15T12:09:45.569824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665167+0000","last_change":"2024-05-15T12:09:43.683141+0000","last_active":"2024-05-15T12:09:44.665167+0000","last_peered":"2024-05-15T12:09:44.665167+0000","last_clean":"2024-05-15T12:09:44.665167+0000","last_became_active":"2024-05-15T12:09:43.682835+0000","last_became_peered":"2024-05-15T12:09:43.682835+0000","last_unstale":"2024-05-15T12:09:44.665167+0000","last_undegraded":"2024-05-15T12:09:44.665167+0000","last_fullsized":"2024-05-15T12:09:44.665167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569587+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:45.569587+0000","last_peered":"2024-05-15T12:09:45.569587+0000","last_clean":"2024-05-15T12:09:45.569587+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:45.569587+0000","last_undegraded":"2024-05-15T12:09:45.569587+0000","last_fullsized":"2024-05-15T12:09:45.569587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570969+0000","last_change":"2024-05-15T12:09:43.680034+0000","last_active":"2024-05-15T12:09:45.570969+0000","last_peered":"2024-05-15T12:09:45.570969+0000","last_clean":"2024-05-15T12:09:45.570969+0000","last_became_active":"2024-05-15T12:09:43.678658+0000","last_became_peered":"2024-05-15T12:09:43.678658+0000","last_unstale":"2024-05-15T12:09:45.570969+0000","last_undegraded":"2024-05-15T12:09:45.570969+0000","last_fullsized":"2024-05-15T12:09:45.570969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301750+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:45.301750+0000","last_peered":"2024-05-15T12:09:45.301750+0000","last_clean":"2024-05-15T12:09:45.301750+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:45.301750+0000","last_undegraded":"2024-05-15T12:09:45.301750+0000","last_fullsized":"2024-05-15T12:09:45.301750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665608+0000","last_change":"2024-05-15T12:09:43.684173+0000","last_active":"2024-05-15T12:09:44.665608+0000","last_peered":"2024-05-15T12:09:44.665608+0000","last_clean":"2024-05-15T12:09:44.665608+0000","last_became_active":"2024-05-15T12:09:43.683863+0000","last_became_peered":"2024-05-15T12:09:43.683863+0000","last_unstale":"2024-05-15T12:09:44.665608+0000","last_undegraded":"2024-05-15T12:09:44.665608+0000","last_fullsized":"2024-05-15T12:09:44.665608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569400+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:45.569400+0000","last_peered":"2024-05-15T12:09:45.569400+0000","last_clean":"2024-05-15T12:09:45.569400+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:45.569400+0000","last_undegraded":"2024-05-15T12:09:45.569400+0000","last_fullsized":"2024-05-15T12:09:45.569400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570185+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:45.570185+0000","last_peered":"2024-05-15T12:09:45.570185+0000","last_clean":"2024-05-15T12:09:45.570185+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:45.570185+0000","last_undegraded":"2024-05-15T12:09:45.570185+0000","last_fullsized":"2024-05-15T12:09:45.570185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:13.810960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570672+0000","last_change":"2024-05-15T12:09:42.670666+0000","last_active":"2024-05-15T12:09:45.570672+0000","last_peered":"2024-05-15T12:09:45.570672+0000","last_clean":"2024-05-15T12:09:45.570672+0000","last_became_active":"2024-05-15T12:09:42.669923+0000","last_became_peered":"2024-05-15T12:09:42.669923+0000","last_unstale":"2024-05-15T12:09:45.570672+0000","last_undegraded":"2024-05-15T12:09:45.570672+0000","last_fullsized":"2024-05-15T12:09:45.570672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301535+0000","last_change":"2024-05-15T12:09:43.687137+0000","last_active":"2024-05-15T12:09:45.301535+0000","last_peered":"2024-05-15T12:09:45.301535+0000","last_clean":"2024-05-15T12:09:45.301535+0000","last_became_active":"2024-05-15T12:09:43.686734+0000","last_became_peered":"2024-05-15T12:09:43.686734+0000","last_unstale":"2024-05-15T12:09:45.301535+0000","last_undegraded":"2024-05-15T12:09:45.301535+0000","last_fullsized":"2024-05-15T12:09:45.301535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:41:27.669352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569471+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:45.569471+0000","last_peered":"2024-05-15T12:09:45.569471+0000","last_clean":"2024-05-15T12:09:45.569471+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:45.569471+0000","last_undegraded":"2024-05-15T12:09:45.569471+0000","last_fullsized":"2024-05-15T12:09:45.569471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570051+0000","last_change":"2024-05-15T12:09:43.676947+0000","last_active":"2024-05-15T12:09:45.570051+0000","last_peered":"2024-05-15T12:09:45.570051+0000","last_clean":"2024-05-15T12:09:45.570051+0000","last_became_active":"2024-05-15T12:09:43.676630+0000","last_became_peered":"2024-05-15T12:09:43.676630+0000","last_unstale":"2024-05-15T12:09:45.570051+0000","last_undegraded":"2024-05-15T12:09:45.570051+0000","last_fullsized":"2024-05-15T12:09:45.570051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569792+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:45.569792+0000","last_peered":"2024-05-15T12:09:45.569792+0000","last_clean":"2024-05-15T12:09:45.569792+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:45.569792+0000","last_undegraded":"2024-05-15T12:09:45.569792+0000","last_fullsized":"2024-05-15T12:09:45.569792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569904+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:45.569904+0000","last_peered":"2024-05-15T12:09:45.569904+0000","last_clean":"2024-05-15T12:09:45.569904+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:45.569904+0000","last_undegraded":"2024-05-15T12:09:45.569904+0000","last_fullsized":"2024-05-15T12:09:45.569904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:29.858762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301233+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:45.301233+0000","last_peered":"2024-05-15T12:09:45.301233+0000","last_clean":"2024-05-15T12:09:45.301233+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:45.301233+0000","last_undegraded":"2024-05-15T12:09:45.301233+0000","last_fullsized":"2024-05-15T12:09:45.301233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569525+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:45.569525+0000","last_peered":"2024-05-15T12:09:45.569525+0000","last_clean":"2024-05-15T12:09:45.569525+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:45.569525+0000","last_undegraded":"2024-05-15T12:09:45.569525+0000","last_fullsized":"2024-05-15T12:09:45.569525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:57:51.828579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301822+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:45.301822+0000","last_peered":"2024-05-15T12:09:45.301822+0000","last_clean":"2024-05-15T12:09:45.301822+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:45.301822+0000","last_undegraded":"2024-05-15T12:09:45.301822+0000","last_fullsized":"2024-05-15T12:09:45.301822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.571120+0000","last_change":"2024-05-15T12:09:43.691593+0000","last_active":"2024-05-15T12:09:45.571120+0000","last_peered":"2024-05-15T12:09:45.571120+0000","last_clean":"2024-05-15T12:09:45.571120+0000","last_became_active":"2024-05-15T12:09:43.691327+0000","last_became_peered":"2024-05-15T12:09:43.691327+0000","last_unstale":"2024-05-15T12:09:45.571120+0000","last_undegraded":"2024-05-15T12:09:45.571120+0000","last_fullsized":"2024-05-15T12:09:45.571120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301808+0000","last_change":"2024-05-15T12:09:43.689517+0000","last_active":"2024-05-15T12:09:45.301808+0000","last_peered":"2024-05-15T12:09:45.301808+0000","last_clean":"2024-05-15T12:09:45.301808+0000","last_became_active":"2024-05-15T12:09:43.689258+0000","last_became_peered":"2024-05-15T12:09:43.689258+0000","last_unstale":"2024-05-15T12:09:45.301808+0000","last_undegraded":"2024-05-15T12:09:45.301808+0000","last_fullsized":"2024-05-15T12:09:45.301808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:47:15.314058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665387+0000","last_change":"2024-05-15T12:09:42.675771+0000","last_active":"2024-05-15T12:09:44.665387+0000","last_peered":"2024-05-15T12:09:44.665387+0000","last_clean":"2024-05-15T12:09:44.665387+0000","last_became_active":"2024-05-15T12:09:42.675470+0000","last_became_peered":"2024-05-15T12:09:42.675470+0000","last_unstale":"2024-05-15T12:09:44.665387+0000","last_undegraded":"2024-05-15T12:09:44.665387+0000","last_fullsized":"2024-05-15T12:09:44.665387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:18.831524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301647+0000","last_change":"2024-05-15T12:09:43.688535+0000","last_active":"2024-05-15T12:09:45.301647+0000","last_peered":"2024-05-15T12:09:45.301647+0000","last_clean":"2024-05-15T12:09:45.301647+0000","last_became_active":"2024-05-15T12:09:43.688274+0000","last_became_peered":"2024-05-15T12:09:43.688274+0000","last_unstale":"2024-05-15T12:09:45.301647+0000","last_undegraded":"2024-05-15T12:09:45.301647+0000","last_fullsized":"2024-05-15T12:09:45.301647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:47:15.480528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570014+0000","last_change":"2024-05-15T12:09:42.684015+0000","last_active":"2024-05-15T12:09:45.570014+0000","last_peered":"2024-05-15T12:09:45.570014+0000","last_clean":"2024-05-15T12:09:45.570014+0000","last_became_active":"2024-05-15T12:09:42.683509+0000","last_became_peered":"2024-05-15T12:09:42.683509+0000","last_unstale":"2024-05-15T12:09:45.570014+0000","last_undegraded":"2024-05-15T12:09:45.570014+0000","last_fullsized":"2024-05-15T12:09:45.570014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570287+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:45.570287+0000","last_peered":"2024-05-15T12:09:45.570287+0000","last_clean":"2024-05-15T12:09:45.570287+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:45.570287+0000","last_undegraded":"2024-05-15T12:09:45.570287+0000","last_fullsized":"2024-05-15T12:09:45.570287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:59.653626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570049+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:45.570049+0000","last_peered":"2024-05-15T12:09:45.570049+0000","last_clean":"2024-05-15T12:09:45.570049+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:45.570049+0000","last_undegraded":"2024-05-15T12:09:45.570049+0000","last_fullsized":"2024-05-15T12:09:45.570049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569733+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:45.569733+0000","last_peered":"2024-05-15T12:09:45.569733+0000","last_clean":"2024-05-15T12:09:45.569733+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:45.569733+0000","last_undegraded":"2024-05-15T12:09:45.569733+0000","last_fullsized":"2024-05-15T12:09:45.569733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569728+0000","last_change":"2024-05-15T12:09:43.681455+0000","last_active":"2024-05-15T12:09:45.569728+0000","last_peered":"2024-05-15T12:09:45.569728+0000","last_clean":"2024-05-15T12:09:45.569728+0000","last_became_active":"2024-05-15T12:09:43.681192+0000","last_became_peered":"2024-05-15T12:09:43.681192+0000","last_unstale":"2024-05-15T12:09:45.569728+0000","last_undegraded":"2024-05-15T12:09:45.569728+0000","last_fullsized":"2024-05-15T12:09:45.569728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569206+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:45.569206+0000","last_peered":"2024-05-15T12:09:45.569206+0000","last_clean":"2024-05-15T12:09:45.569206+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:45.569206+0000","last_undegraded":"2024-05-15T12:09:45.569206+0000","last_fullsized":"2024-05-15T12:09:45.569206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665688+0000","last_change":"2024-05-15T12:09:43.681676+0000","last_active":"2024-05-15T12:09:44.665688+0000","last_peered":"2024-05-15T12:09:44.665688+0000","last_clean":"2024-05-15T12:09:44.665688+0000","last_became_active":"2024-05-15T12:09:43.681405+0000","last_became_peered":"2024-05-15T12:09:43.681405+0000","last_unstale":"2024-05-15T12:09:44.665688+0000","last_undegraded":"2024-05-15T12:09:44.665688+0000","last_fullsized":"2024-05-15T12:09:44.665688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:07:48.262342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569916+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:45.569916+0000","last_peered":"2024-05-15T12:09:45.569916+0000","last_clean":"2024-05-15T12:09:45.569916+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:45.569916+0000","last_undegraded":"2024-05-15T12:09:45.569916+0000","last_fullsized":"2024-05-15T12:09:45.569916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301462+0000","last_change":"2024-05-15T12:09:43.688728+0000","last_active":"2024-05-15T12:09:45.301462+0000","last_peered":"2024-05-15T12:09:45.301462+0000","last_clean":"2024-05-15T12:09:45.301462+0000","last_became_active":"2024-05-15T12:09:43.688448+0000","last_became_peered":"2024-05-15T12:09:43.688448+0000","last_unstale":"2024-05-15T12:09:45.301462+0000","last_undegraded":"2024-05-15T12:09:45.301462+0000","last_fullsized":"2024-05-15T12:09:45.301462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:32.589878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665274+0000","last_change":"2024-05-15T12:09:42.676729+0000","last_active":"2024-05-15T12:09:44.665274+0000","last_peered":"2024-05-15T12:09:44.665274+0000","last_clean":"2024-05-15T12:09:44.665274+0000","last_became_active":"2024-05-15T12:09:42.676435+0000","last_became_peered":"2024-05-15T12:09:42.676435+0000","last_unstale":"2024-05-15T12:09:44.665274+0000","last_undegraded":"2024-05-15T12:09:44.665274+0000","last_fullsized":"2024-05-15T12:09:44.665274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570802+0000","last_change":"2024-05-15T12:09:43.683565+0000","last_active":"2024-05-15T12:09:45.570802+0000","last_peered":"2024-05-15T12:09:45.570802+0000","last_clean":"2024-05-15T12:09:45.570802+0000","last_became_active":"2024-05-15T12:09:43.683268+0000","last_became_peered":"2024-05-15T12:09:43.683268+0000","last_unstale":"2024-05-15T12:09:45.570802+0000","last_undegraded":"2024-05-15T12:09:45.570802+0000","last_fullsized":"2024-05-15T12:09:45.570802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570420+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:45.570420+0000","last_peered":"2024-05-15T12:09:45.570420+0000","last_clean":"2024-05-15T12:09:45.570420+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:45.570420+0000","last_undegraded":"2024-05-15T12:09:45.570420+0000","last_fullsized":"2024-05-15T12:09:45.570420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570045+0000","last_change":"2024-05-15T12:09:43.685808+0000","last_active":"2024-05-15T12:09:45.570045+0000","last_peered":"2024-05-15T12:09:45.570045+0000","last_clean":"2024-05-15T12:09:45.570045+0000","last_became_active":"2024-05-15T12:09:43.685355+0000","last_became_peered":"2024-05-15T12:09:43.685355+0000","last_unstale":"2024-05-15T12:09:45.570045+0000","last_undegraded":"2024-05-15T12:09:45.570045+0000","last_fullsized":"2024-05-15T12:09:45.570045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.252560+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:45.252560+0000","last_peered":"2024-05-15T12:09:45.252560+0000","last_clean":"2024-05-15T12:09:45.252560+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:45.252560+0000","last_undegraded":"2024-05-15T12:09:45.252560+0000","last_fullsized":"2024-05-15T12:09:45.252560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570594+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:45.570594+0000","last_peered":"2024-05-15T12:09:45.570594+0000","last_clean":"2024-05-15T12:09:45.570594+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:45.570594+0000","last_undegraded":"2024-05-15T12:09:45.570594+0000","last_fullsized":"2024-05-15T12:09:45.570594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301077+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:45.301077+0000","last_peered":"2024-05-15T12:09:45.301077+0000","last_clean":"2024-05-15T12:09:45.301077+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:45.301077+0000","last_undegraded":"2024-05-15T12:09:45.301077+0000","last_fullsized":"2024-05-15T12:09:45.301077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:21:15.071184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569731+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:45.569731+0000","last_peered":"2024-05-15T12:09:45.569731+0000","last_clean":"2024-05-15T12:09:45.569731+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:45.569731+0000","last_undegraded":"2024-05-15T12:09:45.569731+0000","last_fullsized":"2024-05-15T12:09:45.569731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:14.329414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570171+0000","last_change":"2024-05-15T12:09:42.677520+0000","last_active":"2024-05-15T12:09:45.570171+0000","last_peered":"2024-05-15T12:09:45.570171+0000","last_clean":"2024-05-15T12:09:45.570171+0000","last_became_active":"2024-05-15T12:09:42.677226+0000","last_became_peered":"2024-05-15T12:09:42.677226+0000","last_unstale":"2024-05-15T12:09:45.570171+0000","last_undegraded":"2024-05-15T12:09:45.570171+0000","last_fullsized":"2024-05-15T12:09:45.570171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569369+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:45.569369+0000","last_peered":"2024-05-15T12:09:45.569369+0000","last_clean":"2024-05-15T12:09:45.569369+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:45.569369+0000","last_undegraded":"2024-05-15T12:09:45.569369+0000","last_fullsized":"2024-05-15T12:09:45.569369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569625+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:45.569625+0000","last_peered":"2024-05-15T12:09:45.569625+0000","last_clean":"2024-05-15T12:09:45.569625+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:45.569625+0000","last_undegraded":"2024-05-15T12:09:45.569625+0000","last_fullsized":"2024-05-15T12:09:45.569625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569706+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:45.569706+0000","last_peered":"2024-05-15T12:09:45.569706+0000","last_clean":"2024-05-15T12:09:45.569706+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:45.569706+0000","last_undegraded":"2024-05-15T12:09:45.569706+0000","last_fullsized":"2024-05-15T12:09:45.569706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:52.672228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570220+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:45.570220+0000","last_peered":"2024-05-15T12:09:45.570220+0000","last_clean":"2024-05-15T12:09:45.570220+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:45.570220+0000","last_undegraded":"2024-05-15T12:09:45.570220+0000","last_fullsized":"2024-05-15T12:09:45.570220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:18.042253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301615+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:45.301615+0000","last_peered":"2024-05-15T12:09:45.301615+0000","last_clean":"2024-05-15T12:09:45.301615+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:45.301615+0000","last_undegraded":"2024-05-15T12:09:45.301615+0000","last_fullsized":"2024-05-15T12:09:45.301615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301605+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:45.301605+0000","last_peered":"2024-05-15T12:09:45.301605+0000","last_clean":"2024-05-15T12:09:45.301605+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:45.301605+0000","last_undegraded":"2024-05-15T12:09:45.301605+0000","last_fullsized":"2024-05-15T12:09:45.301605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.554599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665670+0000","last_change":"2024-05-15T12:09:43.684828+0000","last_active":"2024-05-15T12:09:44.665670+0000","last_peered":"2024-05-15T12:09:44.665670+0000","last_clean":"2024-05-15T12:09:44.665670+0000","last_became_active":"2024-05-15T12:09:43.684507+0000","last_became_peered":"2024-05-15T12:09:43.684507+0000","last_unstale":"2024-05-15T12:09:44.665670+0000","last_undegraded":"2024-05-15T12:09:44.665670+0000","last_fullsized":"2024-05-15T12:09:44.665670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:43:32.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665626+0000","last_change":"2024-05-15T12:09:42.673579+0000","last_active":"2024-05-15T12:09:44.665626+0000","last_peered":"2024-05-15T12:09:44.665626+0000","last_clean":"2024-05-15T12:09:44.665626+0000","last_became_active":"2024-05-15T12:09:42.673301+0000","last_became_peered":"2024-05-15T12:09:42.673301+0000","last_unstale":"2024-05-15T12:09:44.665626+0000","last_undegraded":"2024-05-15T12:09:44.665626+0000","last_fullsized":"2024-05-15T12:09:44.665626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:41.126536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665510+0000","last_change":"2024-05-15T12:09:43.686476+0000","last_active":"2024-05-15T12:09:44.665510+0000","last_peered":"2024-05-15T12:09:44.665510+0000","last_clean":"2024-05-15T12:09:44.665510+0000","last_became_active":"2024-05-15T12:09:43.684889+0000","last_became_peered":"2024-05-15T12:09:43.684889+0000","last_unstale":"2024-05-15T12:09:44.665510+0000","last_undegraded":"2024-05-15T12:09:44.665510+0000","last_fullsized":"2024-05-15T12:09:44.665510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476745,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:56.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:09:56.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.624+0000 7efd7eab4640 1 Processor -- start 2024-05-15T12:09:56.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.624+0000 7efd7eab4640 1 -- start start 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7eab4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd7813ee10 0x7efd78141730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7eab4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd78141c70 0x7efd780cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7eab4640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd780d0640 con 0x7efd780cfdc0 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7eab4640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efd781420d0 con 0x7efd7813ee10 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7eab4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efd780d0920 con 0x7efd78141c70 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd7813ee10 0x7efd78141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd7813ee10 0x7efd78141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56526/0 (socket says 172.21.15.77:56526) 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 -- 172.21.15.77:0/754477327 learned_addr learned my addr 172.21.15.77:0/754477327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd77fff640 1 --2- 172.21.15.77:0/754477327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd78141c70 0x7efd780cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 -- 172.21.15.77:0/754477327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd78141c70 msgr2=0x7efd780cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 --2- 172.21.15.77:0/754477327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd78141c70 0x7efd780cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 -- 172.21.15.77:0/754477327 >> v1:172.21.15.83:6789/0 conn(0x7efd780cfdc0 legacy=0x7efd7815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:56.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.625+0000 7efd7c850640 1 -- 172.21.15.77:0/754477327 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd780d0c00 con 0x7efd7813ee10 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.626+0000 7efd7c850640 1 --2- 172.21.15.77:0/754477327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7813ee10 0x7efd78141730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd68009870 tx=0x7efd6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1589aea5ae2bc5bb server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.626+0000 7efd777fe640 1 -- 172.21.15.77:0/754477327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68037070 con 0x7efd7813ee10 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.626+0000 7efd777fe640 1 -- 172.21.15.77:0/754477327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68032440 con 0x7efd7813ee10 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.626+0000 7efd777fe640 1 -- 172.21.15.77:0/754477327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68032810 con 0x7efd7813ee10 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 -- 172.21.15.77:0/754477327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7813ee10 msgr2=0x7efd78141730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 --2- 172.21.15.77:0/754477327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7813ee10 0x7efd78141730 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efd68009870 tx=0x7efd6802a1c0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 -- 172.21.15.77:0/754477327 shutdown_connections 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 --2- 172.21.15.77:0/754477327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd78141c70 0x7efd780cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 --2- 172.21.15.77:0/754477327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd7813ee10 0x7efd78141730 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 -- 172.21.15.77:0/754477327 >> 172.21.15.77:0/754477327 conn(0x7efd7806c810 msgr2=0x7efd7806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 -- 172.21.15.77:0/754477327 shutdown_connections 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.627+0000 7efd7eab4640 1 -- 172.21.15.77:0/754477327 wait complete. 2024-05-15T12:09:56.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.628+0000 7efd7eab4640 1 Processor -- start 2024-05-15T12:09:56.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.628+0000 7efd7eab4640 1 -- start start 2024-05-15T12:09:56.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7eab4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd780cfdc0 0x7efd781523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7eab4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd7813ee10 0x7efd78153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7eab4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 0x7efd781f31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7eab4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd780d0250 con 0x7efd78141c70 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7eab4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efd78072580 con 0x7efd780cfdc0 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7eab4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efd780d03d0 con 0x7efd7813ee10 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 0x7efd781f31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 0x7efd781f31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56534/0 (socket says 172.21.15.77:56534) 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 -- 172.21.15.77:0/2727161955 learned_addr learned my addr 172.21.15.77:0/2727161955 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd77fff640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd7813ee10 0x7efd78153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7c850640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd780cfdc0 0x7efd781523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 -- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd7813ee10 msgr2=0x7efd78153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd7813ee10 0x7efd78153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 -- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd780cfdc0 msgr2=0x7efd781523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd780cfdc0 0x7efd781523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 -- 172.21.15.77:0/2727161955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd781f3cb0 con 0x7efd78141c70 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.629+0000 7efd7d051640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 0x7efd781f31b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c410 tx=0x7efd7000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.630+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70011790 con 0x7efd78141c70 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.630+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd70017070 con 0x7efd78141c70 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.630+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd781f3f90 con 0x7efd78141c70 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.630+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd70011b70 con 0x7efd78141c70 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.630+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd78158800 con 0x7efd78141c70 2024-05-15T12:09:56.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.631+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd78158a00 con 0x7efd78141c70 2024-05-15T12:09:56.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.631+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd70011d10 con 0x7efd78141c70 2024-05-15T12:09:56.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.632+0000 7efd757fa640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd640762d0 0x7efd64078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.632+0000 7efd7c850640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd640762d0 0x7efd64078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.632+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd70097390 con 0x7efd78141c70 2024-05-15T12:09:56.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.632+0000 7efd7c850640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd640762d0 0x7efd64078790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd68034000 tx=0x7efd6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.636+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd78158a00 con 0x7efd78141c70 2024-05-15T12:09:56.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.814+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd78142490 con 0x7efd640762d0 2024-05-15T12:09:56.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.819+0000 7efd757fa640 1 -- 172.21.15.77:0/2727161955 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251822 (secure 0 0 0) 0x7efd78142490 con 0x7efd640762d0 2024-05-15T12:09:56.817 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:56.818 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd640762d0 msgr2=0x7efd64078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd640762d0 0x7efd64078790 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd68034000 tx=0x7efd6802e000 comp rx=0 tx=0).stop 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 msgr2=0x7efd781f31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 0x7efd781f31b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efd7000c410 tx=0x7efd7000c8d0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 shutdown_connections 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd640762d0 0x7efd64078790 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd7813ee10 0x7efd78153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd78141c70 0x7efd781f31b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 --2- 172.21.15.77:0/2727161955 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd780cfdc0 0x7efd781523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 >> 172.21.15.77:0/2727161955 conn(0x7efd7806c810 msgr2=0x7efd7815ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 shutdown_connections 2024-05-15T12:09:56.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.823+0000 7efd7eab4640 1 -- 172.21.15.77:0/2727161955 wait complete. 2024-05-15T12:09:56.828 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-05-15T12:09:56.246052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2856,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2924544,"data_stored":1769772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.583848"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301762+0000","last_change":"2024-05-15T12:09:43.688570+0000","last_active":"2024-05-15T12:09:45.301762+0000","last_peered":"2024-05-15T12:09:45.301762+0000","last_clean":"2024-05-15T12:09:45.301762+0000","last_became_active":"2024-05-15T12:09:43.688306+0000","last_became_peered":"2024-05-15T12:09:43.688306+0000","last_unstale":"2024-05-15T12:09:45.301762+0000","last_undegraded":"2024-05-15T12:09:45.301762+0000","last_fullsized":"2024-05-15T12:09:45.301762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:05:52.845647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665728+0000","last_change":"2024-05-15T12:09:43.684869+0000","last_active":"2024-05-15T12:09:44.665728+0000","last_peered":"2024-05-15T12:09:44.665728+0000","last_clean":"2024-05-15T12:09:44.665728+0000","last_became_active":"2024-05-15T12:09:43.684509+0000","last_became_peered":"2024-05-15T12:09:43.684509+0000","last_unstale":"2024-05-15T12:09:44.665728+0000","last_undegraded":"2024-05-15T12:09:44.665728+0000","last_fullsized":"2024-05-15T12:09:44.665728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665257+0000","last_change":"2024-05-15T12:09:43.689819+0000","last_active":"2024-05-15T12:09:44.665257+0000","last_peered":"2024-05-15T12:09:44.665257+0000","last_clean":"2024-05-15T12:09:44.665257+0000","last_became_active":"2024-05-15T12:09:43.689562+0000","last_became_peered":"2024-05-15T12:09:43.689562+0000","last_unstale":"2024-05-15T12:09:44.665257+0000","last_undegraded":"2024-05-15T12:09:44.665257+0000","last_fullsized":"2024-05-15T12:09:44.665257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:58.146319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570774+0000","last_change":"2024-05-15T12:09:43.682424+0000","last_active":"2024-05-15T12:09:45.570774+0000","last_peered":"2024-05-15T12:09:45.570774+0000","last_clean":"2024-05-15T12:09:45.570774+0000","last_became_active":"2024-05-15T12:09:43.680716+0000","last_became_peered":"2024-05-15T12:09:43.680716+0000","last_unstale":"2024-05-15T12:09:45.570774+0000","last_undegraded":"2024-05-15T12:09:45.570774+0000","last_fullsized":"2024-05-15T12:09:45.570774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301439+0000","last_change":"2024-05-15T12:09:43.687774+0000","last_active":"2024-05-15T12:09:45.301439+0000","last_peered":"2024-05-15T12:09:45.301439+0000","last_clean":"2024-05-15T12:09:45.301439+0000","last_became_active":"2024-05-15T12:09:43.687470+0000","last_became_peered":"2024-05-15T12:09:43.687470+0000","last_unstale":"2024-05-15T12:09:45.301439+0000","last_undegraded":"2024-05-15T12:09:45.301439+0000","last_fullsized":"2024-05-15T12:09:45.301439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570334+0000","last_change":"2024-05-15T12:09:43.679941+0000","last_active":"2024-05-15T12:09:45.570334+0000","last_peered":"2024-05-15T12:09:45.570334+0000","last_clean":"2024-05-15T12:09:45.570334+0000","last_became_active":"2024-05-15T12:09:43.679673+0000","last_became_peered":"2024-05-15T12:09:43.679673+0000","last_unstale":"2024-05-15T12:09:45.570334+0000","last_undegraded":"2024-05-15T12:09:45.570334+0000","last_fullsized":"2024-05-15T12:09:45.570334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301315+0000","last_change":"2024-05-15T12:09:43.690274+0000","last_active":"2024-05-15T12:09:45.301315+0000","last_peered":"2024-05-15T12:09:45.301315+0000","last_clean":"2024-05-15T12:09:45.301315+0000","last_became_active":"2024-05-15T12:09:43.689924+0000","last_became_peered":"2024-05-15T12:09:43.689924+0000","last_unstale":"2024-05-15T12:09:45.301315+0000","last_undegraded":"2024-05-15T12:09:45.301315+0000","last_fullsized":"2024-05-15T12:09:45.301315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664987+0000","last_change":"2024-05-15T12:09:43.687337+0000","last_active":"2024-05-15T12:09:44.664987+0000","last_peered":"2024-05-15T12:09:44.664987+0000","last_clean":"2024-05-15T12:09:44.664987+0000","last_became_active":"2024-05-15T12:09:43.687077+0000","last_became_peered":"2024-05-15T12:09:43.687077+0000","last_unstale":"2024-05-15T12:09:44.664987+0000","last_undegraded":"2024-05-15T12:09:44.664987+0000","last_fullsized":"2024-05-15T12:09:44.664987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:28:25.302593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663804+0000","last_change":"2024-05-15T12:09:43.667227+0000","last_active":"2024-05-15T12:09:44.663804+0000","last_peered":"2024-05-15T12:09:44.663804+0000","last_clean":"2024-05-15T12:09:44.663804+0000","last_became_active":"2024-05-15T12:09:43.666857+0000","last_became_peered":"2024-05-15T12:09:43.666857+0000","last_unstale":"2024-05-15T12:09:44.663804+0000","last_undegraded":"2024-05-15T12:09:44.663804+0000","last_fullsized":"2024-05-15T12:09:44.663804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301648+0000","last_change":"2024-05-15T12:09:43.690965+0000","last_active":"2024-05-15T12:09:45.301648+0000","last_peered":"2024-05-15T12:09:45.301648+0000","last_clean":"2024-05-15T12:09:45.301648+0000","last_became_active":"2024-05-15T12:09:43.690543+0000","last_became_peered":"2024-05-15T12:09:43.690543+0000","last_unstale":"2024-05-15T12:09:45.301648+0000","last_undegraded":"2024-05-15T12:09:45.301648+0000","last_fullsized":"2024-05-15T12:09:45.301648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:10:52.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301466+0000","last_change":"2024-05-15T12:09:43.687426+0000","last_active":"2024-05-15T12:09:45.301466+0000","last_peered":"2024-05-15T12:09:45.301466+0000","last_clean":"2024-05-15T12:09:45.301466+0000","last_became_active":"2024-05-15T12:09:43.687081+0000","last_became_peered":"2024-05-15T12:09:43.687081+0000","last_unstale":"2024-05-15T12:09:45.301466+0000","last_undegraded":"2024-05-15T12:09:45.301466+0000","last_fullsized":"2024-05-15T12:09:45.301466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:06:09.653727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301460+0000","last_change":"2024-05-15T12:09:43.690220+0000","last_active":"2024-05-15T12:09:45.301460+0000","last_peered":"2024-05-15T12:09:45.301460+0000","last_clean":"2024-05-15T12:09:45.301460+0000","last_became_active":"2024-05-15T12:09:43.689961+0000","last_became_peered":"2024-05-15T12:09:43.689961+0000","last_unstale":"2024-05-15T12:09:45.301460+0000","last_undegraded":"2024-05-15T12:09:45.301460+0000","last_fullsized":"2024-05-15T12:09:45.301460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:39:03.154852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570134+0000","last_change":"2024-05-15T12:09:43.690439+0000","last_active":"2024-05-15T12:09:45.570134+0000","last_peered":"2024-05-15T12:09:45.570134+0000","last_clean":"2024-05-15T12:09:45.570134+0000","last_became_active":"2024-05-15T12:09:43.690122+0000","last_became_peered":"2024-05-15T12:09:43.690122+0000","last_unstale":"2024-05-15T12:09:45.570134+0000","last_undegraded":"2024-05-15T12:09:45.570134+0000","last_fullsized":"2024-05-15T12:09:45.570134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:20:33.857444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569946+0000","last_change":"2024-05-15T12:09:43.677396+0000","last_active":"2024-05-15T12:09:45.569946+0000","last_peered":"2024-05-15T12:09:45.569946+0000","last_clean":"2024-05-15T12:09:45.569946+0000","last_became_active":"2024-05-15T12:09:43.677134+0000","last_became_peered":"2024-05-15T12:09:43.677134+0000","last_unstale":"2024-05-15T12:09:45.569946+0000","last_undegraded":"2024-05-15T12:09:45.569946+0000","last_fullsized":"2024-05-15T12:09:45.569946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:14.148993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.664971+0000","last_change":"2024-05-15T12:09:43.692214+0000","last_active":"2024-05-15T12:09:44.664971+0000","last_peered":"2024-05-15T12:09:44.664971+0000","last_clean":"2024-05-15T12:09:44.664971+0000","last_became_active":"2024-05-15T12:09:43.691930+0000","last_became_peered":"2024-05-15T12:09:43.691930+0000","last_unstale":"2024-05-15T12:09:44.664971+0000","last_undegraded":"2024-05-15T12:09:44.664971+0000","last_fullsized":"2024-05-15T12:09:44.664971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:28:02.761282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569783+0000","last_change":"2024-05-15T12:09:43.683112+0000","last_active":"2024-05-15T12:09:45.569783+0000","last_peered":"2024-05-15T12:09:45.569783+0000","last_clean":"2024-05-15T12:09:45.569783+0000","last_became_active":"2024-05-15T12:09:43.681468+0000","last_became_peered":"2024-05-15T12:09:43.681468+0000","last_unstale":"2024-05-15T12:09:45.569783+0000","last_undegraded":"2024-05-15T12:09:45.569783+0000","last_fullsized":"2024-05-15T12:09:45.569783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:46.388308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570602+0000","last_change":"2024-05-15T12:09:43.693492+0000","last_active":"2024-05-15T12:09:45.570602+0000","last_peered":"2024-05-15T12:09:45.570602+0000","last_clean":"2024-05-15T12:09:45.570602+0000","last_became_active":"2024-05-15T12:09:43.693030+0000","last_became_peered":"2024-05-15T12:09:43.693030+0000","last_unstale":"2024-05-15T12:09:45.570602+0000","last_undegraded":"2024-05-15T12:09:45.570602+0000","last_fullsized":"2024-05-15T12:09:45.570602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:00.031488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569769+0000","last_change":"2024-05-15T12:09:43.683405+0000","last_active":"2024-05-15T12:09:45.569769+0000","last_peered":"2024-05-15T12:09:45.569769+0000","last_clean":"2024-05-15T12:09:45.569769+0000","last_became_active":"2024-05-15T12:09:43.683076+0000","last_became_peered":"2024-05-15T12:09:43.683076+0000","last_unstale":"2024-05-15T12:09:45.569769+0000","last_undegraded":"2024-05-15T12:09:45.569769+0000","last_fullsized":"2024-05-15T12:09:45.569769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570373+0000","last_change":"2024-05-15T12:09:43.679107+0000","last_active":"2024-05-15T12:09:45.570373+0000","last_peered":"2024-05-15T12:09:45.570373+0000","last_clean":"2024-05-15T12:09:45.570373+0000","last_became_active":"2024-05-15T12:09:43.678680+0000","last_became_peered":"2024-05-15T12:09:43.678680+0000","last_unstale":"2024-05-15T12:09:45.570373+0000","last_undegraded":"2024-05-15T12:09:45.570373+0000","last_fullsized":"2024-05-15T12:09:45.570373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:51:48.147256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301507+0000","last_change":"2024-05-15T12:09:43.689570+0000","last_active":"2024-05-15T12:09:45.301507+0000","last_peered":"2024-05-15T12:09:45.301507+0000","last_clean":"2024-05-15T12:09:45.301507+0000","last_became_active":"2024-05-15T12:09:43.689307+0000","last_became_peered":"2024-05-15T12:09:43.689307+0000","last_unstale":"2024-05-15T12:09:45.301507+0000","last_undegraded":"2024-05-15T12:09:45.301507+0000","last_fullsized":"2024-05-15T12:09:45.301507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:49.540352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666081+0000","last_change":"2024-05-15T12:09:43.685746+0000","last_active":"2024-05-15T12:09:44.666081+0000","last_peered":"2024-05-15T12:09:44.666081+0000","last_clean":"2024-05-15T12:09:44.666081+0000","last_became_active":"2024-05-15T12:09:43.683693+0000","last_became_peered":"2024-05-15T12:09:43.683693+0000","last_unstale":"2024-05-15T12:09:44.666081+0000","last_undegraded":"2024-05-15T12:09:44.666081+0000","last_fullsized":"2024-05-15T12:09:44.666081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:51:06.407982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663436+0000","last_change":"2024-05-15T12:09:43.690131+0000","last_active":"2024-05-15T12:09:44.663436+0000","last_peered":"2024-05-15T12:09:44.663436+0000","last_clean":"2024-05-15T12:09:44.663436+0000","last_became_active":"2024-05-15T12:09:43.689817+0000","last_became_peered":"2024-05-15T12:09:43.689817+0000","last_unstale":"2024-05-15T12:09:44.663436+0000","last_undegraded":"2024-05-15T12:09:44.663436+0000","last_fullsized":"2024-05-15T12:09:44.663436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665508+0000","last_change":"2024-05-15T12:09:43.682377+0000","last_active":"2024-05-15T12:09:44.665508+0000","last_peered":"2024-05-15T12:09:44.665508+0000","last_clean":"2024-05-15T12:09:44.665508+0000","last_became_active":"2024-05-15T12:09:43.681994+0000","last_became_peered":"2024-05-15T12:09:43.681994+0000","last_unstale":"2024-05-15T12:09:44.665508+0000","last_undegraded":"2024-05-15T12:09:44.665508+0000","last_fullsized":"2024-05-15T12:09:44.665508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:44:28.072895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569477+0000","last_change":"2024-05-15T12:09:43.685853+0000","last_active":"2024-05-15T12:09:45.569477+0000","last_peered":"2024-05-15T12:09:45.569477+0000","last_clean":"2024-05-15T12:09:45.569477+0000","last_became_active":"2024-05-15T12:09:43.685555+0000","last_became_peered":"2024-05-15T12:09:43.685555+0000","last_unstale":"2024-05-15T12:09:45.569477+0000","last_undegraded":"2024-05-15T12:09:45.569477+0000","last_fullsized":"2024-05-15T12:09:45.569477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:00.691717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665400+0000","last_change":"2024-05-15T12:09:43.684244+0000","last_active":"2024-05-15T12:09:44.665400+0000","last_peered":"2024-05-15T12:09:44.665400+0000","last_clean":"2024-05-15T12:09:44.665400+0000","last_became_active":"2024-05-15T12:09:43.683969+0000","last_became_peered":"2024-05-15T12:09:43.683969+0000","last_unstale":"2024-05-15T12:09:44.665400+0000","last_undegraded":"2024-05-15T12:09:44.665400+0000","last_fullsized":"2024-05-15T12:09:44.665400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:13:33.829548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570957+0000","last_change":"2024-05-15T12:09:43.680234+0000","last_active":"2024-05-15T12:09:45.570957+0000","last_peered":"2024-05-15T12:09:45.570957+0000","last_clean":"2024-05-15T12:09:45.570957+0000","last_became_active":"2024-05-15T12:09:43.679005+0000","last_became_peered":"2024-05-15T12:09:43.679005+0000","last_unstale":"2024-05-15T12:09:45.570957+0000","last_undegraded":"2024-05-15T12:09:45.570957+0000","last_fullsized":"2024-05-15T12:09:45.570957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569504+0000","last_change":"2024-05-15T12:09:43.679589+0000","last_active":"2024-05-15T12:09:45.569504+0000","last_peered":"2024-05-15T12:09:45.569504+0000","last_clean":"2024-05-15T12:09:45.569504+0000","last_became_active":"2024-05-15T12:09:43.679299+0000","last_became_peered":"2024-05-15T12:09:43.679299+0000","last_unstale":"2024-05-15T12:09:45.569504+0000","last_undegraded":"2024-05-15T12:09:45.569504+0000","last_fullsized":"2024-05-15T12:09:45.569504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:19.705038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569877+0000","last_change":"2024-05-15T12:09:43.690523+0000","last_active":"2024-05-15T12:09:45.569877+0000","last_peered":"2024-05-15T12:09:45.569877+0000","last_clean":"2024-05-15T12:09:45.569877+0000","last_became_active":"2024-05-15T12:09:43.690212+0000","last_became_peered":"2024-05-15T12:09:43.690212+0000","last_unstale":"2024-05-15T12:09:45.569877+0000","last_undegraded":"2024-05-15T12:09:45.569877+0000","last_fullsized":"2024-05-15T12:09:45.569877+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665359+0000","last_change":"2024-05-15T12:09:43.682107+0000","last_active":"2024-05-15T12:09:44.665359+0000","last_peered":"2024-05-15T12:09:44.665359+0000","last_clean":"2024-05-15T12:09:44.665359+0000","last_became_active":"2024-05-15T12:09:43.681812+0000","last_became_peered":"2024-05-15T12:09:43.681812+0000","last_unstale":"2024-05-15T12:09:44.665359+0000","last_undegraded":"2024-05-15T12:09:44.665359+0000","last_fullsized":"2024-05-15T12:09:44.665359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:45:18.559560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569621+0000","last_change":"2024-05-15T12:09:43.682513+0000","last_active":"2024-05-15T12:09:45.569621+0000","last_peered":"2024-05-15T12:09:45.569621+0000","last_clean":"2024-05-15T12:09:45.569621+0000","last_became_active":"2024-05-15T12:09:43.682263+0000","last_became_peered":"2024-05-15T12:09:43.682263+0000","last_unstale":"2024-05-15T12:09:45.569621+0000","last_undegraded":"2024-05-15T12:09:45.569621+0000","last_fullsized":"2024-05-15T12:09:45.569621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:17.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569080+0000","last_change":"2024-05-15T12:09:43.675815+0000","last_active":"2024-05-15T12:09:45.569080+0000","last_peered":"2024-05-15T12:09:45.569080+0000","last_clean":"2024-05-15T12:09:45.569080+0000","last_became_active":"2024-05-15T12:09:43.675490+0000","last_became_peered":"2024-05-15T12:09:43.675490+0000","last_unstale":"2024-05-15T12:09:45.569080+0000","last_undegraded":"2024-05-15T12:09:45.569080+0000","last_fullsized":"2024-05-15T12:09:45.569080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570107+0000","last_change":"2024-05-15T12:09:43.681262+0000","last_active":"2024-05-15T12:09:45.570107+0000","last_peered":"2024-05-15T12:09:45.570107+0000","last_clean":"2024-05-15T12:09:45.570107+0000","last_became_active":"2024-05-15T12:09:43.680971+0000","last_became_peered":"2024-05-15T12:09:43.680971+0000","last_unstale":"2024-05-15T12:09:45.570107+0000","last_undegraded":"2024-05-15T12:09:45.570107+0000","last_fullsized":"2024-05-15T12:09:45.570107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:12.449186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663443+0000","last_change":"2024-05-15T12:09:43.684894+0000","last_active":"2024-05-15T12:09:44.663443+0000","last_peered":"2024-05-15T12:09:44.663443+0000","last_clean":"2024-05-15T12:09:44.663443+0000","last_became_active":"2024-05-15T12:09:43.684604+0000","last_became_peered":"2024-05-15T12:09:43.684604+0000","last_unstale":"2024-05-15T12:09:44.663443+0000","last_undegraded":"2024-05-15T12:09:44.663443+0000","last_fullsized":"2024-05-15T12:09:44.663443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665379+0000","last_change":"2024-05-15T12:09:42.676644+0000","last_active":"2024-05-15T12:09:44.665379+0000","last_peered":"2024-05-15T12:09:44.665379+0000","last_clean":"2024-05-15T12:09:44.665379+0000","last_became_active":"2024-05-15T12:09:42.676347+0000","last_became_peered":"2024-05-15T12:09:42.676347+0000","last_unstale":"2024-05-15T12:09:44.665379+0000","last_undegraded":"2024-05-15T12:09:44.665379+0000","last_fullsized":"2024-05-15T12:09:44.665379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666259+0000","last_change":"2024-05-15T12:09:43.691667+0000","last_active":"2024-05-15T12:09:44.666259+0000","last_peered":"2024-05-15T12:09:44.666259+0000","last_clean":"2024-05-15T12:09:44.666259+0000","last_became_active":"2024-05-15T12:09:43.691400+0000","last_became_peered":"2024-05-15T12:09:43.691400+0000","last_unstale":"2024-05-15T12:09:44.666259+0000","last_undegraded":"2024-05-15T12:09:44.666259+0000","last_fullsized":"2024-05-15T12:09:44.666259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:49:23.315126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569732+0000","last_change":"2024-05-15T12:09:42.686345+0000","last_active":"2024-05-15T12:09:45.569732+0000","last_peered":"2024-05-15T12:09:45.569732+0000","last_clean":"2024-05-15T12:09:45.569732+0000","last_became_active":"2024-05-15T12:09:42.686042+0000","last_became_peered":"2024-05-15T12:09:42.686042+0000","last_unstale":"2024-05-15T12:09:45.569732+0000","last_undegraded":"2024-05-15T12:09:45.569732+0000","last_fullsized":"2024-05-15T12:09:45.569732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:23.634224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569824+0000","last_change":"2024-05-15T12:09:42.683878+0000","last_active":"2024-05-15T12:09:45.569824+0000","last_peered":"2024-05-15T12:09:45.569824+0000","last_clean":"2024-05-15T12:09:45.569824+0000","last_became_active":"2024-05-15T12:09:42.683562+0000","last_became_peered":"2024-05-15T12:09:42.683562+0000","last_unstale":"2024-05-15T12:09:45.569824+0000","last_undegraded":"2024-05-15T12:09:45.569824+0000","last_fullsized":"2024-05-15T12:09:45.569824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665167+0000","last_change":"2024-05-15T12:09:43.683141+0000","last_active":"2024-05-15T12:09:44.665167+0000","last_peered":"2024-05-15T12:09:44.665167+0000","last_clean":"2024-05-15T12:09:44.665167+0000","last_became_active":"2024-05-15T12:09:43.682835+0000","last_became_peered":"2024-05-15T12:09:43.682835+0000","last_unstale":"2024-05-15T12:09:44.665167+0000","last_undegraded":"2024-05-15T12:09:44.665167+0000","last_fullsized":"2024-05-15T12:09:44.665167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:42.233627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569587+0000","last_change":"2024-05-15T12:09:42.677109+0000","last_active":"2024-05-15T12:09:45.569587+0000","last_peered":"2024-05-15T12:09:45.569587+0000","last_clean":"2024-05-15T12:09:45.569587+0000","last_became_active":"2024-05-15T12:09:42.675739+0000","last_became_peered":"2024-05-15T12:09:42.675739+0000","last_unstale":"2024-05-15T12:09:45.569587+0000","last_undegraded":"2024-05-15T12:09:45.569587+0000","last_fullsized":"2024-05-15T12:09:45.569587+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:34.849414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666678+0000","last_change":"2024-05-15T12:09:43.674294+0000","last_active":"2024-05-15T12:09:44.666678+0000","last_peered":"2024-05-15T12:09:44.666678+0000","last_clean":"2024-05-15T12:09:44.666678+0000","last_became_active":"2024-05-15T12:09:43.673998+0000","last_became_peered":"2024-05-15T12:09:43.673998+0000","last_unstale":"2024-05-15T12:09:44.666678+0000","last_undegraded":"2024-05-15T12:09:44.666678+0000","last_fullsized":"2024-05-15T12:09:44.666678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:18.494888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663768+0000","last_change":"2024-05-15T12:09:42.668376+0000","last_active":"2024-05-15T12:09:44.663768+0000","last_peered":"2024-05-15T12:09:44.663768+0000","last_clean":"2024-05-15T12:09:44.663768+0000","last_became_active":"2024-05-15T12:09:42.668048+0000","last_became_peered":"2024-05-15T12:09:42.668048+0000","last_unstale":"2024-05-15T12:09:44.663768+0000","last_undegraded":"2024-05-15T12:09:44.663768+0000","last_fullsized":"2024-05-15T12:09:44.663768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:53:10.682215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570969+0000","last_change":"2024-05-15T12:09:43.680034+0000","last_active":"2024-05-15T12:09:45.570969+0000","last_peered":"2024-05-15T12:09:45.570969+0000","last_clean":"2024-05-15T12:09:45.570969+0000","last_became_active":"2024-05-15T12:09:43.678658+0000","last_became_peered":"2024-05-15T12:09:43.678658+0000","last_unstale":"2024-05-15T12:09:45.570969+0000","last_undegraded":"2024-05-15T12:09:45.570969+0000","last_fullsized":"2024-05-15T12:09:45.570969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301750+0000","last_change":"2024-05-15T12:09:42.679600+0000","last_active":"2024-05-15T12:09:45.301750+0000","last_peered":"2024-05-15T12:09:45.301750+0000","last_clean":"2024-05-15T12:09:45.301750+0000","last_became_active":"2024-05-15T12:09:42.679293+0000","last_became_peered":"2024-05-15T12:09:42.679293+0000","last_unstale":"2024-05-15T12:09:45.301750+0000","last_undegraded":"2024-05-15T12:09:45.301750+0000","last_fullsized":"2024-05-15T12:09:45.301750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665608+0000","last_change":"2024-05-15T12:09:43.684173+0000","last_active":"2024-05-15T12:09:44.665608+0000","last_peered":"2024-05-15T12:09:44.665608+0000","last_clean":"2024-05-15T12:09:44.665608+0000","last_became_active":"2024-05-15T12:09:43.683863+0000","last_became_peered":"2024-05-15T12:09:43.683863+0000","last_unstale":"2024-05-15T12:09:44.665608+0000","last_undegraded":"2024-05-15T12:09:44.665608+0000","last_fullsized":"2024-05-15T12:09:44.665608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:12:24.839656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569400+0000","last_change":"2024-05-15T12:09:42.677183+0000","last_active":"2024-05-15T12:09:45.569400+0000","last_peered":"2024-05-15T12:09:45.569400+0000","last_clean":"2024-05-15T12:09:45.569400+0000","last_became_active":"2024-05-15T12:09:42.676875+0000","last_became_peered":"2024-05-15T12:09:42.676875+0000","last_unstale":"2024-05-15T12:09:45.569400+0000","last_undegraded":"2024-05-15T12:09:45.569400+0000","last_fullsized":"2024-05-15T12:09:45.569400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:24:33.625460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570185+0000","last_change":"2024-05-15T12:09:43.681981+0000","last_active":"2024-05-15T12:09:45.570185+0000","last_peered":"2024-05-15T12:09:45.570185+0000","last_clean":"2024-05-15T12:09:45.570185+0000","last_became_active":"2024-05-15T12:09:43.681599+0000","last_became_peered":"2024-05-15T12:09:43.681599+0000","last_unstale":"2024-05-15T12:09:45.570185+0000","last_undegraded":"2024-05-15T12:09:45.570185+0000","last_fullsized":"2024-05-15T12:09:45.570185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:13.810960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570672+0000","last_change":"2024-05-15T12:09:42.670666+0000","last_active":"2024-05-15T12:09:45.570672+0000","last_peered":"2024-05-15T12:09:45.570672+0000","last_clean":"2024-05-15T12:09:45.570672+0000","last_became_active":"2024-05-15T12:09:42.669923+0000","last_became_peered":"2024-05-15T12:09:42.669923+0000","last_unstale":"2024-05-15T12:09:45.570672+0000","last_undegraded":"2024-05-15T12:09:45.570672+0000","last_fullsized":"2024-05-15T12:09:45.570672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301535+0000","last_change":"2024-05-15T12:09:43.687137+0000","last_active":"2024-05-15T12:09:45.301535+0000","last_peered":"2024-05-15T12:09:45.301535+0000","last_clean":"2024-05-15T12:09:45.301535+0000","last_became_active":"2024-05-15T12:09:43.686734+0000","last_became_peered":"2024-05-15T12:09:43.686734+0000","last_unstale":"2024-05-15T12:09:45.301535+0000","last_undegraded":"2024-05-15T12:09:45.301535+0000","last_fullsized":"2024-05-15T12:09:45.301535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:41:27.669352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569471+0000","last_change":"2024-05-15T12:09:42.683998+0000","last_active":"2024-05-15T12:09:45.569471+0000","last_peered":"2024-05-15T12:09:45.569471+0000","last_clean":"2024-05-15T12:09:45.569471+0000","last_became_active":"2024-05-15T12:09:42.683643+0000","last_became_peered":"2024-05-15T12:09:42.683643+0000","last_unstale":"2024-05-15T12:09:45.569471+0000","last_undegraded":"2024-05-15T12:09:45.569471+0000","last_fullsized":"2024-05-15T12:09:45.569471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570051+0000","last_change":"2024-05-15T12:09:43.676947+0000","last_active":"2024-05-15T12:09:45.570051+0000","last_peered":"2024-05-15T12:09:45.570051+0000","last_clean":"2024-05-15T12:09:45.570051+0000","last_became_active":"2024-05-15T12:09:43.676630+0000","last_became_peered":"2024-05-15T12:09:43.676630+0000","last_unstale":"2024-05-15T12:09:45.570051+0000","last_undegraded":"2024-05-15T12:09:45.570051+0000","last_fullsized":"2024-05-15T12:09:45.570051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:06:47.274245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569792+0000","last_change":"2024-05-15T12:09:42.678677+0000","last_active":"2024-05-15T12:09:45.569792+0000","last_peered":"2024-05-15T12:09:45.569792+0000","last_clean":"2024-05-15T12:09:45.569792+0000","last_became_active":"2024-05-15T12:09:42.678410+0000","last_became_peered":"2024-05-15T12:09:42.678410+0000","last_unstale":"2024-05-15T12:09:45.569792+0000","last_undegraded":"2024-05-15T12:09:45.569792+0000","last_fullsized":"2024-05-15T12:09:45.569792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:51:18.695686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569904+0000","last_change":"2024-05-15T12:09:43.693213+0000","last_active":"2024-05-15T12:09:45.569904+0000","last_peered":"2024-05-15T12:09:45.569904+0000","last_clean":"2024-05-15T12:09:45.569904+0000","last_became_active":"2024-05-15T12:09:43.692757+0000","last_became_peered":"2024-05-15T12:09:43.692757+0000","last_unstale":"2024-05-15T12:09:45.569904+0000","last_undegraded":"2024-05-15T12:09:45.569904+0000","last_fullsized":"2024-05-15T12:09:45.569904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:06:29.858762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301233+0000","last_change":"2024-05-15T12:09:42.684205+0000","last_active":"2024-05-15T12:09:45.301233+0000","last_peered":"2024-05-15T12:09:45.301233+0000","last_clean":"2024-05-15T12:09:45.301233+0000","last_became_active":"2024-05-15T12:09:42.683925+0000","last_became_peered":"2024-05-15T12:09:42.683925+0000","last_unstale":"2024-05-15T12:09:45.301233+0000","last_undegraded":"2024-05-15T12:09:45.301233+0000","last_fullsized":"2024-05-15T12:09:45.301233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663484+0000","last_change":"2024-05-15T12:09:43.686589+0000","last_active":"2024-05-15T12:09:44.663484+0000","last_peered":"2024-05-15T12:09:44.663484+0000","last_clean":"2024-05-15T12:09:44.663484+0000","last_became_active":"2024-05-15T12:09:43.686293+0000","last_became_peered":"2024-05-15T12:09:43.686293+0000","last_unstale":"2024-05-15T12:09:44.663484+0000","last_undegraded":"2024-05-15T12:09:44.663484+0000","last_fullsized":"2024-05-15T12:09:44.663484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:18:24.643576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665850+0000","last_change":"2024-05-15T12:09:42.669574+0000","last_active":"2024-05-15T12:09:44.665850+0000","last_peered":"2024-05-15T12:09:44.665850+0000","last_clean":"2024-05-15T12:09:44.665850+0000","last_became_active":"2024-05-15T12:09:42.669285+0000","last_became_peered":"2024-05-15T12:09:42.669285+0000","last_unstale":"2024-05-15T12:09:44.665850+0000","last_undegraded":"2024-05-15T12:09:44.665850+0000","last_fullsized":"2024-05-15T12:09:44.665850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569525+0000","last_change":"2024-05-15T12:09:43.681232+0000","last_active":"2024-05-15T12:09:45.569525+0000","last_peered":"2024-05-15T12:09:45.569525+0000","last_clean":"2024-05-15T12:09:45.569525+0000","last_became_active":"2024-05-15T12:09:43.680949+0000","last_became_peered":"2024-05-15T12:09:43.680949+0000","last_unstale":"2024-05-15T12:09:45.569525+0000","last_undegraded":"2024-05-15T12:09:45.569525+0000","last_fullsized":"2024-05-15T12:09:45.569525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:57:51.828579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301822+0000","last_change":"2024-05-15T12:09:42.682909+0000","last_active":"2024-05-15T12:09:45.301822+0000","last_peered":"2024-05-15T12:09:45.301822+0000","last_clean":"2024-05-15T12:09:45.301822+0000","last_became_active":"2024-05-15T12:09:42.682595+0000","last_became_peered":"2024-05-15T12:09:42.682595+0000","last_unstale":"2024-05-15T12:09:45.301822+0000","last_undegraded":"2024-05-15T12:09:45.301822+0000","last_fullsized":"2024-05-15T12:09:45.301822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:35:41.584459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.571120+0000","last_change":"2024-05-15T12:09:43.691593+0000","last_active":"2024-05-15T12:09:45.571120+0000","last_peered":"2024-05-15T12:09:45.571120+0000","last_clean":"2024-05-15T12:09:45.571120+0000","last_became_active":"2024-05-15T12:09:43.691327+0000","last_became_peered":"2024-05-15T12:09:43.691327+0000","last_unstale":"2024-05-15T12:09:45.571120+0000","last_undegraded":"2024-05-15T12:09:45.571120+0000","last_fullsized":"2024-05-15T12:09:45.571120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:16.508247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666409+0000","last_change":"2024-05-15T12:09:42.676676+0000","last_active":"2024-05-15T12:09:44.666409+0000","last_peered":"2024-05-15T12:09:44.666409+0000","last_clean":"2024-05-15T12:09:44.666409+0000","last_became_active":"2024-05-15T12:09:42.676301+0000","last_became_peered":"2024-05-15T12:09:42.676301+0000","last_unstale":"2024-05-15T12:09:44.666409+0000","last_undegraded":"2024-05-15T12:09:44.666409+0000","last_fullsized":"2024-05-15T12:09:44.666409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301808+0000","last_change":"2024-05-15T12:09:43.689517+0000","last_active":"2024-05-15T12:09:45.301808+0000","last_peered":"2024-05-15T12:09:45.301808+0000","last_clean":"2024-05-15T12:09:45.301808+0000","last_became_active":"2024-05-15T12:09:43.689258+0000","last_became_peered":"2024-05-15T12:09:43.689258+0000","last_unstale":"2024-05-15T12:09:45.301808+0000","last_undegraded":"2024-05-15T12:09:45.301808+0000","last_fullsized":"2024-05-15T12:09:45.301808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:47:15.314058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665387+0000","last_change":"2024-05-15T12:09:42.675771+0000","last_active":"2024-05-15T12:09:44.665387+0000","last_peered":"2024-05-15T12:09:44.665387+0000","last_clean":"2024-05-15T12:09:44.665387+0000","last_became_active":"2024-05-15T12:09:42.675470+0000","last_became_peered":"2024-05-15T12:09:42.675470+0000","last_unstale":"2024-05-15T12:09:44.665387+0000","last_undegraded":"2024-05-15T12:09:44.665387+0000","last_fullsized":"2024-05-15T12:09:44.665387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:21:18.831524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301647+0000","last_change":"2024-05-15T12:09:43.688535+0000","last_active":"2024-05-15T12:09:45.301647+0000","last_peered":"2024-05-15T12:09:45.301647+0000","last_clean":"2024-05-15T12:09:45.301647+0000","last_became_active":"2024-05-15T12:09:43.688274+0000","last_became_peered":"2024-05-15T12:09:43.688274+0000","last_unstale":"2024-05-15T12:09:45.301647+0000","last_undegraded":"2024-05-15T12:09:45.301647+0000","last_fullsized":"2024-05-15T12:09:45.301647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:47:15.480528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570014+0000","last_change":"2024-05-15T12:09:42.684015+0000","last_active":"2024-05-15T12:09:45.570014+0000","last_peered":"2024-05-15T12:09:45.570014+0000","last_clean":"2024-05-15T12:09:45.570014+0000","last_became_active":"2024-05-15T12:09:42.683509+0000","last_became_peered":"2024-05-15T12:09:42.683509+0000","last_unstale":"2024-05-15T12:09:45.570014+0000","last_undegraded":"2024-05-15T12:09:45.570014+0000","last_fullsized":"2024-05-15T12:09:45.570014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:08:10.733709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570287+0000","last_change":"2024-05-15T12:09:43.671485+0000","last_active":"2024-05-15T12:09:45.570287+0000","last_peered":"2024-05-15T12:09:45.570287+0000","last_clean":"2024-05-15T12:09:45.570287+0000","last_became_active":"2024-05-15T12:09:43.670677+0000","last_became_peered":"2024-05-15T12:09:43.670677+0000","last_unstale":"2024-05-15T12:09:45.570287+0000","last_undegraded":"2024-05-15T12:09:45.570287+0000","last_fullsized":"2024-05-15T12:09:45.570287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:59.653626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663326+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:09:44.663326+0000","last_peered":"2024-05-15T12:09:44.663326+0000","last_clean":"2024-05-15T12:09:44.663326+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:09:44.663326+0000","last_undegraded":"2024-05-15T12:09:44.663326+0000","last_fullsized":"2024-05-15T12:09:44.663326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570049+0000","last_change":"2024-05-15T12:09:42.675437+0000","last_active":"2024-05-15T12:09:45.570049+0000","last_peered":"2024-05-15T12:09:45.570049+0000","last_clean":"2024-05-15T12:09:45.570049+0000","last_became_active":"2024-05-15T12:09:42.675116+0000","last_became_peered":"2024-05-15T12:09:42.675116+0000","last_unstale":"2024-05-15T12:09:45.570049+0000","last_undegraded":"2024-05-15T12:09:45.570049+0000","last_fullsized":"2024-05-15T12:09:45.570049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:15.981266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666110+0000","last_change":"2024-05-15T12:09:43.680653+0000","last_active":"2024-05-15T12:09:44.666110+0000","last_peered":"2024-05-15T12:09:44.666110+0000","last_clean":"2024-05-15T12:09:44.666110+0000","last_became_active":"2024-05-15T12:09:43.679768+0000","last_became_peered":"2024-05-15T12:09:43.679768+0000","last_unstale":"2024-05-15T12:09:44.666110+0000","last_undegraded":"2024-05-15T12:09:44.666110+0000","last_fullsized":"2024-05-15T12:09:44.666110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:42:37.797249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569733+0000","last_change":"2024-05-15T12:09:42.677732+0000","last_active":"2024-05-15T12:09:45.569733+0000","last_peered":"2024-05-15T12:09:45.569733+0000","last_clean":"2024-05-15T12:09:45.569733+0000","last_became_active":"2024-05-15T12:09:42.677466+0000","last_became_peered":"2024-05-15T12:09:42.677466+0000","last_unstale":"2024-05-15T12:09:45.569733+0000","last_undegraded":"2024-05-15T12:09:45.569733+0000","last_fullsized":"2024-05-15T12:09:45.569733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:34.837005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569728+0000","last_change":"2024-05-15T12:09:43.681455+0000","last_active":"2024-05-15T12:09:45.569728+0000","last_peered":"2024-05-15T12:09:45.569728+0000","last_clean":"2024-05-15T12:09:45.569728+0000","last_became_active":"2024-05-15T12:09:43.681192+0000","last_became_peered":"2024-05-15T12:09:43.681192+0000","last_unstale":"2024-05-15T12:09:45.569728+0000","last_undegraded":"2024-05-15T12:09:45.569728+0000","last_fullsized":"2024-05-15T12:09:45.569728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:27:35.846357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569206+0000","last_change":"2024-05-15T12:09:42.677431+0000","last_active":"2024-05-15T12:09:45.569206+0000","last_peered":"2024-05-15T12:09:45.569206+0000","last_clean":"2024-05-15T12:09:45.569206+0000","last_became_active":"2024-05-15T12:09:42.677127+0000","last_became_peered":"2024-05-15T12:09:42.677127+0000","last_unstale":"2024-05-15T12:09:45.569206+0000","last_undegraded":"2024-05-15T12:09:45.569206+0000","last_fullsized":"2024-05-15T12:09:45.569206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665688+0000","last_change":"2024-05-15T12:09:43.681676+0000","last_active":"2024-05-15T12:09:44.665688+0000","last_peered":"2024-05-15T12:09:44.665688+0000","last_clean":"2024-05-15T12:09:44.665688+0000","last_became_active":"2024-05-15T12:09:43.681405+0000","last_became_peered":"2024-05-15T12:09:43.681405+0000","last_unstale":"2024-05-15T12:09:44.665688+0000","last_undegraded":"2024-05-15T12:09:44.665688+0000","last_fullsized":"2024-05-15T12:09:44.665688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:07:48.262342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569916+0000","last_change":"2024-05-15T12:09:42.678300+0000","last_active":"2024-05-15T12:09:45.569916+0000","last_peered":"2024-05-15T12:09:45.569916+0000","last_clean":"2024-05-15T12:09:45.569916+0000","last_became_active":"2024-05-15T12:09:42.677923+0000","last_became_peered":"2024-05-15T12:09:42.677923+0000","last_unstale":"2024-05-15T12:09:45.569916+0000","last_undegraded":"2024-05-15T12:09:45.569916+0000","last_fullsized":"2024-05-15T12:09:45.569916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:51:15.498895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301462+0000","last_change":"2024-05-15T12:09:43.688728+0000","last_active":"2024-05-15T12:09:45.301462+0000","last_peered":"2024-05-15T12:09:45.301462+0000","last_clean":"2024-05-15T12:09:45.301462+0000","last_became_active":"2024-05-15T12:09:43.688448+0000","last_became_peered":"2024-05-15T12:09:43.688448+0000","last_unstale":"2024-05-15T12:09:45.301462+0000","last_undegraded":"2024-05-15T12:09:45.301462+0000","last_fullsized":"2024-05-15T12:09:45.301462+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:47:32.589878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665274+0000","last_change":"2024-05-15T12:09:42.676729+0000","last_active":"2024-05-15T12:09:44.665274+0000","last_peered":"2024-05-15T12:09:44.665274+0000","last_clean":"2024-05-15T12:09:44.665274+0000","last_became_active":"2024-05-15T12:09:42.676435+0000","last_became_peered":"2024-05-15T12:09:42.676435+0000","last_unstale":"2024-05-15T12:09:44.665274+0000","last_undegraded":"2024-05-15T12:09:44.665274+0000","last_fullsized":"2024-05-15T12:09:44.665274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570802+0000","last_change":"2024-05-15T12:09:43.683565+0000","last_active":"2024-05-15T12:09:45.570802+0000","last_peered":"2024-05-15T12:09:45.570802+0000","last_clean":"2024-05-15T12:09:45.570802+0000","last_became_active":"2024-05-15T12:09:43.683268+0000","last_became_peered":"2024-05-15T12:09:43.683268+0000","last_unstale":"2024-05-15T12:09:45.570802+0000","last_undegraded":"2024-05-15T12:09:45.570802+0000","last_fullsized":"2024-05-15T12:09:45.570802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570420+0000","last_change":"2024-05-15T12:09:42.679552+0000","last_active":"2024-05-15T12:09:45.570420+0000","last_peered":"2024-05-15T12:09:45.570420+0000","last_clean":"2024-05-15T12:09:45.570420+0000","last_became_active":"2024-05-15T12:09:42.679234+0000","last_became_peered":"2024-05-15T12:09:42.679234+0000","last_unstale":"2024-05-15T12:09:45.570420+0000","last_undegraded":"2024-05-15T12:09:45.570420+0000","last_fullsized":"2024-05-15T12:09:45.570420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:45:13.139640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570045+0000","last_change":"2024-05-15T12:09:43.685808+0000","last_active":"2024-05-15T12:09:45.570045+0000","last_peered":"2024-05-15T12:09:45.570045+0000","last_clean":"2024-05-15T12:09:45.570045+0000","last_became_active":"2024-05-15T12:09:43.685355+0000","last_became_peered":"2024-05-15T12:09:43.685355+0000","last_unstale":"2024-05-15T12:09:45.570045+0000","last_undegraded":"2024-05-15T12:09:45.570045+0000","last_fullsized":"2024-05-15T12:09:45.570045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:33:34.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.252560+0000","last_change":"2024-05-15T12:09:42.680338+0000","last_active":"2024-05-15T12:09:45.252560+0000","last_peered":"2024-05-15T12:09:45.252560+0000","last_clean":"2024-05-15T12:09:45.252560+0000","last_became_active":"2024-05-15T12:09:42.680038+0000","last_became_peered":"2024-05-15T12:09:42.680038+0000","last_unstale":"2024-05-15T12:09:45.252560+0000","last_undegraded":"2024-05-15T12:09:45.252560+0000","last_fullsized":"2024-05-15T12:09:45.252560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:53:18.539628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666479+0000","last_change":"2024-05-15T12:09:43.677589+0000","last_active":"2024-05-15T12:09:44.666479+0000","last_peered":"2024-05-15T12:09:44.666479+0000","last_clean":"2024-05-15T12:09:44.666479+0000","last_became_active":"2024-05-15T12:09:43.677300+0000","last_became_peered":"2024-05-15T12:09:43.677300+0000","last_unstale":"2024-05-15T12:09:44.666479+0000","last_undegraded":"2024-05-15T12:09:44.666479+0000","last_fullsized":"2024-05-15T12:09:44.666479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:07:55.902807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570594+0000","last_change":"2024-05-15T12:09:42.683928+0000","last_active":"2024-05-15T12:09:45.570594+0000","last_peered":"2024-05-15T12:09:45.570594+0000","last_clean":"2024-05-15T12:09:45.570594+0000","last_became_active":"2024-05-15T12:09:42.683609+0000","last_became_peered":"2024-05-15T12:09:42.683609+0000","last_unstale":"2024-05-15T12:09:45.570594+0000","last_undegraded":"2024-05-15T12:09:45.570594+0000","last_fullsized":"2024-05-15T12:09:45.570594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:11.439833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666362+0000","last_change":"2024-05-15T12:09:43.679014+0000","last_active":"2024-05-15T12:09:44.666362+0000","last_peered":"2024-05-15T12:09:44.666362+0000","last_clean":"2024-05-15T12:09:44.666362+0000","last_became_active":"2024-05-15T12:09:43.678754+0000","last_became_peered":"2024-05-15T12:09:43.678754+0000","last_unstale":"2024-05-15T12:09:44.666362+0000","last_undegraded":"2024-05-15T12:09:44.666362+0000","last_fullsized":"2024-05-15T12:09:44.666362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:01:54.147864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301077+0000","last_change":"2024-05-15T12:09:42.688750+0000","last_active":"2024-05-15T12:09:45.301077+0000","last_peered":"2024-05-15T12:09:45.301077+0000","last_clean":"2024-05-15T12:09:45.301077+0000","last_became_active":"2024-05-15T12:09:42.688502+0000","last_became_peered":"2024-05-15T12:09:42.688502+0000","last_unstale":"2024-05-15T12:09:45.301077+0000","last_undegraded":"2024-05-15T12:09:45.301077+0000","last_fullsized":"2024-05-15T12:09:45.301077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:21:15.071184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569731+0000","last_change":"2024-05-15T12:09:43.674325+0000","last_active":"2024-05-15T12:09:45.569731+0000","last_peered":"2024-05-15T12:09:45.569731+0000","last_clean":"2024-05-15T12:09:45.569731+0000","last_became_active":"2024-05-15T12:09:43.674070+0000","last_became_peered":"2024-05-15T12:09:43.674070+0000","last_unstale":"2024-05-15T12:09:45.569731+0000","last_undegraded":"2024-05-15T12:09:45.569731+0000","last_fullsized":"2024-05-15T12:09:45.569731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:14.329414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666519+0000","last_change":"2024-05-15T12:09:42.683328+0000","last_active":"2024-05-15T12:09:44.666519+0000","last_peered":"2024-05-15T12:09:44.666519+0000","last_clean":"2024-05-15T12:09:44.666519+0000","last_became_active":"2024-05-15T12:09:42.682985+0000","last_became_peered":"2024-05-15T12:09:42.682985+0000","last_unstale":"2024-05-15T12:09:44.666519+0000","last_undegraded":"2024-05-15T12:09:44.666519+0000","last_fullsized":"2024-05-15T12:09:44.666519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:00:49.567432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665945+0000","last_change":"2024-05-15T12:09:43.680582+0000","last_active":"2024-05-15T12:09:44.665945+0000","last_peered":"2024-05-15T12:09:44.665945+0000","last_clean":"2024-05-15T12:09:44.665945+0000","last_became_active":"2024-05-15T12:09:43.678199+0000","last_became_peered":"2024-05-15T12:09:43.678199+0000","last_unstale":"2024-05-15T12:09:44.665945+0000","last_undegraded":"2024-05-15T12:09:44.665945+0000","last_fullsized":"2024-05-15T12:09:44.665945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:46:29.174357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570171+0000","last_change":"2024-05-15T12:09:42.677520+0000","last_active":"2024-05-15T12:09:45.570171+0000","last_peered":"2024-05-15T12:09:45.570171+0000","last_clean":"2024-05-15T12:09:45.570171+0000","last_became_active":"2024-05-15T12:09:42.677226+0000","last_became_peered":"2024-05-15T12:09:42.677226+0000","last_unstale":"2024-05-15T12:09:45.570171+0000","last_undegraded":"2024-05-15T12:09:45.570171+0000","last_fullsized":"2024-05-15T12:09:45.570171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:36:04.145824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569369+0000","last_change":"2024-05-15T12:09:43.680974+0000","last_active":"2024-05-15T12:09:45.569369+0000","last_peered":"2024-05-15T12:09:45.569369+0000","last_clean":"2024-05-15T12:09:45.569369+0000","last_became_active":"2024-05-15T12:09:43.680626+0000","last_became_peered":"2024-05-15T12:09:43.680626+0000","last_unstale":"2024-05-15T12:09:45.569369+0000","last_undegraded":"2024-05-15T12:09:45.569369+0000","last_fullsized":"2024-05-15T12:09:45.569369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:31:16.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569625+0000","last_change":"2024-05-15T12:09:42.676630+0000","last_active":"2024-05-15T12:09:45.569625+0000","last_peered":"2024-05-15T12:09:45.569625+0000","last_clean":"2024-05-15T12:09:45.569625+0000","last_became_active":"2024-05-15T12:09:42.675938+0000","last_became_peered":"2024-05-15T12:09:42.675938+0000","last_unstale":"2024-05-15T12:09:45.569625+0000","last_undegraded":"2024-05-15T12:09:45.569625+0000","last_fullsized":"2024-05-15T12:09:45.569625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:53:13.298935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.569706+0000","last_change":"2024-05-15T12:09:43.669824+0000","last_active":"2024-05-15T12:09:45.569706+0000","last_peered":"2024-05-15T12:09:45.569706+0000","last_clean":"2024-05-15T12:09:45.569706+0000","last_became_active":"2024-05-15T12:09:43.669538+0000","last_became_peered":"2024-05-15T12:09:43.669538+0000","last_unstale":"2024-05-15T12:09:45.569706+0000","last_undegraded":"2024-05-15T12:09:45.569706+0000","last_fullsized":"2024-05-15T12:09:45.569706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:52.672228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.570220+0000","last_change":"2024-05-15T12:09:43.689267+0000","last_active":"2024-05-15T12:09:45.570220+0000","last_peered":"2024-05-15T12:09:45.570220+0000","last_clean":"2024-05-15T12:09:45.570220+0000","last_became_active":"2024-05-15T12:09:43.688980+0000","last_became_peered":"2024-05-15T12:09:43.688980+0000","last_unstale":"2024-05-15T12:09:45.570220+0000","last_undegraded":"2024-05-15T12:09:45.570220+0000","last_fullsized":"2024-05-15T12:09:45.570220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:18.042253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301615+0000","last_change":"2024-05-15T12:09:42.679474+0000","last_active":"2024-05-15T12:09:45.301615+0000","last_peered":"2024-05-15T12:09:45.301615+0000","last_clean":"2024-05-15T12:09:45.301615+0000","last_became_active":"2024-05-15T12:09:42.679185+0000","last_became_peered":"2024-05-15T12:09:42.679185+0000","last_unstale":"2024-05-15T12:09:45.301615+0000","last_undegraded":"2024-05-15T12:09:45.301615+0000","last_fullsized":"2024-05-15T12:09:45.301615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:08:37.784945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.663593+0000","last_change":"2024-05-15T12:09:43.692529+0000","last_active":"2024-05-15T12:09:44.663593+0000","last_peered":"2024-05-15T12:09:44.663593+0000","last_clean":"2024-05-15T12:09:44.663593+0000","last_became_active":"2024-05-15T12:09:43.691910+0000","last_became_peered":"2024-05-15T12:09:43.691910+0000","last_unstale":"2024-05-15T12:09:44.663593+0000","last_undegraded":"2024-05-15T12:09:44.663593+0000","last_fullsized":"2024-05-15T12:09:44.663593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:22:35.858767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:45.301605+0000","last_change":"2024-05-15T12:09:42.682720+0000","last_active":"2024-05-15T12:09:45.301605+0000","last_peered":"2024-05-15T12:09:45.301605+0000","last_clean":"2024-05-15T12:09:45.301605+0000","last_became_active":"2024-05-15T12:09:42.682421+0000","last_became_peered":"2024-05-15T12:09:42.682421+0000","last_unstale":"2024-05-15T12:09:45.301605+0000","last_undegraded":"2024-05-15T12:09:45.301605+0000","last_fullsized":"2024-05-15T12:09:45.301605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:13:01.554599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665670+0000","last_change":"2024-05-15T12:09:43.684828+0000","last_active":"2024-05-15T12:09:44.665670+0000","last_peered":"2024-05-15T12:09:44.665670+0000","last_clean":"2024-05-15T12:09:44.665670+0000","last_became_active":"2024-05-15T12:09:43.684507+0000","last_became_peered":"2024-05-15T12:09:43.684507+0000","last_unstale":"2024-05-15T12:09:44.665670+0000","last_undegraded":"2024-05-15T12:09:44.665670+0000","last_fullsized":"2024-05-15T12:09:44.665670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:43:32.889981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665626+0000","last_change":"2024-05-15T12:09:42.673579+0000","last_active":"2024-05-15T12:09:44.665626+0000","last_peered":"2024-05-15T12:09:44.665626+0000","last_clean":"2024-05-15T12:09:44.665626+0000","last_became_active":"2024-05-15T12:09:42.673301+0000","last_became_peered":"2024-05-15T12:09:42.673301+0000","last_unstale":"2024-05-15T12:09:44.665626+0000","last_undegraded":"2024-05-15T12:09:44.665626+0000","last_fullsized":"2024-05-15T12:09:44.665626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:15:41.126536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.665510+0000","last_change":"2024-05-15T12:09:43.686476+0000","last_active":"2024-05-15T12:09:44.665510+0000","last_peered":"2024-05-15T12:09:44.665510+0000","last_clean":"2024-05-15T12:09:44.665510+0000","last_became_active":"2024-05-15T12:09:43.684889+0000","last_became_peered":"2024-05-15T12:09:43.684889+0000","last_unstale":"2024-05-15T12:09:44.665510+0000","last_undegraded":"2024-05-15T12:09:44.665510+0000","last_fullsized":"2024-05-15T12:09:44.665510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:42.654322+0000","last_clean_scrub_stamp":"2024-05-15T12:09:42.654322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:06:15.930022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-05-15T12:09:44.666544+0000","last_change":"2024-05-15T12:09:42.679700+0000","last_active":"2024-05-15T12:09:44.666544+0000","last_peered":"2024-05-15T12:09:44.666544+0000","last_clean":"2024-05-15T12:09:44.666544+0000","last_became_active":"2024-05-15T12:09:42.679429+0000","last_became_peered":"2024-05-15T12:09:42.679429+0000","last_unstale":"2024-05-15T12:09:44.666544+0000","last_undegraded":"2024-05-15T12:09:44.666544+0000","last_fullsized":"2024-05-15T12:09:44.666544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:41.644969+0000","last_clean_scrub_stamp":"2024-05-15T12:09:41.644969+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:41:43.721113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476745,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":74639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":73151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":75311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":73609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":663465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":73083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:09:56.832 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T12:09:56.832 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-15T12:09:56.832 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-15T12:09:56.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-15T12:09:56.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.973+0000 7f575b81d640 1 Processor -- start 2024-05-15T12:09:56.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.973+0000 7f575b81d640 1 -- start start 2024-05-15T12:09:56.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f575b81d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f5754071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f575b81d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5754072170 0x7f57540cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f575b81d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f57540cff20 0x7f575406e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f575b81d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5754148ef0 con 0x7f5754072170 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f575b81d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5754072680 con 0x7f57540cff20 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f575b81d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5754072960 con 0x7f5754148b10 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5754072170 0x7f57540cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5754072170 0x7f57540cf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56536/0 (socket says 172.21.15.77:56536) 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 -- 172.21.15.77:0/1691472586 learned_addr learned my addr 172.21.15.77:0/1691472586 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f57595b9640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f5754071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5759dba640 1 --2- 172.21.15.77:0/1691472586 >> v2:172.21.15.83:3300/0 conn(0x7f57540cff20 0x7f575406e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 -- 172.21.15.77:0/1691472586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 msgr2=0x7f5754071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f5754071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 -- 172.21.15.77:0/1691472586 >> v2:172.21.15.83:3300/0 conn(0x7f57540cff20 msgr2=0x7f575406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 --2- 172.21.15.77:0/1691472586 >> v2:172.21.15.83:3300/0 conn(0x7f57540cff20 0x7f575406e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f5758db8640 1 -- 172.21.15.77:0/1691472586 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575406dbb0 con 0x7f5754072170 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.974+0000 7f57595b9640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f5754071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f5758db8640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f57540cf9e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5754074070 tx=0x7f574402a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4143f7faa95330 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f574bfff640 1 -- 172.21.15.77:0/1691472586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744037070 con 0x7f5754072170 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f574bfff640 1 -- 172.21.15.77:0/1691472586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574402ae00 con 0x7f5754072170 2024-05-15T12:09:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f574bfff640 1 -- 172.21.15.77:0/1691472586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744032660 con 0x7f5754072170 2024-05-15T12:09:56.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 -- 172.21.15.77:0/1691472586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 msgr2=0x7f57540cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f57540cf9e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5754074070 tx=0x7f574402a0b0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 -- 172.21.15.77:0/1691472586 shutdown_connections 2024-05-15T12:09:56.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 --2- 172.21.15.77:0/1691472586 >> v2:172.21.15.83:3300/0 conn(0x7f57540cff20 0x7f575406e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f57540cf9e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 --2- 172.21.15.77:0/1691472586 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f5754071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.975+0000 7f575b81d640 1 -- 172.21.15.77:0/1691472586 >> 172.21.15.77:0/1691472586 conn(0x7f57540d2fd0 msgr2=0x7f57540d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.976+0000 7f575b81d640 1 -- 172.21.15.77:0/1691472586 shutdown_connections 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.976+0000 7f575b81d640 1 -- 172.21.15.77:0/1691472586 wait complete. 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 Processor -- start 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 -- start start 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f575415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57540cff20 0x7f57540cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f57541e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57540b6280 con 0x7f5754072170 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f57540b6100 con 0x7f57540cff20 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.977+0000 7f575b81d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f575406e8d0 con 0x7f5754148b10 2024-05-15T12:09:56.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f575415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f575415e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56550/0 (socket says 172.21.15.77:56550) 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 -- 172.21.15.77:0/3806506738 learned_addr learned my addr 172.21.15.77:0/3806506738 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f5758db8640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57540cff20 0x7f57540cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f5759dba640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f57541e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 -- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 msgr2=0x7f57541e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f57541e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 -- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57540cff20 msgr2=0x7f57540cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57540cff20 0x7f57540cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 -- 172.21.15.77:0/3806506738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57540cc2c0 con 0x7f5754072170 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f57595b9640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f575415e990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f575000d800 tx=0x7f575000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750004030 con 0x7f5754072170 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57500041d0 con 0x7f5754072170 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57540cc5a0 con 0x7f5754072170 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57500096a0 con 0x7f5754072170 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.978+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57540ccb60 con 0x7f5754072170 2024-05-15T12:09:56.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.979+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575406a640 con 0x7f5754072170 2024-05-15T12:09:56.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.980+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5750009840 con 0x7f5754072170 2024-05-15T12:09:56.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.980+0000 7f5749ffb640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f57380762d0 0x7f5738078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:56.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.981+0000 7f5758db8640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f57380762d0 0x7f5738078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:56.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.981+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f57500978e0 con 0x7f5754072170 2024-05-15T12:09:56.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.981+0000 7f5758db8640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f57380762d0 0x7f5738078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5744034000 tx=0x7f574402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:56.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:56.985+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5750061240 con 0x7f5754072170 2024-05-15T12:09:57.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.204+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5754071510 con 0x7f5754072170 2024-05-15T12:09:57.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.205+0000 7f5749ffb640 1 -- 172.21.15.77:0/3806506738 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f5750060b40 con 0x7f5754072170 2024-05-15T12:09:57.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:57.200 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f57380762d0 msgr2=0x7f5738078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f57380762d0 0x7f5738078790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5744034000 tx=0x7f574402e000 comp rx=0 tx=0).stop 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 msgr2=0x7f575415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f575415e990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f575000d800 tx=0x7f575000dcc0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 shutdown_connections 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f57380762d0 0x7f5738078790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5754148b10 0x7f57541e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f57540cff20 0x7f57540cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 --2- 172.21.15.77:0/3806506738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5754072170 0x7f575415e990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 >> 172.21.15.77:0/3806506738 conn(0x7f57540d2fd0 msgr2=0x7f57540706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 shutdown_connections 2024-05-15T12:09:57.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.207+0000 7f575b81d640 1 -- 172.21.15.77:0/3806506738 wait complete. 2024-05-15T12:09:57.212 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-15T12:09:57.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:09:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.318+0000 7f6efabc8640 1 Processor -- start 2024-05-15T12:09:57.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.318+0000 7f6efabc8640 1 -- start start 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6efabc8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f6ef415d520 0x7f6ef4071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6efabc8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef4143150 0x7f6ef40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6efabc8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef41435b0 con 0x7f6ef4070c30 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6efabc8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef4071060 con 0x7f6ef415d520 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6efabc8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef4072210 con 0x7f6ef4143150 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6ef9165640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6ef4070c30 0x7f6ef4160bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44434/0 (socket says 172.21.15.77:44434) 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6ef9165640 1 -- 172.21.15.77:0/1816346653 learned_addr learned my addr 172.21.15.77:0/1816346653 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1816346653 >> v2:172.21.15.83:3300/0 conn(0x7f6ef415d520 0x7f6ef4071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eebfff640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef4143150 0x7f6ef40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682969849 0 0) 0x7f6ef41435b0 con 0x7f6ef4070c30 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6edc003520 con 0x7f6ef4070c30 2024-05-15T12:09:57.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815849571 0 0) 0x7f6edc003520 con 0x7f6ef4070c30 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef4143150 msgr2=0x7f6ef40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef4143150 0x7f6ef40706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 >> v2:172.21.15.83:3300/0 conn(0x7f6ef415d520 msgr2=0x7f6ef4071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.319+0000 7f6eeb7fe640 1 --2- 172.21.15.77:0/1816346653 >> v2:172.21.15.83:3300/0 conn(0x7f6ef415d520 0x7f6ef4071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef40724f0 con 0x7f6ef4070c30 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f6eec001a70 con 0x7f6ef4070c30 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 >> v1:172.21.15.77:6789/0 conn(0x7f6ef4070c30 legacy=0x7f6ef4160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6edc003a70 0x7f6edc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc004800 0x7f6edc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6edc0051c0 0x7f6edc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4071060 con 0x7f6edc003a70 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4072210 con 0x7f6edc004800 2024-05-15T12:09:57.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f6edc00bfb0 con 0x7f6edc0051c0 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1816346653 >> v2:172.21.15.83:3300/0 conn(0x7f6ef415d520 0x7f6ef4071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eebfff640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef4143150 0x7f6ef40706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6edc003a70 0x7f6edc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef9165640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6edc0051c0 0x7f6edc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6eebfff640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc004800 0x7f6edc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 -- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6edc0051c0 msgr2=0x7f6edc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6edc0051c0 0x7f6edc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 -- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc004800 msgr2=0x7f6edc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc004800 0x7f6edc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.320+0000 7f6ef8964640 1 -- 172.21.15.77:0/1816346653 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6edc003520 con 0x7f6edc003a70 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6edc003a70 0x7f6edc003e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009c70 tx=0x7f6edc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8900519243d7a246 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0009840 con 0x7f6edc003a70 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ef0004020 con 0x7f6edc003a70 2024-05-15T12:09:57.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6eeb7fe640 1 -- 172.21.15.77:0/1816346653 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef00043d0 con 0x7f6edc003a70 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6efabc8640 1 -- 172.21.15.77:0/1816346653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6edc003a70 msgr2=0x7f6edc003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1816346653 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6edc003a70 0x7f6edc003e90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009c70 tx=0x7f6edc005830 comp rx=0 tx=0).stop 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6ef9165640 1 -- 172.21.15.77:0/1816346653 reap_dead start 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6efabc8640 1 -- 172.21.15.77:0/1816346653 shutdown_connections 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6efabc8640 1 -- 172.21.15.77:0/1816346653 >> 172.21.15.77:0/1816346653 conn(0x7f6ef40d2fd0 msgr2=0x7f6ef40d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6efabc8640 1 -- 172.21.15.77:0/1816346653 shutdown_connections 2024-05-15T12:09:57.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.321+0000 7f6efabc8640 1 -- 172.21.15.77:0/1816346653 wait complete. 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 Processor -- start 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 -- start start 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc003a70 0x7f6ef41f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 0x7f6ef41598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef41e8970 0x7f6ef4159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef415d900 con 0x7f6ef41e84f0 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef4072ab0 con 0x7f6edc003a70 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.323+0000 7f6efabc8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef40d18c0 con 0x7f6ef41e8970 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 0x7f6ef41598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 0x7f6ef41598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56574/0 (socket says 172.21.15.77:56574) 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 -- 172.21.15.77:0/1436017936 learned_addr learned my addr 172.21.15.77:0/1436017936 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc003a70 0x7f6ef41f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6ef9165640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef41e8970 0x7f6ef4159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 -- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef41e8970 msgr2=0x7f6ef4159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef41e8970 0x7f6ef4159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 -- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc003a70 msgr2=0x7f6ef41f2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc003a70 0x7f6ef41f2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 -- 172.21.15.77:0/1436017936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef4154f50 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6eebfff640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 0x7f6ef41598b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4011c00 tx=0x7f6ee400f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400fca0 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee400fe40 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef4155230 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4014640 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.324+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef41557f0 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.325+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef406a640 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.326+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6ee4012040 con 0x7f6ef41e84f0 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.326+0000 7f6ee97fa640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6ee00762d0 0x7f6ee0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.326+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6ee4097c70 con 0x7f6ef41e84f0 2024-05-15T12:09:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.326+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6ee00762d0 0x7f6ee0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.327+0000 7f6ef8964640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6ee00762d0 0x7f6ee0078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0032000 tx=0x7f6ef0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.331+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6ee4019030 con 0x7f6ef41e84f0 2024-05-15T12:09:57.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.544+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ef40b6190 con 0x7f6ef41e84f0 2024-05-15T12:09:57.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.544+0000 7f6ee97fa640 1 -- 172.21.15.77:0/1436017936 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f6ee4060f80 con 0x7f6ef41e84f0 2024-05-15T12:09:57.539 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:57.540 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:09:57.540 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:09:57.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.546+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6ee00762d0 msgr2=0x7f6ee0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.546+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6ee00762d0 0x7f6ee0078790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0032000 tx=0x7f6ef0008030 comp rx=0 tx=0).stop 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.546+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 msgr2=0x7f6ef41598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.546+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 0x7f6ef41598b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4011c00 tx=0x7f6ee400f610 comp rx=0 tx=0).stop 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 shutdown_connections 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6ee00762d0 0x7f6ee0078790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6ef41e8970 0x7f6ef4159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6ef41e84f0 0x7f6ef41598b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 --2- 172.21.15.77:0/1436017936 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6edc003a70 0x7f6ef41f2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 >> 172.21.15.77:0/1436017936 conn(0x7f6ef40d2fd0 msgr2=0x7f6ef415c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:57.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 shutdown_connections 2024-05-15T12:09:57.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.547+0000 7f6efabc8640 1 -- 172.21.15.77:0/1436017936 wait complete. 2024-05-15T12:09:57.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:09:57.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.657+0000 7ff338946640 1 Processor -- start 2024-05-15T12:09:57.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.657+0000 7ff338946640 1 -- start start 2024-05-15T12:09:57.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.658+0000 7ff338946640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff3340d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.658+0000 7ff338946640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff33415f840 0x7ff3340d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.658+0000 7ff338946640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3340d0dd0 con 0x7ff33415f460 2024-05-15T12:09:57.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.658+0000 7ff338946640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff3340d19e0 con 0x7ff33415f840 2024-05-15T12:09:57.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.658+0000 7ff338946640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340d10b0 con 0x7ff3340d3fd0 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff332d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff33415f840 0x7ff3340d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff331d9b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff3340d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff332d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff33415f840 0x7ff3340d05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:47950/0 (socket says 172.21.15.77:47950) 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff33259c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff33415f460 0x7ff3340d38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37294/0 (socket says 172.21.15.77:37294) 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff332d9d640 1 -- 172.21.15.77:0/3944180361 learned_addr learned my addr 172.21.15.77:0/3944180361 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff331d9b640 1 -- 172.21.15.77:0/3944180361 >> v2:172.21.15.83:3300/0 conn(0x7ff33415f840 msgr2=0x7ff3340d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff331d9b640 1 --2- 172.21.15.77:0/3944180361 >> v2:172.21.15.83:3300/0 conn(0x7ff33415f840 0x7ff3340d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff33159a640 1 -- 172.21.15.77:0/3944180361 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2033309264 0 0) 0x7ff3340d0dd0 con 0x7ff33415f460 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff331d9b640 1 -- 172.21.15.77:0/3944180361 >> v1:172.21.15.83:6789/0 conn(0x7ff33415f460 legacy=0x7ff3340d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.659+0000 7ff331d9b640 1 -- 172.21.15.77:0/3944180361 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3340d1390 con 0x7ff3340d3fd0 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff331d9b640 1 --2- 172.21.15.77:0/3944180361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff3340d0060 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff3280097a0 tx=0x7ff32802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba30975aaf9e52d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff33159a640 1 -- 172.21.15.77:0/3944180361 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328037070 con 0x7ff3340d3fd0 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff33159a640 1 -- 172.21.15.77:0/3944180361 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32802ae50 con 0x7ff3340d3fd0 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff33159a640 1 -- 172.21.15.77:0/3944180361 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328032660 con 0x7ff3340d3fd0 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff338946640 1 -- 172.21.15.77:0/3944180361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 msgr2=0x7ff3340d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff338946640 1 --2- 172.21.15.77:0/3944180361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff3340d0060 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff3280097a0 tx=0x7ff32802a100 comp rx=0 tx=0).stop 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff338946640 1 -- 172.21.15.77:0/3944180361 shutdown_connections 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.660+0000 7ff338946640 1 --2- 172.21.15.77:0/3944180361 >> v2:172.21.15.83:3300/0 conn(0x7ff33415f840 0x7ff3340d05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.661+0000 7ff338946640 1 --2- 172.21.15.77:0/3944180361 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff3340d0060 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.661+0000 7ff338946640 1 -- 172.21.15.77:0/3944180361 >> 172.21.15.77:0/3944180361 conn(0x7ff33408ec10 msgr2=0x7ff33409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.661+0000 7ff338946640 1 -- 172.21.15.77:0/3944180361 shutdown_connections 2024-05-15T12:09:57.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.661+0000 7ff338946640 1 -- 172.21.15.77:0/3944180361 wait complete. 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.662+0000 7ff338946640 1 Processor -- start 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.662+0000 7ff338946640 1 -- start start 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff334157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 0x7ff3340b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33415f840 0x7ff3341f8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340b4a00 con 0x7ff33415f460 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340d0ae0 con 0x7ff33415f840 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340b4b80 con 0x7ff3340d3fd0 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 0x7ff3340b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 0x7ff3340b84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56588/0 (socket says 172.21.15.77:56588) 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 -- 172.21.15.77:0/3009620178 learned_addr learned my addr 172.21.15.77:0/3009620178 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff33259c640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff334157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff332d9d640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33415f840 0x7ff3341f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 -- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 msgr2=0x7ff334157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff334157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 -- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33415f840 msgr2=0x7ff3341f8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33415f840 0x7ff3341f8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 -- 172.21.15.77:0/3009620178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff334162000 con 0x7ff33415f460 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff332d9d640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33415f840 0x7ff3341f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff331d9b640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 0x7ff3340b84d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff328035040 tx=0x7ff3280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328037040 con 0x7ff33415f460 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff328004030 con 0x7ff33415f460 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3341622e0 con 0x7ff33415f460 2024-05-15T12:09:57.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328004420 con 0x7ff33415f460 2024-05-15T12:09:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.663+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3340cceb0 con 0x7ff33415f460 2024-05-15T12:09:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.664+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33406a640 con 0x7ff33415f460 2024-05-15T12:09:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.665+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff328003610 con 0x7ff33415f460 2024-05-15T12:09:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.665+0000 7ff322ffd640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff3140762d0 0x7ff314078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.665+0000 7ff33259c640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff3140762d0 0x7ff314078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.665+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff3280b81c0 con 0x7ff33415f460 2024-05-15T12:09:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.666+0000 7ff33259c640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff3140762d0 0x7ff314078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3240012e0 tx=0x7ff3240016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.670+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff328081bb0 con 0x7ff33415f460 2024-05-15T12:09:57.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.884+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3340b6490 con 0x7ff33415f460 2024-05-15T12:09:57.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.885+0000 7ff322ffd640 1 -- 172.21.15.77:0/3009620178 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7ff3280814b0 con 0x7ff33415f460 2024-05-15T12:09:57.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:57.880 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:09:57.880 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff3140762d0 msgr2=0x7ff314078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff3140762d0 0x7ff314078790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff3240012e0 tx=0x7ff3240016f0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 msgr2=0x7ff3340b84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 0x7ff3340b84d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff328035040 tx=0x7ff3280046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 shutdown_connections 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff3140762d0 0x7ff314078790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff33415f840 0x7ff3341f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff33415f460 0x7ff3340b84d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 --2- 172.21.15.77:0/3009620178 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff3340d3fd0 0x7ff334157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 >> 172.21.15.77:0/3009620178 conn(0x7ff33408ec10 msgr2=0x7ff3340cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:57.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 shutdown_connections 2024-05-15T12:09:57.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.887+0000 7ff338946640 1 -- 172.21.15.77:0/3009620178 wait complete. 2024-05-15T12:09:57.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:09:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.998+0000 7f9767064640 1 Processor -- start 2024-05-15T12:09:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.998+0000 7f9767064640 1 -- start start 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9767064640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9760070e00 0x7f9760071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9767064640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f9760143150 0x7f97600d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9767064640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9760072210 con 0x7f976015d520 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9767064640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f97600724f0 con 0x7f9760070e00 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9767064640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f97600727d0 con 0x7f9760143150 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9760070e00 0x7f9760071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9760070e00 0x7f9760071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56592/0 (socket says 172.21.15.77:56592) 2024-05-15T12:09:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 -- 172.21.15.77:0/686629172 learned_addr learned my addr 172.21.15.77:0/686629172 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9764e00640 1 --1- 172.21.15.77:0/686629172 >> v1:172.21.15.77:6789/0 conn(0x7f976015d520 0x7f97600706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44438/0 (socket says 172.21.15.77:44438) 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f9765601640 1 --2- 172.21.15.77:0/686629172 >> v2:172.21.15.83:3300/0 conn(0x7f9760143150 0x7f97600d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 -- 172.21.15.77:0/686629172 >> v2:172.21.15.83:3300/0 conn(0x7f9760143150 msgr2=0x7f97600d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 --2- 172.21.15.77:0/686629172 >> v2:172.21.15.83:3300/0 conn(0x7f9760143150 0x7f97600d1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 -- 172.21.15.77:0/686629172 >> v1:172.21.15.77:6789/0 conn(0x7f976015d520 legacy=0x7f97600706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975ffff640 1 -- 172.21.15.77:0/686629172 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760072ab0 con 0x7f9760070e00 2024-05-15T12:09:57.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:57.999+0000 7f975f7fe640 1 -- 172.21.15.77:0/686629172 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846129873 0 0) 0x7f9760072210 con 0x7f976015d520 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.000+0000 7f975ffff640 1 --2- 172.21.15.77:0/686629172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f9760071c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9760072f70 tx=0x7f975402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8625fa6238eb25 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.000+0000 7f975f7fe640 1 -- 172.21.15.77:0/686629172 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754037070 con 0x7f9760070e00 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.000+0000 7f975f7fe640 1 -- 172.21.15.77:0/686629172 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9754032440 con 0x7f9760070e00 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.000+0000 7f975f7fe640 1 -- 172.21.15.77:0/686629172 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9754032810 con 0x7f9760070e00 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 -- 172.21.15.77:0/686629172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 msgr2=0x7f9760071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 --2- 172.21.15.77:0/686629172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f9760071c30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9760072f70 tx=0x7f975402a270 comp rx=0 tx=0).stop 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 -- 172.21.15.77:0/686629172 shutdown_connections 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 --2- 172.21.15.77:0/686629172 >> v2:172.21.15.83:3300/0 conn(0x7f9760143150 0x7f97600d1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 --2- 172.21.15.77:0/686629172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f9760071c30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 -- 172.21.15.77:0/686629172 >> 172.21.15.77:0/686629172 conn(0x7f97600d2fd0 msgr2=0x7f97600d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 -- 172.21.15.77:0/686629172 shutdown_connections 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.001+0000 7f9767064640 1 -- 172.21.15.77:0/686629172 wait complete. 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.002+0000 7f9767064640 1 Processor -- start 2024-05-15T12:09:57.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.002+0000 7f9767064640 1 -- start start 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9767064640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f976013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9767064640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9760143150 0x7f97600d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9767064640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f976015d520 0x7f97600d2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9767064640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97600d18c0 con 0x7f9760070e00 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9767064640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9760143550 con 0x7f9760143150 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9767064640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f97600d1a40 con 0x7f976015d520 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f976013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f976013ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56606/0 (socket says 172.21.15.77:56606) 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 -- 172.21.15.77:0/2060601354 learned_addr learned my addr 172.21.15.77:0/2060601354 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9765601640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f976015d520 0x7f97600d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 -- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f976015d520 msgr2=0x7f97600d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f976015d520 0x7f97600d2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 -- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9760143150 msgr2=0x7f97600d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f975ffff640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9760143150 0x7f97600d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9760143150 0x7f97600d1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 -- 172.21.15.77:0/2060601354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760161170 con 0x7f9760070e00 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.003+0000 7f9764e00640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f976013ef00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f975800c770 tx=0x7f975800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.004+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9758018070 con 0x7f9760070e00 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.004+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f975800a640 con 0x7f9760070e00 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.004+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f975800aa30 con 0x7f9760070e00 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.004+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9760160bb0 con 0x7f9760070e00 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.004+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9760157d40 con 0x7f9760070e00 2024-05-15T12:09:58.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.005+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f976006a640 con 0x7f9760070e00 2024-05-15T12:09:58.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.005+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f975801b070 con 0x7f9760070e00 2024-05-15T12:09:58.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.006+0000 7f975d7fa640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f974c0762d0 0x7f974c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.006+0000 7f975ffff640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f974c0762d0 0x7f974c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.006+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9758096b30 con 0x7f9760070e00 2024-05-15T12:09:58.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.006+0000 7f975ffff640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f974c0762d0 0x7f974c078790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9754034000 tx=0x7f975402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:58.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.010+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9758060520 con 0x7f9760070e00 2024-05-15T12:09:58.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.193+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97600d2a70 con 0x7f9760070e00 2024-05-15T12:09:58.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.194+0000 7f975d7fa640 1 -- 172.21.15.77:0/2060601354 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7f975805fe20 con 0x7f9760070e00 2024-05-15T12:09:58.189 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:58.189 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f974c0762d0 msgr2=0x7f974c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f974c0762d0 0x7f974c078790 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9754034000 tx=0x7f975402e000 comp rx=0 tx=0).stop 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 msgr2=0x7f976013ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f976013ef00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f975800c770 tx=0x7f975800cc30 comp rx=0 tx=0).stop 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 shutdown_connections 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f974c0762d0 0x7f974c078790 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f976015d520 0x7f97600d2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9760143150 0x7f97600d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 --2- 172.21.15.77:0/2060601354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9760070e00 0x7f976013ef00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 >> 172.21.15.77:0/2060601354 conn(0x7f97600d2fd0 msgr2=0x7f976015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:58.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 shutdown_connections 2024-05-15T12:09:58.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.196+0000 7f9767064640 1 -- 172.21.15.77:0/2060601354 wait complete. 2024-05-15T12:09:58.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:09:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.307+0000 7fc5554c8640 1 Processor -- start 2024-05-15T12:09:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.307+0000 7fc5554c8640 1 -- start start 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc5554c8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc5500d3fd0 0x7fc5500d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc5554c8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc5554c8640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5500d0dd0 con 0x7fc55015f460 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc5554c8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc5500d19e0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc5554c8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc5500d10b0 con 0x7fc55015f840 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc54f7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc54e7fc640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc5500d3fd0 0x7fc5500d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc54effd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fc55015f460 0x7fc5500d38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:37298/0 (socket says 172.21.15.77:37298) 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc54effd640 1 -- 172.21.15.77:0/388191778 learned_addr learned my addr 172.21.15.77:0/388191778 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.308+0000 7fc54dffb640 1 -- 172.21.15.77:0/388191778 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030083994 0 0) 0x7fc5500d0dd0 con 0x7fc55015f460 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54f7fe640 1 -- 172.21.15.77:0/388191778 >> v2:172.21.15.83:3300/0 conn(0x7fc5500d3fd0 msgr2=0x7fc5500d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54f7fe640 1 --2- 172.21.15.77:0/388191778 >> v2:172.21.15.83:3300/0 conn(0x7fc5500d3fd0 0x7fc5500d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54f7fe640 1 -- 172.21.15.77:0/388191778 >> v1:172.21.15.83:6789/0 conn(0x7fc55015f460 legacy=0x7fc5500d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54f7fe640 1 -- 172.21.15.77:0/388191778 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5500d1390 con 0x7fc55015f840 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54e7fc640 1 --2- 172.21.15.77:0/388191778 >> v2:172.21.15.83:3300/0 conn(0x7fc5500d3fd0 0x7fc5500d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54f7fe640 1 --2- 172.21.15.77:0/388191778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500d05a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5480097a0 tx=0x7fc54802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf41ee80a636f7a server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54dffb640 1 -- 172.21.15.77:0/388191778 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548037070 con 0x7fc55015f840 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54dffb640 1 -- 172.21.15.77:0/388191778 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54802ae50 con 0x7fc55015f840 2024-05-15T12:09:58.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.309+0000 7fc54dffb640 1 -- 172.21.15.77:0/388191778 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc548032660 con 0x7fc55015f840 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 -- 172.21.15.77:0/388191778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 msgr2=0x7fc5500d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 --2- 172.21.15.77:0/388191778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500d05a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc5480097a0 tx=0x7fc54802a100 comp rx=0 tx=0).stop 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 -- 172.21.15.77:0/388191778 shutdown_connections 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 --2- 172.21.15.77:0/388191778 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500d05a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 --2- 172.21.15.77:0/388191778 >> v2:172.21.15.83:3300/0 conn(0x7fc5500d3fd0 0x7fc5500d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 -- 172.21.15.77:0/388191778 >> 172.21.15.77:0/388191778 conn(0x7fc55008ec10 msgr2=0x7fc55009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:58.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 -- 172.21.15.77:0/388191778 shutdown_connections 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.310+0000 7fc5554c8640 1 -- 172.21.15.77:0/388191778 wait complete. 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.311+0000 7fc5554c8640 1 Processor -- start 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.311+0000 7fc5554c8640 1 -- start start 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc5554c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 0x7fc5500ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc5554c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55015f460 0x7fc5501544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc5554c8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500b9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc5554c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500b4a00 con 0x7fc5500d3fd0 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc5554c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc5500d0ae0 con 0x7fc55015f460 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc5554c8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc5500b4b80 con 0x7fc55015f840 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 0x7fc5500ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 0x7fc5500ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56614/0 (socket says 172.21.15.77:56614) 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 -- 172.21.15.77:0/1478982548 learned_addr learned my addr 172.21.15.77:0/1478982548 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54f7fe640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54e7fc640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55015f460 0x7fc5501544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 -- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 msgr2=0x7fc5500b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 -- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55015f460 msgr2=0x7fc5501544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55015f460 0x7fc5501544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.312+0000 7fc54effd640 1 -- 172.21.15.77:0/1478982548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc550154a10 con 0x7fc5500d3fd0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.313+0000 7fc54effd640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 0x7fc5500ccbe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c870 tx=0x7fc54000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.313+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc540018070 con 0x7fc5500d3fd0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.313+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc54000a5e0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.313+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54000a9d0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.313+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5500b9f60 con 0x7fc5500d3fd0 2024-05-15T12:09:58.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.313+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5501600d0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.314+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55006a640 con 0x7fc5500d3fd0 2024-05-15T12:09:58.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.315+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc54001b070 con 0x7fc5500d3fd0 2024-05-15T12:09:58.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.315+0000 7fc5377fe640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc53c0762d0 0x7fc53c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:58.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.315+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc540096ba0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.315+0000 7fc54e7fc640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc53c0762d0 0x7fc53c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:58.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.315+0000 7fc54e7fc640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc53c0762d0 0x7fc53c078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc544009560 tx=0x7fc544009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:58.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.319+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc54005feb0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.542+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc55015ea60 con 0x7fc5500d3fd0 2024-05-15T12:09:58.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.542+0000 7fc5377fe640 1 -- 172.21.15.77:0/1478982548 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7fc5400641b0 con 0x7fc5500d3fd0 2024-05-15T12:09:58.537 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:09:58.537 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:09:58.538 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:09:58.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.544+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc53c0762d0 msgr2=0x7fc53c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.544+0000 7fc5554c8640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc53c0762d0 0x7fc53c078790 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc544009560 tx=0x7fc544009190 comp rx=0 tx=0).stop 2024-05-15T12:09:58.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.544+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 msgr2=0x7fc5500ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.544+0000 7fc5554c8640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 0x7fc5500ccbe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc54000c870 tx=0x7fc54000cd30 comp rx=0 tx=0).stop 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 shutdown_connections 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc53c0762d0 0x7fc53c078790 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc55015f840 0x7fc5500b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc55015f460 0x7fc5501544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 --2- 172.21.15.77:0/1478982548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5500d3fd0 0x7fc5500ccbe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 >> 172.21.15.77:0/1478982548 conn(0x7fc55008ec10 msgr2=0x7fc5500b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 shutdown_connections 2024-05-15T12:09:58.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:58.545+0000 7fc5554c8640 1 -- 172.21.15.77:0/1478982548 wait complete. 2024-05-15T12:09:58.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-15T12:09:43.024878+0000', 'modified': '2024-05-15T12:09:46.032593+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.83:6835/4120523335', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.83:6833', 'nonce': 4120523335}, {'type': 'v1', 'addr': '172.21.15.83:6835', 'nonce': 4120523335}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4302, 'qdb_cluster': [4302]} 2024-05-15T12:09:58.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-15T12:09:58.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-15T12:09:59.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.061+0000 7fd5bad24640 1 Processor -- start 2024-05-15T12:09:59.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.061+0000 7fd5bad24640 1 -- start start 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5bad24640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5b41629b0 0x7fd5b4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5bad24640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd5b40b55e0 0x7fd5b4070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5bad24640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40d11b0 con 0x7fd5b40d2210 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5bad24640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b4162d90 con 0x7fd5b41629b0 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5bad24640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd5b40d1450 con 0x7fd5b40b55e0 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5b41629b0 0x7fd5b4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5b41629b0 0x7fd5b4070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56620/0 (socket says 172.21.15.77:56620) 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/1455107332 learned_addr learned my addr 172.21.15.77:0/1455107332 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/1455107332 >> v2:172.21.15.83:3300/0 conn(0x7fd5b40b55e0 msgr2=0x7fd5b4070d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5abfff640 1 --2- 172.21.15.77:0/1455107332 >> v2:172.21.15.83:3300/0 conn(0x7fd5b40b55e0 0x7fd5b4070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/1455107332 >> v2:172.21.15.83:3300/0 conn(0x7fd5b40b55e0 0x7fd5b4070d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/1455107332 >> v1:172.21.15.83:6789/0 conn(0x7fd5b40d2210 legacy=0x7fd5b40cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/1455107332 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40d1730 con 0x7fd5b41629b0 2024-05-15T12:09:59.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.062+0000 7fd5abfff640 1 --2- 172.21.15.77:0/1455107332 >> v2:172.21.15.83:3300/0 conn(0x7fd5b40b55e0 0x7fd5b4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/1455107332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b41629b0 0x7fd5b4070460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4072690 tx=0x7fd5b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d852f04ef8f55238 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5ab7fe640 1 -- 172.21.15.77:0/1455107332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0037070 con 0x7fd5b41629b0 2024-05-15T12:09:59.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5ab7fe640 1 -- 172.21.15.77:0/1455107332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b0032440 con 0x7fd5b41629b0 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5ab7fe640 1 -- 172.21.15.77:0/1455107332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0032810 con 0x7fd5b41629b0 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 -- 172.21.15.77:0/1455107332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b41629b0 msgr2=0x7fd5b4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 --2- 172.21.15.77:0/1455107332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b41629b0 0x7fd5b4070460 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4072690 tx=0x7fd5b002a1e0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 -- 172.21.15.77:0/1455107332 shutdown_connections 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 --2- 172.21.15.77:0/1455107332 >> v2:172.21.15.83:3300/0 conn(0x7fd5b40b55e0 0x7fd5b4070d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 --2- 172.21.15.77:0/1455107332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b41629b0 0x7fd5b4070460 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 -- 172.21.15.77:0/1455107332 >> 172.21.15.77:0/1455107332 conn(0x7fd5b40b4ac0 msgr2=0x7fd5b40b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 -- 172.21.15.77:0/1455107332 shutdown_connections 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.063+0000 7fd5bad24640 1 -- 172.21.15.77:0/1455107332 wait complete. 2024-05-15T12:09:59.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 Processor -- start 2024-05-15T12:09:59.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 -- start start 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 0x7fd5b4154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5b40d2210 0x7fd5b40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5b41629b0 0x7fd5b40ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b40709a0 con 0x7fd5b40b55e0 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b40d1cf0 con 0x7fd5b40d2210 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.065+0000 7fd5bad24640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b4070b20 con 0x7fd5b41629b0 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 0x7fd5b4154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 0x7fd5b4154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56626/0 (socket says 172.21.15.77:56626) 2024-05-15T12:09:59.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/4108145978 learned_addr learned my addr 172.21.15.77:0/4108145978 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5abfff640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5b40d2210 0x7fd5b40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5b41629b0 msgr2=0x7fd5b40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5b41629b0 0x7fd5b40ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5b40d2210 msgr2=0x7fd5b40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5b40d2210 0x7fd5b40ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/4108145978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40b89e0 con 0x7fd5b40b55e0 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 0x7fd5b4154350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000c00 tx=0x7fd5b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5a97fa640 1 -- 172.21.15.77:0/4108145978 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0041020 con 0x7fd5b40b55e0 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5a97fa640 1 -- 172.21.15.77:0/4108145978 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b0030970 con 0x7fd5b40b55e0 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b4155000 con 0x7fd5b40b55e0 2024-05-15T12:09:59.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5a97fa640 1 -- 172.21.15.77:0/4108145978 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0037040 con 0x7fd5b40b55e0 2024-05-15T12:09:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.066+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b41552a0 con 0x7fd5b40b55e0 2024-05-15T12:09:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.068+0000 7fd5a97fa640 1 -- 172.21.15.77:0/4108145978 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd5b0044020 con 0x7fd5b40b55e0 2024-05-15T12:09:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.068+0000 7fd5a97fa640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd5a00762d0 0x7fd5a0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.068+0000 7fd5a97fa640 1 -- 172.21.15.77:0/4108145978 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5b00b7f90 con 0x7fd5b40b55e0 2024-05-15T12:09:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.068+0000 7fd5abfff640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd5a00762d0 0x7fd5a0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.069+0000 7fd5abfff640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd5a00762d0 0x7fd5a0078790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40cd060 tx=0x7fd5a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.069+0000 7fd5bda40740 1 Processor -- start 2024-05-15T12:09:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.069+0000 7fd5bda40740 1 -- start start 2024-05-15T12:09:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec2b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec261e0 0x55a88ec29f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec2a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5bda40740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a88eb9cf10 con 0x55a88ec2b350 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a88eb8cab0 con 0x55a88ec2a490 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x55a88eb90af0 con 0x55a88ec261e0 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec2b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec2b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56628/0 (socket says 172.21.15.77:56628) 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/935726779 learned_addr learned my addr 172.21.15.77:0/935726779 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec2a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5abfff640 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec261e0 0x55a88ec29f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec261e0 msgr2=0x55a88ec29f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec261e0 0x55a88ec29f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 msgr2=0x55a88ec2a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec2a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/935726779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88eb505d0 con 0x55a88ec2b350 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec2b730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5b007d870 tx=0x7fd5b0081110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8750909d57ec3e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd59a7fc640 1 -- 172.21.15.77:0/935726779 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0081980 con 0x55a88ec2b350 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd59a7fc640 1 -- 172.21.15.77:0/935726779 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b0081280 con 0x55a88ec2b350 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.070+0000 7fd59a7fc640 1 -- 172.21.15.77:0/935726779 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0085630 con 0x55a88ec2b350 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 -- 172.21.15.77:0/935726779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 msgr2=0x55a88ec2b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec2b730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd5b007d870 tx=0x7fd5b0081110 comp rx=0 tx=0).stop 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 -- 172.21.15.77:0/935726779 shutdown_connections 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec261e0 0x55a88ec29f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec2a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 --2- 172.21.15.77:0/935726779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec2b730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 -- 172.21.15.77:0/935726779 >> 172.21.15.77:0/935726779 conn(0x55a88ec28450 msgr2=0x55a88ec70f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 -- 172.21.15.77:0/935726779 shutdown_connections 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.071+0000 7fd5bda40740 1 -- 172.21.15.77:0/935726779 wait complete. 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.072+0000 7fd5bda40740 1 -- start start 2024-05-15T12:09:59.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.072+0000 7fd5bda40740 1 Processor -- start 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.072+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec2a490 0x55a88ec66ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.072+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.072+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 0x55a88ec75b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a88e872850 con 0x55a88ec48cb0 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55a88eb48c10 con 0x55a88ec2b350 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x55a88eb9cf10 con 0x55a88ec2a490 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 10 client.0 _ll_register_callbacks cb 0x55a88eb4c150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 0x55a88ec75b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 0x55a88ec75b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56634/0 (socket says 172.21.15.77:56634) 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 -- 172.21.15.77:0/3911866980 learned_addr learned my addr 172.21.15.77:0/3911866980 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5abfff640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec2a490 0x55a88ec66ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 -- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec2a490 msgr2=0x55a88ec66ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec2a490 0x55a88ec66ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 -- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 msgr2=0x55a88ec755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 -- 172.21.15.77:0/3911866980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88e8a12d0 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 0x55a88ec75b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c9d0 tx=0x7fd5ac00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809143177f574b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5937fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5937fe640 1 -- 172.21.15.77:0/3911866980 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac01a060 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5937fe640 1 -- 172.21.15.77:0/3911866980 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5ac007ae0 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b0081280 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5937fe640 1 -- 172.21.15.77:0/3911866980 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd5ac020050 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 10 client.4617 fetch_fsmap learned FSMap version 8 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a88e96b6b0 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.073+0000 7fd5937fe640 1 -- 172.21.15.77:0/3911866980 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b0081280 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5937fe640 1 -- 172.21.15.77:0/3911866980 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fd5ac023020 con 0x55a88ec48cb0 2024-05-15T12:09:59.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5bda40740 10 client.4617 fetch_fsmap finished waiting for FSMap version 8 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5bda40740 10 client.4617 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5bda40740 20 client.4617 populate_metadata read hostname 'smithi077' 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ec78640 0x55a88ec78a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5bda40740 4 client.4617 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 --> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a88eb9ee60 con 0x55a88ec78640 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ec78640 0x55a88ec78a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ec78640 0x55a88ec78a20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b7bd4becfa99a0e server_cookie=9c751dff2836d663 in_seq=0 out_seq=0 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.074+0000 7fd5937fe640 10 client.4617 ms_handle_connect on v2:172.21.15.83:6833/4120523335 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5937fe640 1 -- 172.21.15.77:0/3911866980 <== mds.0 v2:172.21.15.83:6833/4120523335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a88eb9ee60 con 0x55a88ec78640 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5937fe640 10 client.4617 handle_command_reply: tid=0 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 client.4617 shutdown 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 msgr2=0x55a88ec75b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 0x55a88ec75b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c9d0 tx=0x7fd5ac00ce90 comp rx=0 tx=0).stop 2024-05-15T12:09:59.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 shutdown_connections 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ec78640 0x55a88ec78a20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec48cb0 0x55a88ec75b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5937fe640 0 client.4617 ms_handle_reset on v2:172.21.15.83:6833/4120523335 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3911866980 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec2a490 0x55a88ec66ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 >> 172.21.15.77:0/3911866980 conn(0x55a88ec261e0 msgr2=0x55a88ec25920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 shutdown_connections 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 1 -- 172.21.15.77:0/3911866980 wait complete. 2024-05-15T12:09:59.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.075+0000 7fd5bda40740 20 client.4617 trim_cache size 0 max 16384 2024-05-15T12:09:59.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.094+0000 7fd5bda40740 1 Processor -- start 2024-05-15T12:09:59.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.094+0000 7fd5bda40740 1 -- start start 2024-05-15T12:09:59.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec66cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec562c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5bda40740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b42019e0 con 0x55a88ec2b350 2024-05-15T12:09:59.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b42009e0 con 0x55a88ec2a490 2024-05-15T12:09:59.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd5b41ffd40 con 0x55a88ec48cb0 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56640/0 (socket says 172.21.15.77:56640) 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 -- 172.21.15.77:0/1540446815 learned_addr learned my addr 172.21.15.77:0/1540446815 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec66cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 -- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 msgr2=0x55a88ec4beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 -- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 msgr2=0x55a88ec66cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec66cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 -- 172.21.15.77:0/1540446815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88ec49ca0 con 0x55a88ec2b350 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd5abfff640 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec562c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400dc50 tx=0x7fd5a4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72c34ed31dff04c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd599ffb640 1 -- 172.21.15.77:0/1540446815 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4019070 con 0x55a88ec2b350 2024-05-15T12:09:59.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd599ffb640 1 -- 172.21.15.77:0/1540446815 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a401a040 con 0x55a88ec2b350 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.095+0000 7fd599ffb640 1 -- 172.21.15.77:0/1540446815 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4021470 con 0x55a88ec2b350 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 -- 172.21.15.77:0/1540446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 msgr2=0x55a88ec562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec562c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400dc50 tx=0x7fd5a4013000 comp rx=0 tx=0).stop 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 -- 172.21.15.77:0/1540446815 shutdown_connections 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2b350 0x55a88ec562c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 --2- 172.21.15.77:0/1540446815 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2a490 0x55a88ec66cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 -- 172.21.15.77:0/1540446815 >> 172.21.15.77:0/1540446815 conn(0x55a88ec261e0 msgr2=0x55a88ec29c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 -- 172.21.15.77:0/1540446815 shutdown_connections 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.096+0000 7fd5bda40740 1 -- 172.21.15.77:0/1540446815 wait complete. 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.097+0000 7fd5bda40740 1 -- start start 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.097+0000 7fd5bda40740 1 Processor -- start 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.097+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 0x55a88ecebc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.097+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec4beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.097+0000 7fd5bda40740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a88ec74930 con 0x55a88ec2a490 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4200390 con 0x55a88ec2b350 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x55a88ec78f60 con 0x55a88ec48cb0 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 10 client.0 _ll_register_callbacks cb 0x7fd5ac009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 0x55a88ecebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 0x55a88ecebc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56652/0 (socket says 172.21.15.77:56652) 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/3137853932 learned_addr learned my addr 172.21.15.77:0/3137853932 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5abfff640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec4beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b92c1640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 msgr2=0x55a88ec4c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 msgr2=0x55a88ec4beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec4beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 -- 172.21.15.77:0/3137853932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88ec47e50 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5abfff640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5b8ac0640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 0x55a88ecebc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5b002a220 tx=0x7fd5b0008070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06ad7e88b611472 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5937fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5937fe640 1 -- 172.21.15.77:0/3137853932 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0081280 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5937fe640 1 -- 172.21.15.77:0/3137853932 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5b00814e0 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a401a040 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5937fe640 1 -- 172.21.15.77:0/3137853932 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd5b008a050 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 10 client.4623 fetch_fsmap learned FSMap version 8 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55a88ecf05a0 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5937fe640 1 -- 172.21.15.77:0/3137853932 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5a401a040 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5937fe640 1 -- 172.21.15.77:0/3137853932 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 8) ==== 3494+0+0 (secure 0 0 0) 0x7fd5b003a030 con 0x55a88ec2a490 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 10 client.4623 fetch_fsmap finished waiting for FSMap version 8 2024-05-15T12:09:59.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 10 client.4623 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 20 client.4623 populate_metadata read hostname 'smithi077' 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ecefc10 0x55a88ecefff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 4 client.4623 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.098+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 --> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] -- command(tid 0: {"prefix": "status"}) -- 0x55a88eb98640 con 0x55a88ecefc10 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5abfff640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ecefc10 0x55a88ecefff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5937fe640 10 client.4623 ms_handle_connect on v2:172.21.15.83:6833/4120523335 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5abfff640 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ecefc10 0x55a88ecefff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37886effde3dd243 server_cookie=d9cdcdbec5c9a61d in_seq=0 out_seq=0 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5937fe640 1 -- 172.21.15.77:0/3137853932 <== mds.0 v2:172.21.15.83:6833/4120523335 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55a88eb98640 con 0x55a88ecefc10 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5937fe640 10 client.4623 handle_command_reply: tid=0 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 client.4623 shutdown 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 msgr2=0x55a88ecebc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 0x55a88ecebc20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd5b002a220 tx=0x7fd5b0008070 comp rx=0 tx=0).stop 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 shutdown_connections 2024-05-15T12:09:59.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:6833/4120523335,v1:172.21.15.83:6835/4120523335] conn(0x55a88ecefc10 0x55a88ecefff0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55a88ec48cb0 0x55a88ec4c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55a88ec2b350 0x55a88ec4beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5937fe640 0 client.4623 ms_handle_reset on v2:172.21.15.83:6833/4120523335 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 --2- 172.21.15.77:0/3137853932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a88ec2a490 0x55a88ecebc20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 >> 172.21.15.77:0/3137853932 conn(0x55a88ec261e0 msgr2=0x55a88ec562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 shutdown_connections 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.099+0000 7fd5bda40740 1 -- 172.21.15.77:0/3137853932 wait complete. 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bda40740 20 client.4623 trim_cache size 0 max 16384 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T12:09:59.103 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "80026697-69b5-4668-adbe-f40fd7cb21f7", 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4302, 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 15.439462110999999, 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 8, 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 21, 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 21, 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 21.453885889999999 2024-05-15T12:09:59.104 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd5a00762d0 msgr2=0x7fd5a0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd5a00762d0 0x7fd5a0078790 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40cd060 tx=0x7fd5a4008040 comp rx=0 tx=0).stop 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 msgr2=0x7fd5b4154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 0x7fd5b4154350 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0000c00 tx=0x7fd5b00046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 shutdown_connections 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd5a00762d0 0x7fd5a0078790 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd5b41629b0 0x7fd5b40ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd5b40d2210 0x7fd5b40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 --2- 172.21.15.77:0/4108145978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5b40b55e0 0x7fd5b4154350 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 >> 172.21.15.77:0/4108145978 conn(0x7fd5b40b4ac0 msgr2=0x7fd5b40b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 shutdown_connections 2024-05-15T12:09:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.100+0000 7fd5bad24640 1 -- 172.21.15.77:0/4108145978 wait complete. 2024-05-15T12:09:59.107 INFO:teuthology.run_tasks:Running task sequential... 2024-05-15T12:09:59.116 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-15T12:09:59.116 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-15T12:09:59.124 INFO:teuthology.task.print:Enabling mgr modules 2024-05-15T12:09:59.124 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-15T12:09:59.169 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-15T12:09:59.169 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-15T12:09:59.169 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-15T12:09:59.170 INFO:tasks.ceph_fuse:client.2 config is {} 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-15T12:09:59.170 INFO:tasks.ceph_fuse:client.1 config is {} 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-15T12:09:59.170 INFO:tasks.ceph_fuse:client.3 config is {} 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-15T12:09:59.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-15T12:09:59.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.171 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-05-15T12:09:59.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.191 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-05-15T12:09:59.262 INFO:teuthology.orchestra.run.smithi083.stderr:Cannot find device "ceph-brx" 2024-05-15T12:09:59.263 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T12:09:59.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.264 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-05-15T12:09:59.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-05-15T12:09:59.347 INFO:teuthology.orchestra.run.smithi077.stderr:Cannot find device "ceph-brx" 2024-05-15T12:09:59.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T12:09:59.349 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-15T12:09:59.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T12:09:59.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.494+0000 7f161d847640 1 Processor -- start 2024-05-15T12:09:59.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.494+0000 7f161d847640 1 -- start start 2024-05-15T12:09:59.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f161d847640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f161815d520 0x7f1618071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f161d847640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1618143150 0x7f16180706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f161d847640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16181435e0 con 0x7f1618070c30 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f161d847640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f1618071040 con 0x7f161815d520 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f161d847640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1618072210 con 0x7f1618143150 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f161815d520 0x7f1618071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f161815d520 0x7f1618071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56658/0 (socket says 172.21.15.77:56658) 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 -- 172.21.15.77:0/2202167962 learned_addr learned my addr 172.21.15.77:0/2202167962 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f16167fc640 1 --2- 172.21.15.77:0/2202167962 >> v2:172.21.15.83:3300/0 conn(0x7f1618143150 0x7f16180706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 -- 172.21.15.77:0/2202167962 >> v2:172.21.15.83:3300/0 conn(0x7f1618143150 msgr2=0x7f16180706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:09:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 --2- 172.21.15.77:0/2202167962 >> v2:172.21.15.83:3300/0 conn(0x7f1618143150 0x7f16180706f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 -- 172.21.15.77:0/2202167962 >> v1:172.21.15.83:6789/0 conn(0x7f1618070c30 legacy=0x7f1618160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f1616ffd640 1 -- 172.21.15.77:0/2202167962 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16180724f0 con 0x7f161815d520 2024-05-15T12:09:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.495+0000 7f16167fc640 1 --2- 172.21.15.77:0/2202167962 >> v2:172.21.15.83:3300/0 conn(0x7f1618143150 0x7f16180706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:09:59.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.496+0000 7f1616ffd640 1 --2- 172.21.15.77:0/2202167962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f161815d520 0x7f1618071c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16180d3c70 tx=0x7f160802e590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a239f7a490bca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.496+0000 7f1615ffb640 1 -- 172.21.15.77:0/2202167962 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160803a070 con 0x7f161815d520 2024-05-15T12:09:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.496+0000 7f1615ffb640 1 -- 172.21.15.77:0/2202167962 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1608033710 con 0x7f161815d520 2024-05-15T12:09:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.496+0000 7f1615ffb640 1 -- 172.21.15.77:0/2202167962 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608033ae0 con 0x7f161815d520 2024-05-15T12:09:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 -- 172.21.15.77:0/2202167962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f161815d520 msgr2=0x7f1618071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 --2- 172.21.15.77:0/2202167962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f161815d520 0x7f1618071c30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f16180d3c70 tx=0x7f160802e590 comp rx=0 tx=0).stop 2024-05-15T12:09:59.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 -- 172.21.15.77:0/2202167962 shutdown_connections 2024-05-15T12:09:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 --2- 172.21.15.77:0/2202167962 >> v2:172.21.15.83:3300/0 conn(0x7f1618143150 0x7f16180706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 --2- 172.21.15.77:0/2202167962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f161815d520 0x7f1618071c30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 -- 172.21.15.77:0/2202167962 >> 172.21.15.77:0/2202167962 conn(0x7f16180d2fd0 msgr2=0x7f16180d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 -- 172.21.15.77:0/2202167962 shutdown_connections 2024-05-15T12:09:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.497+0000 7f161d847640 1 -- 172.21.15.77:0/2202167962 wait complete. 2024-05-15T12:09:59.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.498+0000 7f161d847640 1 Processor -- start 2024-05-15T12:09:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.498+0000 7f161d847640 1 -- start start 2024-05-15T12:09:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f161d847640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 0x7f161815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f161d847640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1618143150 0x7f1618155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f161d847640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f161815d520 0x7f161815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f161d847640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f161815d900 con 0x7f1618070c30 2024-05-15T12:09:59.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f161d847640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1618072ab0 con 0x7f161815d520 2024-05-15T12:09:59.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f161d847640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f16180d18c0 con 0x7f1618143150 2024-05-15T12:09:59.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 0x7f161815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 0x7f161815b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56666/0 (socket says 172.21.15.77:56666) 2024-05-15T12:09:59.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 -- 172.21.15.77:0/4077076031 learned_addr learned my addr 172.21.15.77:0/4077076031 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:09:59.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 -- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1618143150 msgr2=0x7f1618155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f16167fc640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1618143150 0x7f1618155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f16177fe640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f161815d520 0x7f161815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1618143150 0x7f1618155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 -- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f161815d520 msgr2=0x7f161815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f161815d520 0x7f161815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 -- 172.21.15.77:0/4077076031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161813e7d0 con 0x7f1618070c30 2024-05-15T12:09:59.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f16167fc640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1618143150 0x7f1618155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:59.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f16177fe640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f161815d520 0x7f161815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:09:59.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.499+0000 7f1616ffd640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 0x7f161815b660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f160802e5d0 tx=0x7f16080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.500+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1608044020 con 0x7f1618070c30 2024-05-15T12:09:59.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.500+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f160803f890 con 0x7f1618070c30 2024-05-15T12:09:59.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.500+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161813eab0 con 0x7f1618070c30 2024-05-15T12:09:59.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.500+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160803a040 con 0x7f1618070c30 2024-05-15T12:09:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.500+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f161815c6a0 con 0x7f1618070c30 2024-05-15T12:09:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.501+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16180d2db0 con 0x7f1618070c30 2024-05-15T12:09:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.501+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1608047020 con 0x7f1618070c30 2024-05-15T12:09:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.502+0000 7f15fffff640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f16040762d0 0x7f1604078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:09:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.502+0000 7f16167fc640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f16040762d0 0x7f1604078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:09:59.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.502+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f16080bc060 con 0x7f1618070c30 2024-05-15T12:09:59.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.502+0000 7f16167fc640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f16040762d0 0x7f1604078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f160c006fd0 tx=0x7f160c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:09:59.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.506+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f16180d2db0 con 0x7f1618070c30 2024-05-15T12:09:59.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.728+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f161806a640 con 0x7f1618070c30 2024-05-15T12:09:59.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.729+0000 7f15fffff640 1 -- 172.21.15.77:0/4077076031 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f160804e030 con 0x7f1618070c30 2024-05-15T12:09:59.723 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T12:09:59.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.730+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f16040762d0 msgr2=0x7f1604078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.730+0000 7f161d847640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f16040762d0 0x7f1604078790 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f160c006fd0 tx=0x7f160c008040 comp rx=0 tx=0).stop 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.730+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 msgr2=0x7f161815b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.730+0000 7f161d847640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 0x7f161815b660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f160802e5d0 tx=0x7f16080046c0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 shutdown_connections 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f16040762d0 0x7f1604078790 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1618143150 0x7f1618155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f161815d520 0x7f161815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 --2- 172.21.15.77:0/4077076031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1618070c30 0x7f161815b660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 >> 172.21.15.77:0/4077076031 conn(0x7f16180d2fd0 msgr2=0x7f161806e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 shutdown_connections 2024-05-15T12:09:59.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59.731+0000 7f161d847640 1 -- 172.21.15.77:0/4077076031 wait complete. 2024-05-15T12:09:59.736 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-15T12:09:59.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T12:09:59.736 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-05-15T12:09:59.736 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-15T12:09:59.736 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-15T12:09:59.737 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-15T12:09:59.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-15T12:09:59.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T12:09:59.737 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-15T12:09:59.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.737 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-05-15T12:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-05-15T12:09:59.753 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42752sec preferred_lft 42752sec 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2024-05-15T12:09:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:09:59.755 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-15T12:09:59.755 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:09:59.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:09:59.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:09:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:09:59.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.934 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T12:09:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-05-15T12:09:59.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:09:59.962 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-05-15T12:10:00.033 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-05-15T12:10:00.034 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T12:10:00.034 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T12:10:00.034 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T12:10:00.034 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T12:10:00.034 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:00.034 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:00.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T12:10:00.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T12:10:00.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T12:10:00.035 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:00.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:00.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:00.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:00.323 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-05-15T12:10:00.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:00.339 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-05-15T12:10:00.394 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:00.394 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:00.394 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:00.394 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-15T12:10:00.394 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:00.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:00.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:00.512 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-15T12:10:00.512 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:00.512 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:00.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-15T12:10:00.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-15T12:10:00.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-15T12:10:00.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-15T12:10:00.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-15T12:10:00.513 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:00.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:00.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:00.635 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:00.635 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:00.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-05-15T12:10:00.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-05-15T12:10:00.635 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:00.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:00.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:00.713 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-15T12:10:00.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:00.713 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:00.728 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-15T12:10:00.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:00.729 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:00.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-05-15T12:10:00.849 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-05-15T12:10:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-05-15T12:10:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-05-15T12:10:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-05-15T12:10:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-05-15T12:10:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:00.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:00.909 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-05-15T12:10:00.961 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-15T12:10:00.962 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-15T12:10:01.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-05-15T12:10:01.028 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-05-15T12:10:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-05-15T12:10:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-05-15T12:10:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-05-15T12:10:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-05-15T12:10:01.087 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-05-15T12:10:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:01.089 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2024-05-15T12:10:01.090 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2024-05-15T12:10:01.091 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2024-05-15T12:10:01.091 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-05-15T12:10:01.091 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:01.091 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:01.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:01.091 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-05-15T12:10:01.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2024-05-15T12:10:01.094+0000 7f7fda320480 -1 init, newargv = 0x55fbf5316d80 newargc=15 2024-05-15T12:10:01.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[45256]: starting ceph client 2024-05-15T12:10:01.093 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[45256]: starting fuse 2024-05-15T12:10:01.108 INFO:teuthology.orchestra.run.smithi077.stdout:40 2024-05-15T12:10:01.108 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:01.109 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-05-15T12:10:01.110 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-15T12:10:01.110 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-05-15T12:10:01.110 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-15T12:10:01.110 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-15T12:10:01.111 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2024-05-15T12:10:01.112 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-05-15T12:10:01.227 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.45256.asok 2024-05-15T12:10:01.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:01.238 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45256.asok 2024-05-15T12:10:01.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:01.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45256.asok status 2024-05-15T12:10:01.373 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T12:10:01.373 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "9b63866860f0b71216b2c0a73aedd2e0a8a5c98b", 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.0.0-3687-g9b638668 (9b63866860f0b71216b2c0a73aedd2e0a8a5c98b) squid (dev)", 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "45256", 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-05-15T12:10:01.374 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4635, 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4635 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-05-15T12:10:01.375 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-05-15T12:10:01.376 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3292003593 2024-05-15T12:10:01.376 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:01.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:01.376 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-05-15T12:10:01.376 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-05-15T12:10:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-05-15T12:10:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3292003593 2024-05-15T12:10:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4635 192.168.0.1:0/3292003593", 2024-05-15T12:10:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/3292003593", 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 8, 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 21, 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-05-15T12:10:01.379 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T12:10:01.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T12:10:01.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 Processor -- start 2024-05-15T12:10:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 -- start start 2024-05-15T12:10:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efce815f460 0x7efce80d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efce815f840 0x7efce80d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce80d0060 0x7efce80d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efce80d19e0 con 0x7efce815f840 2024-05-15T12:10:01.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efce80d0dd0 con 0x7efce815f460 2024-05-15T12:10:01.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.488+0000 7efcecd71640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efce80d10b0 con 0x7efce80d0060 2024-05-15T12:10:01.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efce815f840 0x7efce80d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:01.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efce815f840 0x7efce80d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56678/0 (socket says 172.21.15.77:56678) 2024-05-15T12:10:01.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 -- 172.21.15.77:0/3504837414 learned_addr learned my addr 172.21.15.77:0/3504837414 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:01.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efce659c640 1 --2- 172.21.15.77:0/3504837414 >> v2:172.21.15.83:3300/0 conn(0x7efce815f460 0x7efce80d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:01.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 -- 172.21.15.77:0/3504837414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce80d0060 msgr2=0x7efce80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:01.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 --2- 172.21.15.77:0/3504837414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce80d0060 0x7efce80d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 -- 172.21.15.77:0/3504837414 >> v2:172.21.15.83:3300/0 conn(0x7efce815f460 msgr2=0x7efce80d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:01.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 --2- 172.21.15.77:0/3504837414 >> v2:172.21.15.83:3300/0 conn(0x7efce815f460 0x7efce80d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.489+0000 7efcdffff640 1 -- 172.21.15.77:0/3504837414 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce80d1390 con 0x7efce815f840 2024-05-15T12:10:01.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcdffff640 1 --2- 172.21.15.77:0/3504837414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f840 0x7efce80d3e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efce808fa20 tx=0x7efcd002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecbac7640240330 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efce5d9b640 1 -- 172.21.15.77:0/3504837414 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0037070 con 0x7efce815f840 2024-05-15T12:10:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efce5d9b640 1 -- 172.21.15.77:0/3504837414 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd0032440 con 0x7efce815f840 2024-05-15T12:10:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efce5d9b640 1 -- 172.21.15.77:0/3504837414 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0032810 con 0x7efce815f840 2024-05-15T12:10:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 -- 172.21.15.77:0/3504837414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f840 msgr2=0x7efce80d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 --2- 172.21.15.77:0/3504837414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f840 0x7efce80d3e00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efce808fa20 tx=0x7efcd002a140 comp rx=0 tx=0).stop 2024-05-15T12:10:01.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 -- 172.21.15.77:0/3504837414 shutdown_connections 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 --2- 172.21.15.77:0/3504837414 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce80d0060 0x7efce80d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 --2- 172.21.15.77:0/3504837414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f840 0x7efce80d3e00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 --2- 172.21.15.77:0/3504837414 >> v2:172.21.15.83:3300/0 conn(0x7efce815f460 0x7efce80d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 -- 172.21.15.77:0/3504837414 >> 172.21.15.77:0/3504837414 conn(0x7efce808ec10 msgr2=0x7efce809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 -- 172.21.15.77:0/3504837414 shutdown_connections 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.490+0000 7efcecd71640 1 -- 172.21.15.77:0/3504837414 wait complete. 2024-05-15T12:10:01.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 Processor -- start 2024-05-15T12:10:01.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 -- start start 2024-05-15T12:10:01.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce80d0060 0x7efce8154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 0x7efce80ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce815f840 0x7efce81f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efce80d1cd0 con 0x7efce815f460 2024-05-15T12:10:01.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efce80d0a50 con 0x7efce80d0060 2024-05-15T12:10:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcecd71640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efce80d1e50 con 0x7efce815f840 2024-05-15T12:10:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcdffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 0x7efce80ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.492+0000 7efcdffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 0x7efce80ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56682/0 (socket says 172.21.15.77:56682) 2024-05-15T12:10:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 -- 172.21.15.77:0/386248766 learned_addr learned my addr 172.21.15.77:0/386248766 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:01.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efce659c640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce80d0060 0x7efce8154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efce6d9d640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce815f840 0x7efce81f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 -- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce815f840 msgr2=0x7efce81f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce815f840 0x7efce81f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 -- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce80d0060 msgr2=0x7efce8154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce80d0060 0x7efce8154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 -- 172.21.15.77:0/386248766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce80c9a40 con 0x7efce815f460 2024-05-15T12:10:01.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efce659c640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce80d0060 0x7efce8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:01.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efce6d9d640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce815f840 0x7efce81f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:01.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdffff640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 0x7efce80ceb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcd002a180 tx=0x7efcd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:01.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0037040 con 0x7efce815f460 2024-05-15T12:10:01.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd0042070 con 0x7efce815f460 2024-05-15T12:10:01.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce8160a30 con 0x7efce815f460 2024-05-15T12:10:01.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd0030bb0 con 0x7efce815f460 2024-05-15T12:10:01.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.493+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce80c9ce0 con 0x7efce815f460 2024-05-15T12:10:01.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.494+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce806a640 con 0x7efce815f460 2024-05-15T12:10:01.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.495+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcd0047460 con 0x7efce815f460 2024-05-15T12:10:01.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.495+0000 7efcdeffd640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efcc80762d0 0x7efcc8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:01.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.495+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efcd00b82d0 con 0x7efce815f460 2024-05-15T12:10:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.495+0000 7efce659c640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efcc80762d0 0x7efcc8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.496+0000 7efce659c640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efcc80762d0 0x7efcc8078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efcd8008890 tx=0x7efcd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:01.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.500+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efcd0081bb0 con 0x7efce815f460 2024-05-15T12:10:01.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.720+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efce815eba0 con 0x7efce815f460 2024-05-15T12:10:01.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.720+0000 7efcdeffd640 1 -- 172.21.15.77:0/386248766 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7efcd00814b0 con 0x7efce815f460 2024-05-15T12:10:01.715 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efcc80762d0 msgr2=0x7efcc8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efcc80762d0 0x7efcc8078790 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efcd8008890 tx=0x7efcd8008040 comp rx=0 tx=0).stop 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 msgr2=0x7efce80ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 0x7efce80ceb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efcd002a180 tx=0x7efcd00046c0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 shutdown_connections 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efcc80762d0 0x7efcc8078790 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efce815f840 0x7efce81f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efce815f460 0x7efce80ceb10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 --2- 172.21.15.77:0/386248766 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efce80d0060 0x7efce8154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 >> 172.21.15.77:0/386248766 conn(0x7efce808ec10 msgr2=0x7efce806dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:01.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 shutdown_connections 2024-05-15T12:10:01.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01.722+0000 7efcecd71640 1 -- 172.21.15.77:0/386248766 wait complete. 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T12:10:01.729 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-15T12:10:01.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:01.730 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-05-15T12:10:01.745 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42750sec preferred_lft 42750sec 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 1e:6c:a3:78:41:73 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:01.747 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::2cd9:9bff:feeb:bfed/64 scope link 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 1e:6c:a3:78:41:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::1c6c:a3ff:fe78:4173/64 scope link tentative 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:01.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:01.748 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T12:10:01.809 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-05-15T12:10:01.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:01.811 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-05-15T12:10:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-05-15T12:10:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T12:10:01.868 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T12:10:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T12:10:01.869 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T12:10:01.869 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:01.869 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:01.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T12:10:01.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T12:10:01.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T12:10:01.870 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:01.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:01.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:01.995 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-05-15T12:10:02.011 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-15T12:10:02.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:02.011 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-05-15T12:10:02.067 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-15T12:10:02.067 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:02.067 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:02.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:02.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-15T12:10:02.067 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:02.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:02.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:02.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:02.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-15T12:10:02.209 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:02.209 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 42:64:fd:7c:b7:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::4064:fdff:fe7c:b7e9/64 scope link tentative 2024-05-15T12:10:02.210 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:02.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-15T12:10:02.276 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:02.276 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:02.276 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 42:64:fd:7c:b7:e9 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::4064:fdff:fe7c:b7e9/64 scope link tentative 2024-05-15T12:10:02.277 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:02.278 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-15T12:10:02.278 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:02.278 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:02.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-15T12:10:02.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-15T12:10:02.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-15T12:10:02.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-15T12:10:02.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-15T12:10:02.279 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:02.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:02.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:02.432 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:02.432 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:02.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2024-05-15T12:10:02.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2024-05-15T12:10:02.432 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:02.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:02.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:02.508 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-05-15T12:10:02.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:02.509 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:02.524 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-15T12:10:02.524 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:02.525 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:02.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-05-15T12:10:02.644 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:02.700 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-05-15T12:10:02.701 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:02.702 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:02.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:02.704 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-05-15T12:10:02.756 INFO:teuthology.orchestra.run.smithi077.stdout:40 2024-05-15T12:10:02.756 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2024-05-15T12:10:02.756 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-05-15T12:10:02.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-05-15T12:10:02.823 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-05-15T12:10:02.880 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2024-05-15T12:10:02.881 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:02.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:02.882 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-05-15T12:10:02.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:2024-05-15T12:10:02.886+0000 7f3310d29480 -1 init, newargv = 0x55fdcdfb7430 newargc=15 2024-05-15T12:10:02.883 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[45754]: starting ceph client 2024-05-15T12:10:02.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[45754]: starting fuse 2024-05-15T12:10:02.898 INFO:teuthology.orchestra.run.smithi077.stdout:40 2024-05-15T12:10:02.898 INFO:teuthology.orchestra.run.smithi077.stdout:43 2024-05-15T12:10:02.898 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 43] 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-05-15T12:10:02.899 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.2")) 2024-05-15T12:10:02.900 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-05-15T12:10:03.017 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.2.45754.asok 2024-05-15T12:10:03.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:03.028 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45754.asok 2024-05-15T12:10:03.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:03.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45754.asok status 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "9b63866860f0b71216b2c0a73aedd2e0a8a5c98b", 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.0.0-3687-g9b638668 (9b63866860f0b71216b2c0a73aedd2e0a8a5c98b) squid (dev)", 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "2", 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-05-15T12:10:03.163 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "45754", 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4650, 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4650 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-05-15T12:10:03.164 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3433420293 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3433420293 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4650 192.168.0.2:0/3433420293", 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.2:0/3433420293", 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 8, 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 21, 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-05-15T12:10:03.165 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-05-15T12:10:03.166 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-05-15T12:10:03.166 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T12:10:03.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T12:10:03.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.277+0000 7fb74601c640 1 Processor -- start 2024-05-15T12:10:03.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.277+0000 7fb74601c640 1 -- start start 2024-05-15T12:10:03.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb74601c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb74015f1d0 0x7fb7400d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb74601c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7400d28c0 0x7fb7400d52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb74601c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7400d57e0 0x7fb7400d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb74601c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb740162f80 con 0x7fb7400d57e0 2024-05-15T12:10:03.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb74601c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb7401631d0 con 0x7fb74015f1d0 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb74601c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb7401634b0 con 0x7fb7400d28c0 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7400d57e0 0x7fb7400d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb7400d57e0 0x7fb7400d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59224/0 (socket says 172.21.15.77:59224) 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 -- 172.21.15.77:0/2022106456 learned_addr learned my addr 172.21.15.77:0/2022106456 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73f7fe640 1 --2- 172.21.15.77:0/2022106456 >> v2:172.21.15.83:3300/0 conn(0x7fb74015f1d0 0x7fb7400d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73effd640 1 --2- 172.21.15.77:0/2022106456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7400d28c0 0x7fb7400d52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 -- 172.21.15.77:0/2022106456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7400d28c0 msgr2=0x7fb7400d52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 --2- 172.21.15.77:0/2022106456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7400d28c0 0x7fb7400d52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 -- 172.21.15.77:0/2022106456 >> v2:172.21.15.83:3300/0 conn(0x7fb74015f1d0 msgr2=0x7fb7400d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 --2- 172.21.15.77:0/2022106456 >> v2:172.21.15.83:3300/0 conn(0x7fb74015f1d0 0x7fb7400d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.278+0000 7fb73ffff640 1 -- 172.21.15.77:0/2022106456 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb740163790 con 0x7fb7400d57e0 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.279+0000 7fb73ffff640 1 --2- 172.21.15.77:0/2022106456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d57e0 0x7fb7400d3580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb7400d3550 tx=0x7fb73802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c08a1c2c54752d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.279+0000 7fb73e7fc640 1 -- 172.21.15.77:0/2022106456 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738037070 con 0x7fb7400d57e0 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.279+0000 7fb73e7fc640 1 -- 172.21.15.77:0/2022106456 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb738032440 con 0x7fb7400d57e0 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.279+0000 7fb73e7fc640 1 -- 172.21.15.77:0/2022106456 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb738032810 con 0x7fb7400d57e0 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 -- 172.21.15.77:0/2022106456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d57e0 msgr2=0x7fb7400d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 --2- 172.21.15.77:0/2022106456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d57e0 0x7fb7400d3580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb7400d3550 tx=0x7fb73802a270 comp rx=0 tx=0).stop 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 -- 172.21.15.77:0/2022106456 shutdown_connections 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 --2- 172.21.15.77:0/2022106456 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d57e0 0x7fb7400d3580 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 --2- 172.21.15.77:0/2022106456 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb7400d28c0 0x7fb7400d52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 --2- 172.21.15.77:0/2022106456 >> v2:172.21.15.83:3300/0 conn(0x7fb74015f1d0 0x7fb7400d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 -- 172.21.15.77:0/2022106456 >> 172.21.15.77:0/2022106456 conn(0x7fb740073f10 msgr2=0x7fb740074320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:03.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 -- 172.21.15.77:0/2022106456 shutdown_connections 2024-05-15T12:10:03.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.280+0000 7fb74601c640 1 -- 172.21.15.77:0/2022106456 wait complete. 2024-05-15T12:10:03.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.281+0000 7fb74601c640 1 Processor -- start 2024-05-15T12:10:03.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.281+0000 7fb74601c640 1 -- start start 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb74601c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 0x7fb7400cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb74601c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7400d57e0 0x7fb740159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb74601c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb74015f1d0 0x7fb740148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb74601c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb7400d4ea0 con 0x7fb7400d28c0 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb74601c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb7400d4d20 con 0x7fb7400d57e0 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb74601c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb7400d3ac0 con 0x7fb74015f1d0 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 0x7fb7400cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 0x7fb7400cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59230/0 (socket says 172.21.15.77:59230) 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 -- 172.21.15.77:0/3098671725 learned_addr learned my addr 172.21.15.77:0/3098671725 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73effd640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7400d57e0 0x7fb740159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73ffff640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb74015f1d0 0x7fb740148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 -- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb74015f1d0 msgr2=0x7fb740148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:03.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb74015f1d0 0x7fb740148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 -- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7400d57e0 msgr2=0x7fb740159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7400d57e0 0x7fb740159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 -- 172.21.15.77:0/3098671725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7400cdc80 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.282+0000 7fb73f7fe640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 0x7fb7400cd430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb730007e40 tx=0x7fb73000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.283+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730014620 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.283+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb730019070 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.283+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7400cdf60 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.283+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb730014a00 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.283+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7400ce520 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.284+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb74006a640 con 0x7fb7400d28c0 2024-05-15T12:10:03.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.284+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb730014ba0 con 0x7fb7400d28c0 2024-05-15T12:10:03.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.285+0000 7fb727fff640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb72c0762d0 0x7fb72c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:03.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.285+0000 7fb73effd640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb72c0762d0 0x7fb72c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:03.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.285+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb730097eb0 con 0x7fb7400d28c0 2024-05-15T12:10:03.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.285+0000 7fb73effd640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb72c0762d0 0x7fb72c078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb74015e910 tx=0x7fb734008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:03.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.289+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb730061810 con 0x7fb7400d28c0 2024-05-15T12:10:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.509+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7400ba580 con 0x7fb7400d28c0 2024-05-15T12:10:03.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.509+0000 7fb727fff640 1 -- 172.21.15.77:0/3098671725 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7fb730061110 con 0x7fb7400d28c0 2024-05-15T12:10:03.504 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb72c0762d0 msgr2=0x7fb72c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb72c0762d0 0x7fb72c078790 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb74015e910 tx=0x7fb734008040 comp rx=0 tx=0).stop 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 msgr2=0x7fb7400cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 0x7fb7400cd430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb730007e40 tx=0x7fb73000e4b0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 shutdown_connections 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb72c0762d0 0x7fb72c078790 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb74015f1d0 0x7fb740148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb7400d57e0 0x7fb740159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 --2- 172.21.15.77:0/3098671725 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7400d28c0 0x7fb7400cd430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:03.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 >> 172.21.15.77:0/3098671725 conn(0x7fb740073f10 msgr2=0x7fb7400742f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:03.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 shutdown_connections 2024-05-15T12:10:03.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:03.511+0000 7fb74601c640 1 -- 172.21.15.77:0/3098671725 wait complete. 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T12:10:03.517 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-15T12:10:03.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:03.517 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-05-15T12:10:03.537 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42725sec preferred_lft 42725sec 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2024-05-15T12:10:03.538 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:03.538 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add name ceph-brx type bridge 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr flush dev ceph-brx 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set ceph-brx up 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-15T12:10:03.539 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:03.632 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:03.831 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:03.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:03.839 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T12:10:03.864 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-05-15T12:10:03.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:03.866 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-05-15T12:10:03.934 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-05-15T12:10:03.934 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T12:10:03.934 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T12:10:03.934 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T12:10:03.935 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T12:10:03.935 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:04.023 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:04.244 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:04.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:04.250 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-05-15T12:10:04.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:04.266 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-05-15T12:10:04.322 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:04.322 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:04.323 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:04.323 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-15T12:10:04.323 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:04.413 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:04.438 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:04.447 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-15T12:10:04.447 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:04.497 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:04.570 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:04.577 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:04.577 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:04.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.0 up 2024-05-15T12:10:04.577 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.0 master ceph-brx 2024-05-15T12:10:04.577 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:04.627 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:04.650 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:04.658 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-05-15T12:10:04.659 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:04.659 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:04.674 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-15T12:10:04.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:04.674 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:04.730 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-05-15T12:10:04.797 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-05-15T12:10:04.855 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-05-15T12:10:04.856 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-05-15T12:10:04.857 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-05-15T12:10:04.857 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:04.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:04.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:04.857 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-05-15T12:10:04.857 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:04.858 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:04.858 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-05-15T12:10:04.858 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-05-15T12:10:04.858 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-4 2024-05-15T12:10:04.858 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-5 2024-05-15T12:10:04.858 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-6 2024-05-15T12:10:04.859 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-7 2024-05-15T12:10:04.859 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-05-15T12:10:04.859 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:04.859 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:04.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:04.860 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-05-15T12:10:04.911 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-15T12:10:04.911 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-05-15T12:10:04.955 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-05-15T12:10:04.980 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-05-15T12:10:05.037 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:05.038 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-4 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-5 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-6 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-7 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:05.039 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:05.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.040 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-05-15T12:10:05.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi083.stderr:2024-05-15T12:10:05.051+0000 7f2b0451c480 -1 init, newargv = 0x557526d1de70 newargc=15 2024-05-15T12:10:05.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi083.stderr:ceph-fuse[42806]: starting ceph client 2024-05-15T12:10:05.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi083.stderr:ceph-fuse[42806]: starting fuse 2024-05-15T12:10:05.062 INFO:teuthology.orchestra.run.smithi083.stdout:41 2024-05-15T12:10:05.062 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-05-15T12:10:05.062 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-05-15T12:10:05.062 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-05-15T12:10:05.062 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-05-15T12:10:05.062 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-15T12:10:05.063 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.1")) 2024-05-15T12:10:05.064 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-05-15T12:10:05.181 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.1.42806.asok 2024-05-15T12:10:05.184 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:05.192 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42806.asok 2024-05-15T12:10:05.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.193 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42806.asok status 2024-05-15T12:10:05.329 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-05-15T12:10:05.329 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-05-15T12:10:05.329 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "9b63866860f0b71216b2c0a73aedd2e0a8a5c98b", 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.0.0-3687-g9b638668 (9b63866860f0b71216b2c0a73aedd2e0a8a5c98b) squid (dev)", 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "1", 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "42806", 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:05.330 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-05-15T12:10:05.331 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-05-15T12:10:05.331 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4439, 2024-05-15T12:10:05.331 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-05-15T12:10:05.331 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-05-15T12:10:05.331 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-05-15T12:10:05.331 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4439 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 32055281 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-05-15T12:10:05.332 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.1:0", 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 32055281 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4439 192.168.0.1:0/32055281", 2024-05-15T12:10:05.333 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.1:0/32055281", 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 8, 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 21, 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-05-15T12:10:05.334 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-05-15T12:10:05.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T12:10:05.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.455+0000 7f35e03c8640 1 Processor -- start 2024-05-15T12:10:05.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.455+0000 7f35e03c8640 1 -- start start 2024-05-15T12:10:05.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.456+0000 7f35e03c8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f460 0x7f35d80d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.456+0000 7f35e03c8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35d815f840 0x7f35d80d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.456+0000 7f35e03c8640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d80d0dd0 con 0x7f35d80d0060 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.456+0000 7f35e03c8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f35d80d19e0 con 0x7f35d815f840 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.456+0000 7f35e03c8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f35d80d10b0 con 0x7f35d815f460 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35d815f840 0x7f35d80d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f35d815f840 0x7f35d80d3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59236/0 (socket says 172.21.15.77:59236) 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 -- 172.21.15.77:0/2163865268 learned_addr learned my addr 172.21.15.77:0/2163865268 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:05.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35de164640 1 --2- 172.21.15.77:0/2163865268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f460 0x7f35d80d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 -- 172.21.15.77:0/2163865268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f460 msgr2=0x7f35d80d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 --2- 172.21.15.77:0/2163865268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f460 0x7f35d80d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 -- 172.21.15.77:0/2163865268 >> v1:172.21.15.83:6789/0 conn(0x7f35d80d0060 legacy=0x7f35d80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.457+0000 7f35dd963640 1 -- 172.21.15.77:0/2163865268 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d80d1390 con 0x7f35d815f840 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35dd963640 1 --2- 172.21.15.77:0/2163865268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d815f840 0x7f35d80d3e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009870 tx=0x7f35cc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a5d17384207819 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35dd162640 1 -- 172.21.15.77:0/2163865268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc037070 con 0x7f35d815f840 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35dd162640 1 -- 172.21.15.77:0/2163865268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc032440 con 0x7f35d815f840 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35dd162640 1 -- 172.21.15.77:0/2163865268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc032810 con 0x7f35d815f840 2024-05-15T12:10:05.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35e03c8640 1 -- 172.21.15.77:0/2163865268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d815f840 msgr2=0x7f35d80d3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35e03c8640 1 --2- 172.21.15.77:0/2163865268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d815f840 0x7f35d80d3e00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009870 tx=0x7f35cc02a1c0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35e03c8640 1 -- 172.21.15.77:0/2163865268 shutdown_connections 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35e03c8640 1 --2- 172.21.15.77:0/2163865268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d815f840 0x7f35d80d3e00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35e03c8640 1 --2- 172.21.15.77:0/2163865268 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f460 0x7f35d80d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.458+0000 7f35e03c8640 1 -- 172.21.15.77:0/2163865268 >> 172.21.15.77:0/2163865268 conn(0x7f35d808ec10 msgr2=0x7f35d809e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.459+0000 7f35e03c8640 1 -- 172.21.15.77:0/2163865268 shutdown_connections 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.459+0000 7f35e03c8640 1 -- 172.21.15.77:0/2163865268 wait complete. 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 Processor -- start 2024-05-15T12:10:05.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 -- start start 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 0x7f35d81f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35d815f460 0x7f35d8158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f840 0x7f35d80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f35d80b4b80 con 0x7f35d80d0060 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f35d80b4a00 con 0x7f35d815f460 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.460+0000 7f35e03c8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f35d80b4d00 con 0x7f35d815f840 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 0x7f35d81f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 0x7f35d81f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59252/0 (socket says 172.21.15.77:59252) 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 -- 172.21.15.77:0/3703431474 learned_addr learned my addr 172.21.15.77:0/3703431474 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:05.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35dd963640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35d815f460 0x7f35d8158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de965640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f840 0x7f35d80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 -- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f840 msgr2=0x7f35d80c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f840 0x7f35d80c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 -- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35d815f460 msgr2=0x7f35d8158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35d815f460 0x7f35d8158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 -- 172.21.15.77:0/3703431474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d81604d0 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35de164640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 0x7f35d81f5410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009db0 tx=0x7f35c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8018020 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c8014480 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8014850 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d81607b0 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.461+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d8160d70 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.462+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d806a640 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.463+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f35c8005d10 con 0x7f35d80d0060 2024-05-15T12:10:05.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.463+0000 7f35d6ffd640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f35c40762d0 0x7f35c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.463+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f35c8098060 con 0x7f35d80d0060 2024-05-15T12:10:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.463+0000 7f35dd963640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f35c40762d0 0x7f35c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.464+0000 7f35dd963640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f35c40762d0 0x7f35c4078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35cc034000 tx=0x7f35cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.468+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f35c8022070 con 0x7f35d80d0060 2024-05-15T12:10:05.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.689+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f35d815e9e0 con 0x7f35d80d0060 2024-05-15T12:10:05.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.689+0000 7f35d6ffd640 1 -- 172.21.15.77:0/3703431474 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f35c8010040 con 0x7f35d80d0060 2024-05-15T12:10:05.684 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T12:10:05.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f35c40762d0 msgr2=0x7f35c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:05.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f35c40762d0 0x7f35c4078790 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35cc034000 tx=0x7f35cc02e000 comp rx=0 tx=0).stop 2024-05-15T12:10:05.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 msgr2=0x7f35d81f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:05.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 0x7f35d81f5410 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009db0 tx=0x7f35c800c490 comp rx=0 tx=0).stop 2024-05-15T12:10:05.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 shutdown_connections 2024-05-15T12:10:05.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f35c40762d0 0x7f35c4078790 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f35d815f840 0x7f35d80c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f35d815f460 0x7f35d8158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 --2- 172.21.15.77:0/3703431474 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35d80d0060 0x7f35d81f5410 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:05.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 >> 172.21.15.77:0/3703431474 conn(0x7f35d808ec10 msgr2=0x7f35d806dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:05.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 shutdown_connections 2024-05-15T12:10:05.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:05.691+0000 7f35e03c8640 1 -- 172.21.15.77:0/3703431474 wait complete. 2024-05-15T12:10:05.697 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-15T12:10:05.697 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T12:10:05.697 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi083.front.sepia.ceph.com 2024-05-15T12:10:05.697 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-15T12:10:05.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:05.697 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-15T12:10:05.698 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-15T12:10:05.698 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T12:10:05.698 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-15T12:10:05.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.698 DEBUG:teuthology.orchestra.run.smithi083:> ip addr 2024-05-15T12:10:05.717 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:05.717 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:05.717 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:05.717 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:05.718 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:05.718 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:05.718 INFO:teuthology.orchestra.run.smithi083.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:05.718 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1e brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:05.719 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f0 2024-05-15T12:10:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:05.719 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:d8:da:1f brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:05.719 INFO:teuthology.orchestra.run.smithi083.stdout: altname enp7s0f1 2024-05-15T12:10:05.719 INFO:teuthology.orchestra.run.smithi083.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:05.720 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:90 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:05.720 INFO:teuthology.orchestra.run.smithi083.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T12:10:05.720 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 0c:c4:7a:8f:ce:91 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:05.720 INFO:teuthology.orchestra.run.smithi083.stdout: inet 172.21.15.83/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-15T12:10:05.720 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft 42722sec preferred_lft 42722sec 2024-05-15T12:10:05.721 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::ec4:7aff:fe8f:ce91/64 scope link 2024-05-15T12:10:05.721 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:05.721 INFO:teuthology.orchestra.run.smithi083.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:05.721 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether ce:3a:bb:e3:8c:32 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:05.722 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-15T12:10:05.722 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:05.722 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::7014:b9ff:fef4:7041/64 scope link 2024-05-15T12:10:05.722 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:05.722 INFO:teuthology.orchestra.run.smithi083.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-15T12:10:05.723 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether ce:3a:bb:e3:8c:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:05.723 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::cc3a:bbff:fee3:8c32/64 scope link tentative 2024-05-15T12:10:05.723 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:05.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.724 DEBUG:teuthology.orchestra.run.smithi083:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T12:10:05.782 INFO:teuthology.orchestra.run.smithi083.stdout:1 2024-05-15T12:10:05.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.784 DEBUG:teuthology.orchestra.run.smithi083:> route 2024-05-15T12:10:05.842 INFO:teuthology.orchestra.run.smithi083.stdout:Kernel IP routing table 2024-05-15T12:10:05.843 INFO:teuthology.orchestra.run.smithi083.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T12:10:05.843 INFO:teuthology.orchestra.run.smithi083.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T12:10:05.843 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T12:10:05.843 INFO:teuthology.orchestra.run.smithi083.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T12:10:05.844 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:05.844 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:05.844 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T12:10:05.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T12:10:05.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T12:10:05.845 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:05.932 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:05.964 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:05.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.971 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-05-15T12:10:05.986 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-15T12:10:05.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:05.986 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list-id 2024-05-15T12:10:06.041 INFO:teuthology.orchestra.run.smithi083.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-15T12:10:06.042 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:06.042 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:06.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-15T12:10:06.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-15T12:10:06.042 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:06.132 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:06.155 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:06.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:06.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-15T12:10:06.185 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:06.185 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 62:03:3a:ea:12:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::6003:3aff:feea:12eb/64 scope link 2024-05-15T12:10:06.186 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:06.187 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-15T12:10:06.253 INFO:teuthology.orchestra.run.smithi083.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:06.253 INFO:teuthology.orchestra.run.smithi083.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:06.253 INFO:teuthology.orchestra.run.smithi083.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:06.253 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: link/ether 62:03:3a:ea:12:eb brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: inet6 fe80::6003:3aff:feea:12eb/64 scope link 2024-05-15T12:10:06.254 INFO:teuthology.orchestra.run.smithi083.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:06.255 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-15T12:10:06.256 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:06.344 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:06.402 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:06.408 DEBUG:teuthology.orchestra.run.smithi083:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:06.408 DEBUG:teuthology.orchestra.run.smithi083:> set -e 2024-05-15T12:10:06.408 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set brx.1 up 2024-05-15T12:10:06.408 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link set dev brx.1 master ceph-brx 2024-05-15T12:10:06.408 DEBUG:teuthology.orchestra.run.smithi083:> ') 2024-05-15T12:10:06.456 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:06.478 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:06.484 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-05-15T12:10:06.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:06.485 DEBUG:teuthology.orchestra.run.smithi083:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:06.500 INFO:teuthology.orchestra.run.smithi083.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-15T12:10:06.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:06.500 DEBUG:teuthology.orchestra.run.smithi083:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:06.555 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-05-15T12:10:06.620 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:06.678 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-05-15T12:10:06.678 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-05-15T12:10:06.678 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-05-15T12:10:06.678 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-05-15T12:10:06.678 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:06.679 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-4 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-5 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-6 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-7 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:06.680 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-15T12:10:06.681 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-15T12:10:06.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:06.681 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-05-15T12:10:06.734 INFO:teuthology.orchestra.run.smithi083.stdout:41 2024-05-15T12:10:06.734 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-05-15T12:10:06.734 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-05-15T12:10:06.777 DEBUG:teuthology.orchestra.run.smithi083:> sudo modprobe fuse 2024-05-15T12:10:06.803 DEBUG:teuthology.orchestra.run.smithi083:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:06.859 INFO:teuthology.orchestra.run.smithi083.stdout:/proc 2024-05-15T12:10:06.859 INFO:teuthology.orchestra.run.smithi083.stdout:/sys 2024-05-15T12:10:06.859 INFO:teuthology.orchestra.run.smithi083.stdout:/dev 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/security 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/shm 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/pts 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/run 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/cgroup 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/pstore 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/bpf 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/ 2024-05-15T12:10:06.860 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/selinux 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/mqueue 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/tracing 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/debug 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/dev/hugepages 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/sys/kernel/config 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:06.861 INFO:teuthology.orchestra.run.smithi083.stdout:/run/user/1000 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-4 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-5 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-6 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/var/lib/ceph/osd/ceph-7 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-15T12:10:06.862 INFO:teuthology.orchestra.run.smithi083.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-15T12:10:06.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:06.863 DEBUG:teuthology.orchestra.run.smithi083:> ls /sys/fs/fuse/connections 2024-05-15T12:10:06.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi083.stderr:2024-05-15T12:10:06.865+0000 7f9570411480 -1 init, newargv = 0x55e2248e86d0 newargc=15 2024-05-15T12:10:06.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi083.stderr:ceph-fuse[43260]: starting ceph client 2024-05-15T12:10:06.865 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi083.stderr:ceph-fuse[43260]: starting fuse 2024-05-15T12:10:06.879 INFO:teuthology.orchestra.run.smithi083.stdout:41 2024-05-15T12:10:06.879 INFO:teuthology.orchestra.run.smithi083.stdout:43 2024-05-15T12:10:06.879 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 43] 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> sudo stdin-killer -- python3 -c ' 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> import glob 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> import re 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> import os 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> import subprocess 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> def _find_admin_socket(client_name): 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> files = glob.glob(asok_path) 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> # Given a non-glob path, it better be there 2024-05-15T12:10:06.880 DEBUG:teuthology.orchestra.run.smithi083:> if "*" not in asok_path: 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> assert(len(files) == 1) 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> return files[0] 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> for f in files: 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> contents = proc_f.read() 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> if mountpoint in contents: 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> return f 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> print(_find_admin_socket("client.3")) 2024-05-15T12:10:06.881 DEBUG:teuthology.orchestra.run.smithi083:> ' 2024-05-15T12:10:06.998 INFO:teuthology.orchestra.run.smithi083.stdout:/var/run/ceph/ceph-client.3.43260.asok 2024-05-15T12:10:07.001 INFO:teuthology.orchestra.run.smithi083.stderr:2024-05-15T12:10:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:07.009 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43260.asok 2024-05-15T12:10:07.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43260.asok status 2024-05-15T12:10:07.144 INFO:teuthology.orchestra.run.smithi083.stdout:{ 2024-05-15T12:10:07.144 INFO:teuthology.orchestra.run.smithi083.stdout: "metadata": { 2024-05-15T12:10:07.144 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_sha1": "9b63866860f0b71216b2c0a73aedd2e0a8a5c98b", 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "ceph_version": "ceph version 19.0.0-3687-g9b638668 (9b63866860f0b71216b2c0a73aedd2e0a8a5c98b) squid (dev)", 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "entity_id": "3", 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "hostname": "smithi083", 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "pid": "43260", 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "root": "/" 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:07.145 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_count": 0, 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "dentry_pinned_count": 0, 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "id": 4594, 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "inst": { 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "name": { 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "client", 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "num": 4594 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.2:0", 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2160181385 2024-05-15T12:10:07.146 INFO:teuthology.orchestra.run.smithi083.stdout: } 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": { 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "type": "v1", 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "addr": "192.168.0.2:0", 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "nonce": 2160181385 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: }, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "inst_str": "client.4594 192.168.0.2:0/2160181385", 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "addr_str": "192.168.0.2:0/2160181385", 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "inode_count": 1, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "mds_epoch": 8, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch": 21, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "osd_epoch_barrier": 0, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "blocklisted": false, 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout: "fs_name": "cephfs" 2024-05-15T12:10:07.147 INFO:teuthology.orchestra.run.smithi083.stdout:} 2024-05-15T12:10:07.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.153 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-05-15T12:10:07.153 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:07.173 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-05-15T12:10:07.173 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:07.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:07.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.245 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-05-15T12:10:07.245 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:07.305 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-05-15T12:10:07.305 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:07.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:07.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.377 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-05-15T12:10:07.377 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:07.393 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-05-15T12:10:07.393 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:07.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.393 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:07.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.458 DEBUG:teuthology.orchestra.run.smithi083:> stat --file-system '--printf=%T 2024-05-15T12:10:07.458 DEBUG:teuthology.orchestra.run.smithi083:> ' -- /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:07.514 INFO:teuthology.orchestra.run.smithi083.stdout:fuseblk 2024-05-15T12:10:07.514 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:07.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:07.515 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:07.579 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-15T12:10:07.696 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-15T12:10:07.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:10:07.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.809+0000 7fce7c72b640 1 Processor -- start 2024-05-15T12:10:07.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.809+0000 7fce7c72b640 1 -- start start 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.810+0000 7fce7c72b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 0x7fce740d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.810+0000 7fce7c72b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce740d0dd0 con 0x7fce7415f460 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.810+0000 7fce7c72b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce740d10b0 con 0x7fce7415f840 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.810+0000 7fce7c72b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fce740d19e0 con 0x7fce740d3fd0 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce7a4c7640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fce7415f460 0x7fce740d38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53082/0 (socket says 172.21.15.77:53082) 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce7a4c7640 1 -- 172.21.15.77:0/1284439764 learned_addr learned my addr 172.21.15.77:0/1284439764 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce79cc6640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 0x7fce740d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547361317 0 0) 0x7fce740d0dd0 con 0x7fce7415f460 2024-05-15T12:10:07.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce5c003520 con 0x7fce7415f460 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3937223036 0 0) 0x7fce5c003520 con 0x7fce7415f460 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 msgr2=0x7fce740d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 0x7fce740d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 >> v1:172.21.15.83:6789/0 conn(0x7fce7415f840 legacy=0x7fce740d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce740d1390 con 0x7fce7415f460 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fce64001a70 con 0x7fce7415f460 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 >> v1:172.21.15.77:6789/0 conn(0x7fce7415f460 legacy=0x7fce740d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 0x7fce5c003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce5c003fe0 0x7fce5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce740d19e0 con 0x7fce5c003fe0 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c00bbd0 con 0x7fce5c004d40 2024-05-15T12:10:07.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c00bdd0 con 0x7fce740d3fd0 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce79cc6640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce5c003fe0 0x7fce5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce7a4c7640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 0x7fce5c003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.811+0000 7fce7acc8640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce79cc6640 1 -- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 msgr2=0x7fce5c003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce79cc6640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740d3fd0 0x7fce5c003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce79cc6640 1 -- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c004d40 msgr2=0x7fce5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce79cc6640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce79cc6640 1 -- 172.21.15.77:0/1284439764 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c003520 con 0x7fce5c003fe0 2024-05-15T12:10:07.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce79cc6640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce5c003fe0 0x7fce5c004800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fce68009ac0 tx=0x7fce5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2152738ed54b2b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:07.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68036070 con 0x7fce5c003fe0 2024-05-15T12:10:07.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce68031400 con 0x7fce5c003fe0 2024-05-15T12:10:07.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.812+0000 7fce794c5640 1 -- 172.21.15.77:0/1284439764 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce68009690 con 0x7fce5c003fe0 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7c72b640 1 -- 172.21.15.77:0/1284439764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce5c003fe0 msgr2=0x7fce5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7c72b640 1 --2- 172.21.15.77:0/1284439764 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce5c003fe0 0x7fce5c004800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fce68009ac0 tx=0x7fce5c005830 comp rx=0 tx=0).stop 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7acc8640 1 -- 172.21.15.77:0/1284439764 reap_dead start 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7c72b640 1 -- 172.21.15.77:0/1284439764 shutdown_connections 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7c72b640 1 -- 172.21.15.77:0/1284439764 >> 172.21.15.77:0/1284439764 conn(0x7fce7408ec10 msgr2=0x7fce7409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7c72b640 1 -- 172.21.15.77:0/1284439764 shutdown_connections 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.813+0000 7fce7c72b640 1 -- 172.21.15.77:0/1284439764 wait complete. 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.814+0000 7fce7c72b640 1 Processor -- start 2024-05-15T12:10:07.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.814+0000 7fce7c72b640 1 -- start start 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7c72b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c003fe0 0x7fce7415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7c72b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740cacf0 0x7fce74161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7c72b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 0x7fce7406dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7c72b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce740b5b90 con 0x7fce74161740 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7c72b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fce740b5a10 con 0x7fce5c003fe0 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7c72b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fce740b5d10 con 0x7fce740cacf0 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 0x7fce7406dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 0x7fce7406dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59270/0 (socket says 172.21.15.77:59270) 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 -- 172.21.15.77:0/2445678786 learned_addr learned my addr 172.21.15.77:0/2445678786 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7a4c7640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c003fe0 0x7fce7415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce79cc6640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740cacf0 0x7fce74161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 -- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740cacf0 msgr2=0x7fce74161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740cacf0 0x7fce74161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 -- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c003fe0 msgr2=0x7fce7415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:07.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c003fe0 0x7fce7415ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7acc8640 1 -- 172.21.15.77:0/2445678786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce740cb740 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.815+0000 7fce7a4c7640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c003fe0 0x7fce7415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.816+0000 7fce7acc8640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 0x7fce7406dae0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fce7408e680 tx=0x7fce6c00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.816+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c019070 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.816+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c0050d0 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.816+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce740c8970 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.816+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c0054a0 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.816+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce740c8f30 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.817+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7406a640 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.817+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fce6c01c070 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.818+0000 7fce72ffd640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fce600764a0 0x7fce60078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.818+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fce6c096530 con 0x7fce74161740 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.818+0000 7fce7a4c7640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fce600764a0 0x7fce60078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:07.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.818+0000 7fce7a4c7640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fce600764a0 0x7fce60078960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce740cf200 tx=0x7fce64006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:07.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:07.822+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fce6c05ff20 con 0x7fce74161740 2024-05-15T12:10:08.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.006+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce740b2e20 con 0x7fce74161740 2024-05-15T12:10:08.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.008+0000 7fce72ffd640 1 -- 172.21.15.77:0/2445678786 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7fce6c05f820 con 0x7fce74161740 2024-05-15T12:10:08.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:08.003 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fce600764a0 msgr2=0x7fce60078960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fce600764a0 0x7fce60078960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fce740cf200 tx=0x7fce64006040 comp rx=0 tx=0).stop 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 msgr2=0x7fce7406dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 0x7fce7406dae0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fce7408e680 tx=0x7fce6c00fc00 comp rx=0 tx=0).stop 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 shutdown_connections 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fce600764a0 0x7fce60078960 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fce740cacf0 0x7fce74161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce74161740 0x7fce7406dae0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 --2- 172.21.15.77:0/2445678786 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fce5c003fe0 0x7fce7415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 >> 172.21.15.77:0/2445678786 conn(0x7fce7408ec10 msgr2=0x7fce740d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 shutdown_connections 2024-05-15T12:10:08.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.010+0000 7fce7c72b640 1 -- 172.21.15.77:0/2445678786 wait complete. 2024-05-15T12:10:08.016 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-15T12:09:30.256214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-15T12:09:40.874294+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-15T12:09:41.980772+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-15T12:10:08.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-15T12:10:08.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.124+0000 7f0d475c9640 1 Processor -- start 2024-05-15T12:10:08.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.124+0000 7f0d475c9640 1 -- start start 2024-05-15T12:10:08.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d475c9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0d4006cb00 0x7f0d40073d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d475c9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d400b74d0 con 0x7f0d40148de0 2024-05-15T12:10:08.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d475c9640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d400746d0 con 0x7f0d400742c0 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d475c9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0d400b5140 con 0x7f0d4006cb00 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d44b64640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0d4006cb00 0x7f0d40073d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d45365640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0d40148de0 0x7f0d4006c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53090/0 (socket says 172.21.15.77:53090) 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.125+0000 7f0d45365640 1 -- 172.21.15.77:0/452722533 learned_addr learned my addr 172.21.15.77:0/452722533 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.126+0000 7f0d44b64640 1 -- 172.21.15.77:0/452722533 >> v1:172.21.15.83:6789/0 conn(0x7f0d400742c0 legacy=0x7f0d400708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.126+0000 7f0d44b64640 1 -- 172.21.15.77:0/452722533 >> v1:172.21.15.77:6789/0 conn(0x7f0d40148de0 legacy=0x7f0d4006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.126+0000 7f0d37fff640 1 -- 172.21.15.77:0/452722533 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097472470 0 0) 0x7f0d400b74d0 con 0x7f0d40148de0 2024-05-15T12:10:08.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.126+0000 7f0d44b64640 1 -- 172.21.15.77:0/452722533 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d400b5420 con 0x7f0d4006cb00 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.126+0000 7f0d44b64640 1 --2- 172.21.15.77:0/452722533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d4006cb00 0x7f0d40073d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0d300097a0 tx=0x7f0d3002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52206cf85524042c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d37fff640 1 -- 172.21.15.77:0/452722533 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30037070 con 0x7f0d4006cb00 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d37fff640 1 -- 172.21.15.77:0/452722533 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30032440 con 0x7f0d4006cb00 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d37fff640 1 -- 172.21.15.77:0/452722533 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30032810 con 0x7f0d4006cb00 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 -- 172.21.15.77:0/452722533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d4006cb00 msgr2=0x7f0d40073d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 --2- 172.21.15.77:0/452722533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d4006cb00 0x7f0d40073d80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0d300097a0 tx=0x7f0d3002a180 comp rx=0 tx=0).stop 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 -- 172.21.15.77:0/452722533 shutdown_connections 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 --2- 172.21.15.77:0/452722533 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d4006cb00 0x7f0d40073d80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 -- 172.21.15.77:0/452722533 >> 172.21.15.77:0/452722533 conn(0x7f0d400b3ca0 msgr2=0x7f0d400b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 -- 172.21.15.77:0/452722533 shutdown_connections 2024-05-15T12:10:08.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.127+0000 7f0d475c9640 1 -- 172.21.15.77:0/452722533 wait complete. 2024-05-15T12:10:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.128+0000 7f0d475c9640 1 Processor -- start 2024-05-15T12:10:08.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.128+0000 7f0d475c9640 1 -- start start 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d475c9640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4006cb00 0x7f0d4013f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d475c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 0x7f0d4015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d475c9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d40148de0 0x7f0d400d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d475c9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d40071000 con 0x7f0d400742c0 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d475c9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0d400b59e0 con 0x7f0d40148de0 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d475c9640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0d40071180 con 0x7f0d4006cb00 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d44b64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 0x7f0d4015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d44b64640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 0x7f0d4015bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59290/0 (socket says 172.21.15.77:59290) 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d44b64640 1 -- 172.21.15.77:0/3413526999 learned_addr learned my addr 172.21.15.77:0/3413526999 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d45b66640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d40148de0 0x7f0d400d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d45365640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4006cb00 0x7f0d4013f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d44b64640 1 -- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4006cb00 msgr2=0x7f0d4013f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.129+0000 7f0d44b64640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4006cb00 0x7f0d4013f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d44b64640 1 -- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d40148de0 msgr2=0x7f0d400d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d44b64640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d40148de0 0x7f0d400d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d44b64640 1 -- 172.21.15.77:0/3413526999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d401401b0 con 0x7f0d400742c0 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d45365640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4006cb00 0x7f0d4013f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d44b64640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 0x7f0d4015bcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0d300097a0 tx=0x7f0d300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30041070 con 0x7f0d400742c0 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3003c870 con 0x7f0d400742c0 2024-05-15T12:10:08.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d30037040 con 0x7f0d400742c0 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d40140490 con 0x7f0d400742c0 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.130+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d40140a50 con 0x7f0d400742c0 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.131+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d400694d0 con 0x7f0d400742c0 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.132+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d30044070 con 0x7f0d400742c0 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.132+0000 7f0d35ffb640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0d240762d0 0x7f0d24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.132+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d300b8120 con 0x7f0d400742c0 2024-05-15T12:10:08.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.132+0000 7f0d45365640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0d240762d0 0x7f0d24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.132+0000 7f0d45365640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0d240762d0 0x7f0d24078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0012e0 tx=0x7f0d3c005b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.136+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d30081420 con 0x7f0d400742c0 2024-05-15T12:10:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.319+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0d400ce3e0 con 0x7f0d400742c0 2024-05-15T12:10:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.319+0000 7f0d35ffb640 1 -- 172.21.15.77:0/3413526999 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0d30085720 con 0x7f0d400742c0 2024-05-15T12:10:08.314 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-05-15T12:10:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0d240762d0 msgr2=0x7f0d24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0d240762d0 0x7f0d24078790 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0012e0 tx=0x7f0d3c005b90 comp rx=0 tx=0).stop 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 msgr2=0x7f0d4015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 0x7f0d4015bcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0d300097a0 tx=0x7f0d300046c0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 shutdown_connections 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0d240762d0 0x7f0d24078790 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d40148de0 0x7f0d400d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d400742c0 0x7f0d4015bcd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 --2- 172.21.15.77:0/3413526999 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d4006cb00 0x7f0d4013f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.321+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 >> 172.21.15.77:0/3413526999 conn(0x7f0d400b3ca0 msgr2=0x7f0d40073370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.322+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 shutdown_connections 2024-05-15T12:10:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.322+0000 7f0d475c9640 1 -- 172.21.15.77:0/3413526999 wait complete. 2024-05-15T12:10:08.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-15T12:10:08.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.435+0000 7f1e0d454640 1 Processor -- start 2024-05-15T12:10:08.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.435+0000 7f1e0d454640 1 -- start start 2024-05-15T12:10:08.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.436+0000 7f1e0d454640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 0x7f1e08073770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.436+0000 7f1e0d454640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e0813ff00 0x7f1e08140390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.436+0000 7f1e0d454640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e0815cff0 con 0x7f1e080ce6d0 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.436+0000 7f1e0d454640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1e080ceab0 con 0x7f1e0813ff00 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.436+0000 7f1e0d454640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0815d2d0 con 0x7f1e080732f0 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e067fc640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 0x7f1e08073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e077fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1e0813ff00 0x7f1e08140390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e067fc640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 0x7f1e08073770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:49258/0 (socket says 172.21.15.77:49258) 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e06ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f1e080ce6d0 0x7f1e0815c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:57786/0 (socket says 172.21.15.77:57786) 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e067fc640 1 -- 172.21.15.77:0/3618653251 learned_addr learned my addr 172.21.15.77:0/3618653251 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e077fe640 1 -- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 msgr2=0x7f1e08073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e077fe640 1 --2- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 0x7f1e08073770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e077fe640 1 -- 172.21.15.77:0/3618653251 >> v1:172.21.15.83:6789/0 conn(0x7f1e080ce6d0 legacy=0x7f1e0815c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e05ffb640 1 -- 172.21.15.77:0/3618653251 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804017551 0 0) 0x7f1e0815cff0 con 0x7f1e080ce6d0 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e077fe640 1 -- 172.21.15.77:0/3618653251 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0813f700 con 0x7f1e0813ff00 2024-05-15T12:10:08.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.437+0000 7f1e067fc640 1 --2- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 0x7f1e08073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e077fe640 1 --2- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e0813ff00 0x7f1e08140390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e000097a0 tx=0x7f1e0002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df0b1004a268a5b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e05ffb640 1 -- 172.21.15.77:0/3618653251 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00037070 con 0x7f1e0813ff00 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e05ffb640 1 -- 172.21.15.77:0/3618653251 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e00032440 con 0x7f1e0813ff00 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e05ffb640 1 -- 172.21.15.77:0/3618653251 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e00032810 con 0x7f1e0813ff00 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 -- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e0813ff00 msgr2=0x7f1e08140390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 --2- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e0813ff00 0x7f1e08140390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e000097a0 tx=0x7f1e0002a180 comp rx=0 tx=0).stop 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 -- 172.21.15.77:0/3618653251 shutdown_connections 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 --2- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e0813ff00 0x7f1e08140390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 --2- 172.21.15.77:0/3618653251 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e080732f0 0x7f1e08073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 -- 172.21.15.77:0/3618653251 >> 172.21.15.77:0/3618653251 conn(0x7f1e080b3c30 msgr2=0x7f1e080b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 -- 172.21.15.77:0/3618653251 shutdown_connections 2024-05-15T12:10:08.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.438+0000 7f1e0d454640 1 -- 172.21.15.77:0/3618653251 wait complete. 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 Processor -- start 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 -- start start 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 0x7f1e0815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e080ce6d0 0x7f1e081354d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e0813ff00 0x7f1e0815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08070be0 con 0x7f1e080732f0 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08070a60 con 0x7f1e080ce6d0 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e0d454640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0815cbe0 con 0x7f1e0813ff00 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e06ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 0x7f1e0815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e06ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 0x7f1e0815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59294/0 (socket says 172.21.15.77:59294) 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.440+0000 7f1e06ffd640 1 -- 172.21.15.77:0/643986571 learned_addr learned my addr 172.21.15.77:0/643986571 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:08.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e067fc640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e080ce6d0 0x7f1e081354d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e077fe640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e0813ff00 0x7f1e0815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e06ffd640 1 -- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e0813ff00 msgr2=0x7f1e0815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e06ffd640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e0813ff00 0x7f1e0815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e06ffd640 1 -- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e080ce6d0 msgr2=0x7f1e081354d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e06ffd640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e080ce6d0 0x7f1e081354d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e06ffd640 1 -- 172.21.15.77:0/643986571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0815aa50 con 0x7f1e080732f0 2024-05-15T12:10:08.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e06ffd640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 0x7f1e0815a150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1df800c870 tx=0x7f1df800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8018070 con 0x7f1e080732f0 2024-05-15T12:10:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df800a5e0 con 0x7f1e080732f0 2024-05-15T12:10:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0815ad30 con 0x7f1e080732f0 2024-05-15T12:10:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df800a9d0 con 0x7f1e080732f0 2024-05-15T12:10:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.441+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0815b2f0 con 0x7f1e080732f0 2024-05-15T12:10:08.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.442+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e080694d0 con 0x7f1e080732f0 2024-05-15T12:10:08.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.443+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1df800ab70 con 0x7f1e080732f0 2024-05-15T12:10:08.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.443+0000 7f1dff7fe640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1de80762d0 0x7f1de8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.443+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1df8096b80 con 0x7f1e080732f0 2024-05-15T12:10:08.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.443+0000 7f1e067fc640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1de80762d0 0x7f1de8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.444+0000 7f1e067fc640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1de80762d0 0x7f1de8078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e0815c440 tx=0x7f1df0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.448+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1df805fea0 con 0x7f1e080732f0 2024-05-15T12:10:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.629+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1e0815b790 con 0x7f1e080732f0 2024-05-15T12:10:08.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.629+0000 7f1dff7fe640 1 -- 172.21.15.77:0/643986571 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f1df80641a0 con 0x7f1e080732f0 2024-05-15T12:10:08.625 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1de80762d0 msgr2=0x7f1de8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1de80762d0 0x7f1de8078790 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1e0815c440 tx=0x7f1df0009240 comp rx=0 tx=0).stop 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 msgr2=0x7f1e0815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 0x7f1e0815a150 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1df800c870 tx=0x7f1df800cd30 comp rx=0 tx=0).stop 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 shutdown_connections 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1de80762d0 0x7f1de8078790 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1e0813ff00 0x7f1e0815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1e080ce6d0 0x7f1e081354d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 --2- 172.21.15.77:0/643986571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e080732f0 0x7f1e0815a150 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 >> 172.21.15.77:0/643986571 conn(0x7f1e080b3c30 msgr2=0x7f1e080b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 shutdown_connections 2024-05-15T12:10:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.632+0000 7f1e0d454640 1 -- 172.21.15.77:0/643986571 wait complete. 2024-05-15T12:10:08.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-15T12:10:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.745+0000 7fc0dce2c640 1 Processor -- start 2024-05-15T12:10:08.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.745+0000 7fc0dce2c640 1 -- start start 2024-05-15T12:10:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0dce2c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc0d815d730 0x7fc0d80b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0dce2c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d815db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0dce2c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0d815e050 0x7fc0d806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0dce2c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d80b7670 con 0x7fc0d815e050 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0dce2c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc0d80b7390 con 0x7fc0d815d730 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0dce2c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d80b4f10 con 0x7fc0d80b4670 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0d815e050 0x7fc0d806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0d815e050 0x7fc0d806ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59300/0 (socket says 172.21.15.77:59300) 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 -- 172.21.15.77:0/1034186753 learned_addr learned my addr 172.21.15.77:0/1034186753 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d659c640 1 --2- 172.21.15.77:0/1034186753 >> v2:172.21.15.83:3300/0 conn(0x7fc0d815d730 0x7fc0d80b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 -- 172.21.15.77:0/1034186753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 msgr2=0x7fc0d815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0cffff640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 -- 172.21.15.77:0/1034186753 >> v2:172.21.15.83:3300/0 conn(0x7fc0d815d730 msgr2=0x7fc0d80b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 --2- 172.21.15.77:0/1034186753 >> v2:172.21.15.83:3300/0 conn(0x7fc0d815d730 0x7fc0d80b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d6d9d640 1 -- 172.21.15.77:0/1034186753 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80b4c30 con 0x7fc0d815e050 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0d659c640 1 --2- 172.21.15.77:0/1034186753 >> v2:172.21.15.83:3300/0 conn(0x7fc0d815d730 0x7fc0d80b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.746+0000 7fc0cffff640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0d6d9d640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815e050 0x7fc0d806ecf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0d806e860 tx=0x7fc0d002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f601a21df28ae51 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0d5d9b640 1 -- 172.21.15.77:0/1034186753 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0036070 con 0x7fc0d815e050 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0d5d9b640 1 -- 172.21.15.77:0/1034186753 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0d0031600 con 0x7fc0d815e050 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0d5d9b640 1 -- 172.21.15.77:0/1034186753 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d00319d0 con 0x7fc0d815e050 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 -- 172.21.15.77:0/1034186753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815e050 msgr2=0x7fc0d806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815e050 0x7fc0d806ecf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc0d806e860 tx=0x7fc0d002a610 comp rx=0 tx=0).stop 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 -- 172.21.15.77:0/1034186753 shutdown_connections 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815e050 0x7fc0d806ecf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/1034186753 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/1034186753 >> v2:172.21.15.83:3300/0 conn(0x7fc0d815d730 0x7fc0d80b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.747+0000 7fc0dce2c640 1 -- 172.21.15.77:0/1034186753 >> 172.21.15.77:0/1034186753 conn(0x7fc0d80ce0c0 msgr2=0x7fc0d80ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.748+0000 7fc0dce2c640 1 -- 172.21.15.77:0/1034186753 shutdown_connections 2024-05-15T12:10:08.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.748+0000 7fc0dce2c640 1 -- 172.21.15.77:0/1034186753 wait complete. 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.749+0000 7fc0dce2c640 1 Processor -- start 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.749+0000 7fc0dce2c640 1 -- start start 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d80cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 0x7fc0d80c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0d815e050 0x7fc0d80c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d806f230 con 0x7fc0d815d730 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d815e4e0 con 0x7fc0d815e050 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc0d806f3b0 con 0x7fc0d80b4670 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 0x7fc0d80c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 0x7fc0d80c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59310/0 (socket says 172.21.15.77:59310) 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 -- 172.21.15.77:0/283308366 learned_addr learned my addr 172.21.15.77:0/283308366 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:08.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0d659c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d80cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0d6d9d640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0d815e050 0x7fc0d80c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 -- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 msgr2=0x7fc0d80cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d80cc000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 -- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0d815e050 msgr2=0x7fc0d80c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0d815e050 0x7fc0d80c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 -- 172.21.15.77:0/283308366 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d80c7370 con 0x7fc0d815d730 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0d659c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d80cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0d6d9d640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0d815e050 0x7fc0d80c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0cffff640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 0x7fc0d80c68f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000c7f0 tx=0x7fc0c000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0015070 con 0x7fc0d815d730 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0c0007820 con 0x7fc0d815d730 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0007c10 con 0x7fc0d815d730 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d80c7620 con 0x7fc0d815d730 2024-05-15T12:10:08.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.750+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d80c7be0 con 0x7fc0d815d730 2024-05-15T12:10:08.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.752+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d806a640 con 0x7fc0d815d730 2024-05-15T12:10:08.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.752+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc0c0018070 con 0x7fc0d815d730 2024-05-15T12:10:08.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.752+0000 7fc0ceffd640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0b80762d0 0x7fc0b8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:08.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.753+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc0c00976f0 con 0x7fc0d815d730 2024-05-15T12:10:08.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.753+0000 7fc0d659c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0b80762d0 0x7fc0b8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:08.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.753+0000 7fc0d659c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0b80762d0 0x7fc0b8078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006fd0 tx=0x7fc0c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:08.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.757+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc0c0061060 con 0x7fc0d815d730 2024-05-15T12:10:08.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.936+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc0d806daf0 con 0x7fc0d815d730 2024-05-15T12:10:08.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.937+0000 7fc0ceffd640 1 -- 172.21.15.77:0/283308366 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fc0c0060960 con 0x7fc0d815d730 2024-05-15T12:10:08.931 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-05-15T12:10:08.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.938+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0b80762d0 msgr2=0x7fc0b8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.938+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0b80762d0 0x7fc0b8078790 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8006fd0 tx=0x7fc0c8008040 comp rx=0 tx=0).stop 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 msgr2=0x7fc0d80c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 0x7fc0d80c68f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000c7f0 tx=0x7fc0c000ccb0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 shutdown_connections 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc0b80762d0 0x7fc0b8078790 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc0d815e050 0x7fc0d80c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0d815d730 0x7fc0d80c68f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 --2- 172.21.15.77:0/283308366 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc0d80b4670 0x7fc0d80cc000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 >> 172.21.15.77:0/283308366 conn(0x7fc0d80ce0c0 msgr2=0x7fc0d815c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 shutdown_connections 2024-05-15T12:10:08.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:08.939+0000 7fc0dce2c640 1 -- 172.21.15.77:0/283308366 wait complete. 2024-05-15T12:10:08.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-15T12:10:09.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.050+0000 7ff36d0e1640 1 Processor -- start 2024-05-15T12:10:09.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.050+0000 7ff36d0e1640 1 -- start start 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff36d0e1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff36815b720 0x7ff368072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff36d0e1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3680b5920 0x7ff3680b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff36d0e1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3680b3fc0 con 0x7ff3680cef50 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff36d0e1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff3680b6100 con 0x7ff3680b5920 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff36d0e1640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff3680b4260 con 0x7ff36815b720 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3680b5920 0x7ff3680b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff3680b5920 0x7ff3680b4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59324/0 (socket says 172.21.15.77:59324) 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 -- 172.21.15.77:0/3271326836 learned_addr learned my addr 172.21.15.77:0/3271326836 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff366d9d640 1 --2- 172.21.15.77:0/3271326836 >> v2:172.21.15.83:3300/0 conn(0x7ff36815b720 0x7ff368072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 -- 172.21.15.77:0/3271326836 >> v2:172.21.15.83:3300/0 conn(0x7ff36815b720 msgr2=0x7ff368072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 --2- 172.21.15.77:0/3271326836 >> v2:172.21.15.83:3300/0 conn(0x7ff36815b720 0x7ff368072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 -- 172.21.15.77:0/3271326836 >> v1:172.21.15.83:6789/0 conn(0x7ff3680cef50 legacy=0x7ff3680cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:09.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.051+0000 7ff35ffff640 1 -- 172.21.15.77:0/3271326836 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3680b4540 con 0x7ff3680b5920 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.052+0000 7ff35ffff640 1 --2- 172.21.15.77:0/3271326836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff3680b4a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff3680b3ce0 tx=0x7ff35002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f182ba58b528f0f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.052+0000 7ff36659c640 1 -- 172.21.15.77:0/3271326836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350037070 con 0x7ff3680b5920 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.052+0000 7ff36659c640 1 -- 172.21.15.77:0/3271326836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff350032440 con 0x7ff3680b5920 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.052+0000 7ff36659c640 1 -- 172.21.15.77:0/3271326836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350032810 con 0x7ff3680b5920 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 -- 172.21.15.77:0/3271326836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 msgr2=0x7ff3680b4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/3271326836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff3680b4a60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff3680b3ce0 tx=0x7ff35002a1a0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 -- 172.21.15.77:0/3271326836 shutdown_connections 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/3271326836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff3680b4a60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/3271326836 >> v2:172.21.15.83:3300/0 conn(0x7ff36815b720 0x7ff368072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 -- 172.21.15.77:0/3271326836 >> 172.21.15.77:0/3271326836 conn(0x7ff36806c810 msgr2=0x7ff36806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 -- 172.21.15.77:0/3271326836 shutdown_connections 2024-05-15T12:10:09.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.053+0000 7ff36d0e1640 1 -- 172.21.15.77:0/3271326836 wait complete. 2024-05-15T12:10:09.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.054+0000 7ff36d0e1640 1 Processor -- start 2024-05-15T12:10:09.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.054+0000 7ff36d0e1640 1 -- start start 2024-05-15T12:10:09.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36d0e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff36814e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:09.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36d0e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3680cef50 0x7ff36814e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:09.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36d0e1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff36815b720 0x7ff368145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:09.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36d0e1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff36815bb00 con 0x7ff3680b5920 2024-05-15T12:10:09.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36d0e1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680b4fa0 con 0x7ff3680cef50 2024-05-15T12:10:09.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36d0e1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff3680cfab0 con 0x7ff36815b720 2024-05-15T12:10:09.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff36814e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:09.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff36814e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59332/0 (socket says 172.21.15.77:59332) 2024-05-15T12:10:09.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 -- 172.21.15.77:0/4029100327 learned_addr learned my addr 172.21.15.77:0/4029100327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:09.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff35ffff640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3680cef50 0x7ff36814e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:09.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff36759e640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff36815b720 0x7ff368145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:09.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 -- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff36815b720 msgr2=0x7ff368145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:09.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff36815b720 0x7ff368145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 -- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3680cef50 msgr2=0x7ff36814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:09.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3680cef50 0x7ff36814e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 -- 172.21.15.77:0/4029100327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff36815d3c0 con 0x7ff3680b5920 2024-05-15T12:10:09.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.055+0000 7ff366d9d640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff36814e120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff35800d5f0 tx=0x7ff35800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:09.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.056+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580125f0 con 0x7ff3680b5920 2024-05-15T12:10:09.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.056+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff358019070 con 0x7ff3680b5920 2024-05-15T12:10:09.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.056+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3580129d0 con 0x7ff3680b5920 2024-05-15T12:10:09.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.056+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff36814ee50 con 0x7ff3680b5920 2024-05-15T12:10:09.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.056+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36815d940 con 0x7ff3680b5920 2024-05-15T12:10:09.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.057+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36806a640 con 0x7ff3680b5920 2024-05-15T12:10:09.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.057+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff358012b70 con 0x7ff3680b5920 2024-05-15T12:10:09.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.058+0000 7ff35f7fe640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff348076300 0x7ff3480787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:09.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.058+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff358097970 con 0x7ff3680b5920 2024-05-15T12:10:09.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.058+0000 7ff35ffff640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff348076300 0x7ff3480787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:09.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.058+0000 7ff35ffff640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff348076300 0x7ff3480787c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff350034000 tx=0x7ff35002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:09.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.062+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff3580612d0 con 0x7ff3680b5920 2024-05-15T12:10:09.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.312+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7ff368073a60 con 0x7ff3680b5920 2024-05-15T12:10:09.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.946+0000 7ff35f7fe640 1 -- 172.21.15.77:0/4029100327 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v45) ==== 147+0+0 (secure 0 0 0) 0x7ff358060bd0 con 0x7ff3680b5920 2024-05-15T12:10:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff348076300 msgr2=0x7ff3480787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff348076300 0x7ff3480787c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff350034000 tx=0x7ff35002e000 comp rx=0 tx=0).stop 2024-05-15T12:10:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 msgr2=0x7ff36814e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff36814e120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff35800d5f0 tx=0x7ff35800dab0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 shutdown_connections 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff348076300 0x7ff3480787c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff36815b720 0x7ff368145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff3680cef50 0x7ff36814e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 --2- 172.21.15.77:0/4029100327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3680b5920 0x7ff36814e120 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 >> 172.21.15.77:0/4029100327 conn(0x7ff36806c810 msgr2=0x7ff3680cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 shutdown_connections 2024-05-15T12:10:09.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:09.948+0000 7ff36d0e1640 1 -- 172.21.15.77:0/4029100327 wait complete. 2024-05-15T12:10:09.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-15T12:10:10.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.066+0000 7f06e8b22640 1 Processor -- start 2024-05-15T12:10:10.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.066+0000 7f06e8b22640 1 -- start start 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e8b22640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06e4146b20 0x7f06e40d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e8b22640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e4161ad0 con 0x7f06e4070790 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e8b22640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e40d0420 con 0x7f06e4070bd0 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e8b22640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f06e40cd610 con 0x7f06e4146b20 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e259c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06e4146b20 0x7f06e40d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06dbfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f06e4070790 0x7f06e4160cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53094/0 (socket says 172.21.15.77:53094) 2024-05-15T12:10:10.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06dbfff640 1 -- 172.21.15.77:0/3155023815 learned_addr learned my addr 172.21.15.77:0/3155023815 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:10.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e259c640 1 -- 172.21.15.77:0/3155023815 >> v1:172.21.15.83:6789/0 conn(0x7f06e4070bd0 legacy=0x7f06e41613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e259c640 1 -- 172.21.15.77:0/3155023815 >> v1:172.21.15.77:6789/0 conn(0x7f06e4070790 legacy=0x7f06e4160cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e259c640 1 -- 172.21.15.77:0/3155023815 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e4146f00 con 0x7f06e4146b20 2024-05-15T12:10:10.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.067+0000 7f06e1d9b640 1 -- 172.21.15.77:0/3155023815 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895456095 0 0) 0x7f06e4161ad0 con 0x7f06e4070790 2024-05-15T12:10:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e259c640 1 --2- 172.21.15.77:0/3155023815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4146b20 0x7f06e40d18d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06e40cd790 tx=0x7f06d402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c3bf378172684f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e1d9b640 1 -- 172.21.15.77:0/3155023815 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4037070 con 0x7f06e4146b20 2024-05-15T12:10:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e1d9b640 1 -- 172.21.15.77:0/3155023815 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d4032440 con 0x7f06e4146b20 2024-05-15T12:10:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e1d9b640 1 -- 172.21.15.77:0/3155023815 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4032810 con 0x7f06e4146b20 2024-05-15T12:10:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e8b22640 1 -- 172.21.15.77:0/3155023815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4146b20 msgr2=0x7f06e40d18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e8b22640 1 --2- 172.21.15.77:0/3155023815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4146b20 0x7f06e40d18d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f06e40cd790 tx=0x7f06d402a210 comp rx=0 tx=0).stop 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e8b22640 1 -- 172.21.15.77:0/3155023815 shutdown_connections 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.068+0000 7f06e8b22640 1 --2- 172.21.15.77:0/3155023815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4146b20 0x7f06e40d18d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.069+0000 7f06e8b22640 1 -- 172.21.15.77:0/3155023815 >> 172.21.15.77:0/3155023815 conn(0x7f06e40d2fc0 msgr2=0x7f06e40d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.069+0000 7f06e8b22640 1 -- 172.21.15.77:0/3155023815 shutdown_connections 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.069+0000 7f06e8b22640 1 -- 172.21.15.77:0/3155023815 wait complete. 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.070+0000 7f06e8b22640 1 Processor -- start 2024-05-15T12:10:10.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.070+0000 7f06e8b22640 1 -- start start 2024-05-15T12:10:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 0x7f06e41f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e4070bd0 0x7f06e41425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e4146b20 0x7f06e4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40cdb40 con 0x7f06e4070790 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40d2ca0 con 0x7f06e4070bd0 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f06e40d2650 con 0x7f06e4146b20 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 0x7f06e41f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 0x7f06e41f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59356/0 (socket says 172.21.15.77:59356) 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 -- 172.21.15.77:0/4197083624 learned_addr learned my addr 172.21.15.77:0/4197083624 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06dbfff640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e4070bd0 0x7f06e41425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e2d9d640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e4146b20 0x7f06e4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 -- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e4146b20 msgr2=0x7f06e4160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e4146b20 0x7f06e4160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 -- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e4070bd0 msgr2=0x7f06e41425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e4070bd0 0x7f06e41425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 -- 172.21.15.77:0/4197083624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e41f4fd0 con 0x7f06e4070790 2024-05-15T12:10:10.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e2d9d640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e4146b20 0x7f06e4160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e259c640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 0x7f06e41f4a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06d4000c00 tx=0x7f06d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4037050 con 0x7f06e4070790 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d4038040 con 0x7f06e4070790 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e4143090 con 0x7f06e4070790 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4004450 con 0x7f06e4070790 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.071+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e4143930 con 0x7f06e4070790 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.072+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06e406a640 con 0x7f06e4070790 2024-05-15T12:10:10.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.073+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06d4030900 con 0x7f06e4070790 2024-05-15T12:10:10.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.074+0000 7f06daffd640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06c40762d0 0x7f06c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.074+0000 7f06dbfff640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06c40762d0 0x7f06c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.074+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06d40b81c0 con 0x7f06e4070790 2024-05-15T12:10:10.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.074+0000 7f06dbfff640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06c40762d0 0x7f06c4078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06e40b3140 tx=0x7f06cc007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.078+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06d4081b20 con 0x7f06e4070790 2024-05-15T12:10:10.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.260+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f06e40b29d0 con 0x7f06e4070790 2024-05-15T12:10:10.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.266+0000 7f06daffd640 1 -- 172.21.15.77:0/4197083624 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f06d4081420 con 0x7f06e4070790 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06c40762d0 msgr2=0x7f06c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06c40762d0 0x7f06c4078790 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06e40b3140 tx=0x7f06cc007b50 comp rx=0 tx=0).stop 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 msgr2=0x7f06e41f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 0x7f06e41f4a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06d4000c00 tx=0x7f06d40046c0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 shutdown_connections 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06c40762d0 0x7f06c4078790 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f06e4146b20 0x7f06e4160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f06e4070bd0 0x7f06e41425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 --2- 172.21.15.77:0/4197083624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06e4070790 0x7f06e41f4a90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 >> 172.21.15.77:0/4197083624 conn(0x7f06e40d2fc0 msgr2=0x7f06e40b7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:10.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 shutdown_connections 2024-05-15T12:10:10.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.269+0000 7f06e8b22640 1 -- 172.21.15.77:0/4197083624 wait complete. 2024-05-15T12:10:10.275 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-15T12:10:10.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T12:10:10.315 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T12:10:10.362 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-15T12:10:10.362 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:10:10.363 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:10.379 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:10:10.379 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:10.435 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.581+0000 7ff892645640 1 Processor -- start 2024-05-15T12:10:10.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.581+0000 7ff892645640 1 -- start start 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff892645640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff88c06fc00 0x7ff88c15c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff892645640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88c15d060 con 0x7ff88c15c4f0 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff892645640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff88c15d340 con 0x7ff88c159a30 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff892645640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff88c0744c0 con 0x7ff88c06fc00 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff88b7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff88c15c4f0 0x7ff88c06f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53108/0 (socket says 172.21.15.77:53108) 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff88b7fe640 1 -- 172.21.15.77:0/2360495983 learned_addr learned my addr 172.21.15.77:0/2360495983 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff890be2640 1 --2- 172.21.15.77:0/2360495983 >> v2:172.21.15.77:3300/0 conn(0x7ff88c06fc00 0x7ff88c15c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff890be2640 1 -- 172.21.15.77:0/2360495983 >> v1:172.21.15.83:6789/0 conn(0x7ff88c159a30 legacy=0x7ff88c073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff890be2640 1 -- 172.21.15.77:0/2360495983 >> v1:172.21.15.77:6789/0 conn(0x7ff88c15c4f0 legacy=0x7ff88c06f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.582+0000 7ff890be2640 1 -- 172.21.15.77:0/2360495983 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c0735b0 con 0x7ff88c06fc00 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.583+0000 7ff890be2640 1 --2- 172.21.15.77:0/2360495983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c06fc00 0x7ff88c15c9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff88c074640 tx=0x7ff88402c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402242a49202b96f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.583+0000 7ff88affd640 1 -- 172.21.15.77:0/2360495983 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884032750 con 0x7ff88c06fc00 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.583+0000 7ff88affd640 1 -- 172.21.15.77:0/2360495983 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff884030050 con 0x7ff88c06fc00 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.583+0000 7ff88affd640 1 -- 172.21.15.77:0/2360495983 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff884032b10 con 0x7ff88c06fc00 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 -- 172.21.15.77:0/2360495983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c06fc00 msgr2=0x7ff88c15c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 --2- 172.21.15.77:0/2360495983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c06fc00 0x7ff88c15c9a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff88c074640 tx=0x7ff88402c850 comp rx=0 tx=0).stop 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 -- 172.21.15.77:0/2360495983 shutdown_connections 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 --2- 172.21.15.77:0/2360495983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c06fc00 0x7ff88c15c9a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 -- 172.21.15.77:0/2360495983 >> 172.21.15.77:0/2360495983 conn(0x7ff88c06c3f0 msgr2=0x7ff88c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 -- 172.21.15.77:0/2360495983 shutdown_connections 2024-05-15T12:10:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.584+0000 7ff892645640 1 -- 172.21.15.77:0/2360495983 wait complete. 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.585+0000 7ff892645640 1 Processor -- start 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.585+0000 7ff892645640 1 -- start start 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff892645640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff88c06fc00 0x7ff88c0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff892645640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 0x7ff88c1f4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff892645640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff88c15c4f0 0x7ff88c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff892645640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c159e10 con 0x7ff88c159a30 2024-05-15T12:10:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff892645640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff88c0b5090 con 0x7ff88c15c4f0 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff892645640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff88c159f90 con 0x7ff88c06fc00 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 0x7ff88c1f4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 0x7ff88c1f4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59382/0 (socket says 172.21.15.77:59382) 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 -- 172.21.15.77:0/2316233756 learned_addr learned my addr 172.21.15.77:0/2316233756 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff890be2640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff88c15c4f0 0x7ff88c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 -- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff88c06fc00 msgr2=0x7ff88c0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88bfff640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff88c06fc00 0x7ff88c0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff88c06fc00 0x7ff88c0c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 -- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff88c15c4f0 msgr2=0x7ff88c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff88c15c4f0 0x7ff88c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 -- 172.21.15.77:0/2316233756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88c1e5da0 con 0x7ff88c159a30 2024-05-15T12:10:10.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff890be2640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff88c15c4f0 0x7ff88c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.586+0000 7ff88b7fe640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 0x7ff88c1f4b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff880001eb0 tx=0x7ff88000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.587+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880017070 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.587+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff880005d00 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.587+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88c0c6570 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.587+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff880007310 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.587+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88c0c6b30 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.588+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c0768e0 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.588+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff88001a070 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.589+0000 7ff888ff9640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8780762d0 0x7ff878078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.589+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff880096990 con 0x7ff88c159a30 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.589+0000 7ff88bfff640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8780762d0 0x7ff878078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.589+0000 7ff88bfff640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8780762d0 0x7ff878078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff87c003d90 tx=0x7ff87c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.593+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8800602f0 con 0x7ff88c159a30 2024-05-15T12:10:10.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.786+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff88c0b4e70 con 0x7ff88c159a30 2024-05-15T12:10:10.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.786+0000 7ff888ff9640 1 -- 172.21.15.77:0/2316233756 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7ff88005fbf0 con 0x7ff88c159a30 2024-05-15T12:10:10.781 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8780762d0 msgr2=0x7ff878078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8780762d0 0x7ff878078790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff87c003d90 tx=0x7ff87c009040 comp rx=0 tx=0).stop 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 msgr2=0x7ff88c1f4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 0x7ff88c1f4b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff880001eb0 tx=0x7ff88000c890 comp rx=0 tx=0).stop 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 shutdown_connections 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8780762d0 0x7ff878078790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff88c15c4f0 0x7ff88c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff88c159a30 0x7ff88c1f4b90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 --2- 172.21.15.77:0/2316233756 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff88c06fc00 0x7ff88c0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 >> 172.21.15.77:0/2316233756 conn(0x7ff88c06c3f0 msgr2=0x7ff88c0b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:10.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 shutdown_connections 2024-05-15T12:10:10.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.788+0000 7ff892645640 1 -- 172.21.15.77:0/2316233756 wait complete. 2024-05-15T12:10:10.794 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:10:10.794 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:10.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:10.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.957+0000 7fafbee6d640 1 Processor -- start 2024-05-15T12:10:10.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.957+0000 7fafbee6d640 1 -- start start 2024-05-15T12:10:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.957+0000 7fafbee6d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 0x7fafb80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.957+0000 7fafbee6d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80d0bf0 con 0x7fafb80d3f30 2024-05-15T12:10:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.957+0000 7fafbee6d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafb80d0ed0 con 0x7fafb815f780 2024-05-15T12:10:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.957+0000 7fafbee6d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80d11b0 con 0x7fafb80b64b0 2024-05-15T12:10:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb7fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fafb80d3f30 0x7fafb80cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53112/0 (socket says 172.21.15.77:53112) 2024-05-15T12:10:10.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb7fff640 1 -- 172.21.15.77:0/2200645296 learned_addr learned my addr 172.21.15.77:0/2200645296 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafbd40a640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 0x7fafb80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 935131264 0 0) 0x7fafb80d0bf0 con 0x7fafb80d3f30 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa8003520 con 0x7fafb80d3f30 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1920288452 0 0) 0x7fafb80d0ed0 con 0x7fafb815f780 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafb80d0bf0 con 0x7fafb815f780 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2747584891 0 0) 0x7fafa8003520 con 0x7fafb80d3f30 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 msgr2=0x7fafb80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 0x7fafb80d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 >> v1:172.21.15.83:6789/0 conn(0x7fafb815f780 legacy=0x7fafb80d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80b4ca0 con 0x7fafb80d3f30 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fafa40016f0 con 0x7fafb80d3f30 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 >> v1:172.21.15.77:6789/0 conn(0x7fafb80d3f30 legacy=0x7fafb80cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 0x7fafa8003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafa80041c0 0x7fafa8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafa80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80d11b0 con 0x7fafa8004d40 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fafa800bc20 con 0x7fafa80041c0 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fafa800be20 con 0x7fafb80b64b0 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafbd40a640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafa80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafbcc09640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 0x7fafa8003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.958+0000 7fafb7fff640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafa80041c0 0x7fafa8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafbd40a640 1 -- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 msgr2=0x7fafa8003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafbd40a640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb80b64b0 0x7fafa8003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafbd40a640 1 -- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafa80041c0 msgr2=0x7fafa8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafbd40a640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafa80041c0 0x7fafa8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafbd40a640 1 -- 172.21.15.77:0/2200645296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa8003520 con 0x7fafa8004d40 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafbd40a640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafa80051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009f90 tx=0x7fafa8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311be1d676a0c12d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0009c10 con 0x7fafa8004d40 2024-05-15T12:10:10.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0036070 con 0x7fafa8004d40 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.959+0000 7fafb77fe640 1 -- 172.21.15.77:0/2200645296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0031810 con 0x7fafa8004d40 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbee6d640 1 -- 172.21.15.77:0/2200645296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 msgr2=0x7fafa80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbee6d640 1 --2- 172.21.15.77:0/2200645296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafa80051c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fafb0009f90 tx=0x7fafa8005830 comp rx=0 tx=0).stop 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbd40a640 1 -- 172.21.15.77:0/2200645296 reap_dead start 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbee6d640 1 -- 172.21.15.77:0/2200645296 shutdown_connections 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbee6d640 1 -- 172.21.15.77:0/2200645296 >> 172.21.15.77:0/2200645296 conn(0x7fafb809e510 msgr2=0x7fafb80d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbee6d640 1 -- 172.21.15.77:0/2200645296 shutdown_connections 2024-05-15T12:10:10.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.960+0000 7fafbee6d640 1 -- 172.21.15.77:0/2200645296 wait complete. 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.961+0000 7fafbee6d640 1 Processor -- start 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.961+0000 7fafbee6d640 1 -- start start 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbee6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafb80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbee6d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafb815b950 0x7fafb815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbee6d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb8161150 0x7fafb8161600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbee6d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80d0650 con 0x7fafa8004d40 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbee6d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80d04d0 con 0x7fafb815b950 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbee6d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80d07d0 con 0x7fafb8161150 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafb80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafb80caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59398/0 (socket says 172.21.15.77:59398) 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 -- 172.21.15.77:0/1404987531 learned_addr learned my addr 172.21.15.77:0/1404987531 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbd40a640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb8161150 0x7fafb8161600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafb7fff640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafb815b950 0x7fafb815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 -- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb8161150 msgr2=0x7fafb8161600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb8161150 0x7fafb8161600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 -- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafb815b950 msgr2=0x7fafb815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafb815b950 0x7fafb815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbcc09640 1 -- 172.21.15.77:0/1404987531 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80ba6d0 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.962+0000 7fafbd40a640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb8161150 0x7fafb8161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.963+0000 7fafbcc09640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafb80caaa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafac00f850 tx=0x7fafac00fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.963+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac0052e0 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.963+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafac018070 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.963+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb80ba9b0 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.963+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafac00d970 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.963+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb80baf70 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.964+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb80768e0 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.964+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fafac00db10 con 0x7fafa8004d40 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.965+0000 7fafb57fa640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faf9c076300 0x7faf9c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:10.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.965+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fafac0974f0 con 0x7fafa8004d40 2024-05-15T12:10:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.965+0000 7fafb7fff640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faf9c076300 0x7faf9c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:10.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.965+0000 7fafb7fff640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faf9c076300 0x7faf9c0787c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa4001000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:10.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:10.969+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fafac060e50 con 0x7fafa8004d40 2024-05-15T12:10:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.163+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fafb80d3600 con 0x7fafa8004d40 2024-05-15T12:10:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.163+0000 7fafb57fa640 1 -- 172.21.15.77:0/1404987531 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fafac060750 con 0x7fafa8004d40 2024-05-15T12:10:11.158 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:11.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.165+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faf9c076300 msgr2=0x7faf9c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.165+0000 7fafbee6d640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faf9c076300 0x7faf9c0787c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa4001000 comp rx=0 tx=0).stop 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.165+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 msgr2=0x7fafb80caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.165+0000 7fafbee6d640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafb80caaa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fafac00f850 tx=0x7fafac00fd10 comp rx=0 tx=0).stop 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 shutdown_connections 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7faf9c076300 0x7faf9c0787c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fafb8161150 0x7fafb8161600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fafb815b950 0x7fafb815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 --2- 172.21.15.77:0/1404987531 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fafa8004d40 0x7fafb80caaa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 >> 172.21.15.77:0/1404987531 conn(0x7fafb809e510 msgr2=0x7fafb806e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 shutdown_connections 2024-05-15T12:10:11.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.166+0000 7fafbee6d640 1 -- 172.21.15.77:0/1404987531 wait complete. 2024-05-15T12:10:11.171 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2024-05-15T12:10:11.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:11.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:11.196 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:11.196 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:10:11.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:11.197 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-15T12:10:11.263 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:10:11.263 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:11.284 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:10:11.284 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:11.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:11.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.448+0000 7f4df4485640 1 Processor -- start 2024-05-15T12:10:11.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.448+0000 7f4df4485640 1 -- start start 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.449+0000 7f4df4485640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dec0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.449+0000 7f4df4485640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dec0d0bf0 con 0x7f4dec15f780 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.449+0000 7f4df4485640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dec0d0ed0 con 0x7f4dec0d3f30 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.449+0000 7f4df4485640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0d11b0 con 0x7f4dec0b64b0 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.449+0000 7f4df2221640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4dec15f780 0x7f4dec0d3820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53120/0 (socket says 172.21.15.77:53120) 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df2221640 1 -- 172.21.15.77:0/2543669909 learned_addr learned my addr 172.21.15.77:0/2543669909 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df2a22640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dec0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040964875 0 0) 0x7f4dec0d0bf0 con 0x7f4dec15f780 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dd4003520 con 0x7f4dec15f780 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4195862794 0 0) 0x7f4dd4003520 con 0x7f4dec15f780 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 msgr2=0x7f4dec0d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dec0d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 >> v1:172.21.15.83:6789/0 conn(0x7f4dec0d3f30 legacy=0x7f4dec0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0b4ca0 con 0x7f4dec15f780 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f4de40016f0 con 0x7f4dec15f780 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 >> v1:172.21.15.77:6789/0 conn(0x7f4dec15f780 legacy=0x7f4dec0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dd40039e0 0x7f4dd4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dd4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd4004d40 0x7f4dd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d11b0 con 0x7f4dd40039e0 2024-05-15T12:10:11.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd400bb50 con 0x7f4dd4004d40 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd400bd50 con 0x7f4dec0b64b0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df2221640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dd40039e0 0x7f4dd4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df2a22640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd4004d40 0x7f4dd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.450+0000 7f4df1a20640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dd4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df2221640 1 -- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 msgr2=0x7f4dd4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df2221640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dd4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df2221640 1 -- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd4004d40 msgr2=0x7f4dd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df2221640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd4004d40 0x7f4dd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df2221640 1 -- 172.21.15.77:0/2543669909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd4003520 con 0x7f4dd40039e0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df1a20640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0b64b0 0x7f4dd4004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df2221640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dd40039e0 0x7f4dd4003dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c240 tx=0x7f4dd4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e8c1ebfc8580f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4007d30 con 0x7f4dd40039e0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de4005ad0 con 0x7f4dd40039e0 2024-05-15T12:10:11.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.451+0000 7f4df121f640 1 -- 172.21.15.77:0/2543669909 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4007070 con 0x7f4dd40039e0 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df4485640 1 -- 172.21.15.77:0/2543669909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dd40039e0 msgr2=0x7f4dd4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df4485640 1 --2- 172.21.15.77:0/2543669909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dd40039e0 0x7f4dd4003dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c240 tx=0x7f4dd4005830 comp rx=0 tx=0).stop 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df2a22640 1 -- 172.21.15.77:0/2543669909 reap_dead start 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df4485640 1 -- 172.21.15.77:0/2543669909 shutdown_connections 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df4485640 1 -- 172.21.15.77:0/2543669909 >> 172.21.15.77:0/2543669909 conn(0x7f4dec09e510 msgr2=0x7f4dec0d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df4485640 1 -- 172.21.15.77:0/2543669909 shutdown_connections 2024-05-15T12:10:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.452+0000 7f4df4485640 1 -- 172.21.15.77:0/2543669909 wait complete. 2024-05-15T12:10:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.453+0000 7f4df4485640 1 Processor -- start 2024-05-15T12:10:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.453+0000 7f4df4485640 1 -- start start 2024-05-15T12:10:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df4485640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd40039e0 0x7f4dec162590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df4485640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 0x7f4dec0b9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df4485640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0ba030 0x7f4dec0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df4485640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d0650 con 0x7f4dec0b7e60 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df4485640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0d04d0 con 0x7f4dd40039e0 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df4485640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0d07d0 con 0x7f4dec0ba030 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 0x7f4dec0b9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 0x7f4dec0b9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59420/0 (socket says 172.21.15.77:59420) 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 -- 172.21.15.77:0/1843654652 learned_addr learned my addr 172.21.15.77:0/1843654652 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 -- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0ba030 msgr2=0x7f4dec0ba4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df2221640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd40039e0 0x7f4dec162590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0ba030 0x7f4dec0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 -- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd40039e0 msgr2=0x7f4dec162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd40039e0 0x7f4dec162590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 -- 172.21.15.77:0/1843654652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0bae50 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df2221640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd40039e0 0x7f4dec162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.454+0000 7f4df1a20640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 0x7f4dec0b9af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4de000e730 tx=0x7f4de000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.455+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00050d0 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.455+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de0005270 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.455+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec0b82e0 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.455+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0005440 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.455+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec15fcd0 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.456+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dec0768e0 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.456+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4de001a020 con 0x7f4dec0b7e60 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.457+0000 7f4deaffd640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4dd8076300 0x7f4dd80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.457+0000 7f4df2221640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4dd8076300 0x7f4dd80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.457+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4de0096c00 con 0x7f4dec0b7e60 2024-05-15T12:10:11.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.457+0000 7f4df2221640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4dd8076300 0x7f4dd80787c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4de4032000 tx=0x7f4de402d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:11.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.461+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4de009d080 con 0x7f4dec0b7e60 2024-05-15T12:10:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.651+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4dec0d3600 con 0x7f4dec0b7e60 2024-05-15T12:10:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.652+0000 7f4deaffd640 1 -- 172.21.15.77:0/1843654652 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f4de00605f0 con 0x7f4dec0b7e60 2024-05-15T12:10:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:11.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.653+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4dd8076300 msgr2=0x7f4dd80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4dd8076300 0x7f4dd80787c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4de4032000 tx=0x7f4de402d000 comp rx=0 tx=0).stop 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 msgr2=0x7f4dec0b9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 0x7f4dec0b9af0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4de000e730 tx=0x7f4de000ebf0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 shutdown_connections 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4dd8076300 0x7f4dd80787c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4dec0ba030 0x7f4dec0ba4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4dec0b7e60 0x7f4dec0b9af0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 --2- 172.21.15.77:0/1843654652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4dd40039e0 0x7f4dec162590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 >> 172.21.15.77:0/1843654652 conn(0x7f4dec09e510 msgr2=0x7f4dec0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 shutdown_connections 2024-05-15T12:10:11.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.654+0000 7f4df4485640 1 -- 172.21.15.77:0/1843654652 wait complete. 2024-05-15T12:10:11.660 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:10:11.660 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:11.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.785+0000 7f0ebfef8640 1 Processor -- start 2024-05-15T12:10:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.785+0000 7f0ebfef8640 1 -- start start 2024-05-15T12:10:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebfef8640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0eb8159a30 0x7f0eb8073db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebfef8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 0x7f0eb815c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebfef8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb815d060 con 0x7f0eb806f4f0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebfef8640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb815d340 con 0x7f0eb8159a30 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebfef8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb80735b0 con 0x7f0eb815c4f0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebe495640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0eb806f4f0 0x7f0eb815d710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53132/0 (socket says 172.21.15.77:53132) 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebe495640 1 -- 172.21.15.77:0/3814336652 learned_addr learned my addr 172.21.15.77:0/3814336652 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515585931 0 0) 0x7f0eb815d060 con 0x7f0eb806f4f0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebdc94640 1 --2- 172.21.15.77:0/3814336652 >> v2:172.21.15.83:3300/0 conn(0x7f0eb8159a30 0x7f0eb8073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebd493640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 0x7f0eb815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea4003520 con 0x7f0eb806f4f0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 890465322 0 0) 0x7f0ea4003520 con 0x7f0eb806f4f0 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 msgr2=0x7f0eb815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 0x7f0eb815c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 >> v2:172.21.15.83:3300/0 conn(0x7f0eb8159a30 msgr2=0x7f0eb8073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 --2- 172.21.15.77:0/3814336652 >> v2:172.21.15.83:3300/0 conn(0x7f0eb8159a30 0x7f0eb8073db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb8073890 con 0x7f0eb806f4f0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f0eb0001a70 con 0x7f0eb806f4f0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 >> v1:172.21.15.77:6789/0 conn(0x7f0eb806f4f0 legacy=0x7f0eb815d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.786+0000 7f0ebcc92640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 0x7f0ea4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebcc92640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4003fd0 0x7f0ea4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebcc92640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ea4004d40 0x7f0ea40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb815d340 con 0x7f0ea4004d40 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb80735b0 con 0x7f0ea4003fd0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea400ba10 con 0x7f0eb815c4f0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebe495640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ea4004d40 0x7f0ea40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebd493640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4003fd0 0x7f0ea4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebdc94640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 0x7f0ea4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebe495640 1 -- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 msgr2=0x7f0ea4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebe495640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb815c4f0 0x7f0ea4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebe495640 1 -- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4003fd0 msgr2=0x7f0ea4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:11.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebe495640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4003fd0 0x7f0ea4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.787+0000 7f0ebe495640 1 -- 172.21.15.77:0/3814336652 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea4003520 con 0x7f0ea4004d40 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebe495640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ea4004d40 0x7f0ea40051c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000a880 tx=0x7f0ea4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5decf0b2e5aa93af server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000a4a0 con 0x7f0ea4004d40 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb002f070 con 0x7f0ea4004d40 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebcc92640 1 -- 172.21.15.77:0/3814336652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb002bc30 con 0x7f0ea4004d40 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebfef8640 1 -- 172.21.15.77:0/3814336652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ea4004d40 msgr2=0x7f0ea40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/3814336652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ea4004d40 0x7f0ea40051c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000a880 tx=0x7f0ea4005830 comp rx=0 tx=0).stop 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebe495640 1 -- 172.21.15.77:0/3814336652 reap_dead start 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebfef8640 1 -- 172.21.15.77:0/3814336652 shutdown_connections 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebfef8640 1 -- 172.21.15.77:0/3814336652 >> 172.21.15.77:0/3814336652 conn(0x7f0eb806c3f0 msgr2=0x7f0eb806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebfef8640 1 -- 172.21.15.77:0/3814336652 shutdown_connections 2024-05-15T12:10:11.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.788+0000 7f0ebfef8640 1 -- 172.21.15.77:0/3814336652 wait complete. 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 Processor -- start 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 -- start start 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4004d40 0x7f0eb8149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb8145b20 0x7f0eb814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 0x7f0eb814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8159f90 con 0x7f0eb8145fa0 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb8159e10 con 0x7f0ea4004d40 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebfef8640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb80742f0 con 0x7f0eb8145b20 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebe495640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 0x7f0eb814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebe495640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 0x7f0eb814b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59432/0 (socket says 172.21.15.77:59432) 2024-05-15T12:10:11.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.790+0000 7f0ebe495640 1 -- 172.21.15.77:0/1348551807 learned_addr learned my addr 172.21.15.77:0/1348551807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebdc94640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4004d40 0x7f0eb8149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebd493640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb8145b20 0x7f0eb814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebe495640 1 -- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb8145b20 msgr2=0x7f0eb814b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebe495640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb8145b20 0x7f0eb814b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebe495640 1 -- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4004d40 msgr2=0x7f0eb8149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebe495640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4004d40 0x7f0eb8149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebe495640 1 -- 172.21.15.77:0/1348551807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb81470a0 con 0x7f0eb8145fa0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebdc94640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4004d40 0x7f0eb8149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebe495640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 0x7f0eb814b9b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000a9a0 tx=0x7f0eb8073a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0044070 con 0x7f0eb8145fa0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eb000a480 con 0x7f0eb8145fa0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb814c360 con 0x7f0eb8145fa0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0001fe0 con 0x7f0eb8145fa0 2024-05-15T12:10:11.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.791+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb814c920 con 0x7f0eb8145fa0 2024-05-15T12:10:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.792+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb80768e0 con 0x7f0eb8145fa0 2024-05-15T12:10:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.793+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0eb0047070 con 0x7f0eb8145fa0 2024-05-15T12:10:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.793+0000 7f0eae7fc640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e9c0762d0 0x7f0e9c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.793+0000 7f0ebdc94640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e9c0762d0 0x7f0e9c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.793+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0eb00b7680 con 0x7f0eb8145fa0 2024-05-15T12:10:11.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.794+0000 7f0ebdc94640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e9c0762d0 0x7f0e9c078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8167ae0 tx=0x7f0eb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:11.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.797+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0eb0080a20 con 0x7f0eb8145fa0 2024-05-15T12:10:11.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.993+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0eb81500b0 con 0x7f0eb8145fa0 2024-05-15T12:10:11.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.993+0000 7f0eae7fc640 1 -- 172.21.15.77:0/1348551807 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0eb0084d20 con 0x7f0eb8145fa0 2024-05-15T12:10:11.988 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e9c0762d0 msgr2=0x7f0e9c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e9c0762d0 0x7f0e9c078790 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8167ae0 tx=0x7f0eb4008040 comp rx=0 tx=0).stop 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 msgr2=0x7f0eb814b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 0x7f0eb814b9b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000a9a0 tx=0x7f0eb8073a60 comp rx=0 tx=0).stop 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 shutdown_connections 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e9c0762d0 0x7f0e9c078790 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0eb8145b20 0x7f0eb814b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eb8145fa0 0x7f0eb814b9b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 --2- 172.21.15.77:0/1348551807 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ea4004d40 0x7f0eb8149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 >> 172.21.15.77:0/1348551807 conn(0x7f0eb806c3f0 msgr2=0x7f0eb814f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 shutdown_connections 2024-05-15T12:10:11.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:11.995+0000 7f0ebfef8640 1 -- 172.21.15.77:0/1348551807 wait complete. 2024-05-15T12:10:12.001 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-05-15T12:10:12.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:12.001 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-05-15T12:10:12.032 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:12.032 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:10:12.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:12.033 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-15T12:10:12.176 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:10:12.177 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:12.193 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:10:12.193 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:12.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:12.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.396+0000 7fb433408640 1 Processor -- start 2024-05-15T12:10:12.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.396+0000 7fb433408640 1 -- start start 2024-05-15T12:10:12.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb433408640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb42c15f370 0x7fb42c0cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb433408640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb42c06eac0 0x7fb42c162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb433408640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb42c163690 con 0x7fb42c0ca950 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb433408640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c163970 con 0x7fb42c15f370 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb433408640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb42c163c50 con 0x7fb42c06eac0 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4311a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb42c15f370 0x7fb42c0cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4319a5640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb42c0ca950 0x7fb42c06d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53142/0 (socket says 172.21.15.77:53142) 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4311a4640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb42c15f370 0x7fb42c0cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59436/0 (socket says 172.21.15.77:59436) 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4319a5640 1 -- 172.21.15.77:0/922460688 learned_addr learned my addr 172.21.15.77:0/922460688 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4309a3640 1 --2- 172.21.15.77:0/922460688 >> v2:172.21.15.83:3300/0 conn(0x7fb42c06eac0 0x7fb42c162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4311a4640 1 -- 172.21.15.77:0/922460688 >> v2:172.21.15.83:3300/0 conn(0x7fb42c06eac0 msgr2=0x7fb42c162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4311a4640 1 --2- 172.21.15.77:0/922460688 >> v2:172.21.15.83:3300/0 conn(0x7fb42c06eac0 0x7fb42c162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4311a4640 1 -- 172.21.15.77:0/922460688 >> v1:172.21.15.77:6789/0 conn(0x7fb42c0ca950 legacy=0x7fb42c06d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb423fff640 1 -- 172.21.15.77:0/922460688 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531880925 0 0) 0x7fb42c163690 con 0x7fb42c0ca950 2024-05-15T12:10:12.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.397+0000 7fb4311a4640 1 -- 172.21.15.77:0/922460688 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c06c9a0 con 0x7fb42c15f370 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.398+0000 7fb4311a4640 1 --2- 172.21.15.77:0/922460688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c15f370 0x7fb42c0cfae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0d2570 tx=0x7fb42802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e18cbd4a3b2184 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.398+0000 7fb423fff640 1 -- 172.21.15.77:0/922460688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428007740 con 0x7fb42c15f370 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.398+0000 7fb423fff640 1 -- 172.21.15.77:0/922460688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4280078e0 con 0x7fb42c15f370 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.398+0000 7fb423fff640 1 -- 172.21.15.77:0/922460688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb428007cb0 con 0x7fb42c15f370 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 -- 172.21.15.77:0/922460688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c15f370 msgr2=0x7fb42c0cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 --2- 172.21.15.77:0/922460688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c15f370 0x7fb42c0cfae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb42c0d2570 tx=0x7fb42802a680 comp rx=0 tx=0).stop 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 -- 172.21.15.77:0/922460688 shutdown_connections 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 --2- 172.21.15.77:0/922460688 >> v2:172.21.15.83:3300/0 conn(0x7fb42c06eac0 0x7fb42c162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 --2- 172.21.15.77:0/922460688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c15f370 0x7fb42c0cfae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 -- 172.21.15.77:0/922460688 >> 172.21.15.77:0/922460688 conn(0x7fb42c0d1600 msgr2=0x7fb42c0d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 -- 172.21.15.77:0/922460688 shutdown_connections 2024-05-15T12:10:12.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.399+0000 7fb433408640 1 -- 172.21.15.77:0/922460688 wait complete. 2024-05-15T12:10:12.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.400+0000 7fb433408640 1 Processor -- start 2024-05-15T12:10:12.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.400+0000 7fb433408640 1 -- start start 2024-05-15T12:10:12.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb42c06eac0 0x7fb42c14dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 0x7fb42c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb42c15f370 0x7fb42c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0d01a0 con 0x7fb42c0ca950 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c0d0020 con 0x7fb42c15f370 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb42c1632d0 con 0x7fb42c06eac0 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 0x7fb42c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 0x7fb42c14f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59438/0 (socket says 172.21.15.77:59438) 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 -- 172.21.15.77:0/1219865466 learned_addr learned my addr 172.21.15.77:0/1219865466 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 -- 172.21.15.77:0/1219865466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb42c06eac0 msgr2=0x7fb42c14dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb42c06eac0 0x7fb42c14dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 -- 172.21.15.77:0/1219865466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb42c15f370 msgr2=0x7fb42c14f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb42c15f370 0x7fb42c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 -- 172.21.15.77:0/1219865466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c0b69e0 con 0x7fb42c0ca950 2024-05-15T12:10:12.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb4309a3640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 0x7fb42c14f320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c7f0 tx=0x7fb41c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c015070 con 0x7fb42c0ca950 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb41c007820 con 0x7fb42c0ca950 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c14fef0 con 0x7fb42c0ca950 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.401+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41c007bf0 con 0x7fb42c0ca950 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.402+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c150730 con 0x7fb42c0ca950 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.403+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c0768e0 con 0x7fb42c0ca950 2024-05-15T12:10:12.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.403+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb41c018070 con 0x7fb42c0ca950 2024-05-15T12:10:12.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.404+0000 7fb421ffb640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4100762d0 0x7fb410078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.404+0000 7fb4311a4640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4100762d0 0x7fb410078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.404+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb41c097650 con 0x7fb42c0ca950 2024-05-15T12:10:12.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.404+0000 7fb4311a4640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4100762d0 0x7fb410078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb428034000 tx=0x7fb42802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:12.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.408+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb42c14fef0 con 0x7fb42c0ca950 2024-05-15T12:10:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.599+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb42c0686e0 con 0x7fb42c0ca950 2024-05-15T12:10:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.599+0000 7fb421ffb640 1 -- 172.21.15.77:0/1219865466 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fb41c061040 con 0x7fb42c0ca950 2024-05-15T12:10:12.594 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:12.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.601+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4100762d0 msgr2=0x7fb410078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.601+0000 7fb433408640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4100762d0 0x7fb410078790 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb428034000 tx=0x7fb42802e000 comp rx=0 tx=0).stop 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.601+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 msgr2=0x7fb42c14f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.601+0000 7fb433408640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 0x7fb42c14f320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb41c00c7f0 tx=0x7fb41c00ccb0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 shutdown_connections 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb4100762d0 0x7fb410078790 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb42c15f370 0x7fb42c14f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb42c0ca950 0x7fb42c14f320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 --2- 172.21.15.77:0/1219865466 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb42c06eac0 0x7fb42c14dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 >> 172.21.15.77:0/1219865466 conn(0x7fb42c0d1600 msgr2=0x7fb42c1542e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 shutdown_connections 2024-05-15T12:10:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.602+0000 7fb433408640 1 -- 172.21.15.77:0/1219865466 wait complete. 2024-05-15T12:10:12.607 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:10:12.607 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:12.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:12.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.769+0000 7fc60ff96640 1 Processor -- start 2024-05-15T12:10:12.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.769+0000 7fc60ff96640 1 -- start start 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60ff96640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc60806eac0 0x7fc608162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60ff96640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6080ca950 0x7fc6080cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60ff96640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc608163690 con 0x7fc60815f370 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60ff96640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc6080cb2e0 con 0x7fc6080ca950 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60ff96640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc608163970 con 0x7fc60806eac0 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60dd32640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc60815f370 0x7fc6080cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58334/0 (socket says 172.21.15.77:58334) 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60dd32640 1 -- 172.21.15.77:0/1305552775 learned_addr learned my addr 172.21.15.77:0/1305552775 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.770+0000 7fc60e533640 1 --2- 172.21.15.77:0/1305552775 >> v2:172.21.15.77:3300/0 conn(0x7fc6080ca950 0x7fc6080cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60e533640 1 -- 172.21.15.77:0/1305552775 >> v2:172.21.15.83:3300/0 conn(0x7fc60806eac0 msgr2=0x7fc608162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:12.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60d531640 1 --2- 172.21.15.77:0/1305552775 >> v2:172.21.15.83:3300/0 conn(0x7fc60806eac0 0x7fc608162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60e533640 1 --2- 172.21.15.77:0/1305552775 >> v2:172.21.15.83:3300/0 conn(0x7fc60806eac0 0x7fc608162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60cd30640 1 -- 172.21.15.77:0/1305552775 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270430683 0 0) 0x7fc608163690 con 0x7fc60815f370 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60e533640 1 -- 172.21.15.77:0/1305552775 >> v1:172.21.15.77:6789/0 conn(0x7fc60815f370 legacy=0x7fc6080cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60e533640 1 -- 172.21.15.77:0/1305552775 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc608163c50 con 0x7fc6080ca950 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60d531640 1 --2- 172.21.15.77:0/1305552775 >> v2:172.21.15.83:3300/0 conn(0x7fc60806eac0 0x7fc608162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60e533640 1 --2- 172.21.15.77:0/1305552775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc6080cada0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6080d2570 tx=0x7fc60002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf64ccfe88310ac server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60cd30640 1 -- 172.21.15.77:0/1305552775 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600037070 con 0x7fc6080ca950 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60cd30640 1 -- 172.21.15.77:0/1305552775 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc600032440 con 0x7fc6080ca950 2024-05-15T12:10:12.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.771+0000 7fc60cd30640 1 -- 172.21.15.77:0/1305552775 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600032810 con 0x7fc6080ca950 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 -- 172.21.15.77:0/1305552775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 msgr2=0x7fc6080cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1305552775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc6080cada0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6080d2570 tx=0x7fc60002a1a0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 -- 172.21.15.77:0/1305552775 shutdown_connections 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1305552775 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc6080cada0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1305552775 >> v2:172.21.15.83:3300/0 conn(0x7fc60806eac0 0x7fc608162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 -- 172.21.15.77:0/1305552775 >> 172.21.15.77:0/1305552775 conn(0x7fc6080d1600 msgr2=0x7fc6080d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 -- 172.21.15.77:0/1305552775 shutdown_connections 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.772+0000 7fc60ff96640 1 -- 172.21.15.77:0/1305552775 wait complete. 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.773+0000 7fc60ff96640 1 Processor -- start 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.773+0000 7fc60ff96640 1 -- start start 2024-05-15T12:10:12.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60ff96640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc60806eac0 0x7fc6081606f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60ff96640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc608151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60ff96640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60815f370 0x7fc608157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60ff96640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6081632d0 con 0x7fc6080ca950 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60ff96640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc60806cc80 con 0x7fc60815f370 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60ff96640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc608163450 con 0x7fc60806eac0 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc608151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc608151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50836/0 (socket says 172.21.15.77:50836) 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 -- 172.21.15.77:0/1471636362 learned_addr learned my addr 172.21.15.77:0/1471636362 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 -- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc60806eac0 msgr2=0x7fc6081606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60e533640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60815f370 0x7fc608157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60dd32640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc60806eac0 0x7fc6081606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc60806eac0 0x7fc6081606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 -- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60815f370 msgr2=0x7fc608157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60815f370 0x7fc608157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60d531640 1 -- 172.21.15.77:0/1471636362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc608152100 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60e533640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60815f370 0x7fc608157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.774+0000 7fc60dd32640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc60806eac0 0x7fc6081606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.775+0000 7fc60d531640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc608151bc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c820 tx=0x7fc5f800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.775+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8015070 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.775+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5f8007a30 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.775+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6080b0ae0 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.775+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8007e00 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.775+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6080b10a0 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.776+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6080768e0 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.776+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc5f8018070 con 0x7fc6080ca950 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.777+0000 7fc5fe7fc640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc5ec0762d0 0x7fc5ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:12.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.777+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc5f8097530 con 0x7fc6080ca950 2024-05-15T12:10:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.777+0000 7fc60dd32640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc5ec0762d0 0x7fc5ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.777+0000 7fc60dd32640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc5ec0762d0 0x7fc5ec078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc604007fd0 tx=0x7fc604009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:12.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.781+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc608152100 con 0x7fc6080ca950 2024-05-15T12:10:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.977+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc6080686e0 con 0x7fc6080ca950 2024-05-15T12:10:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.977+0000 7fc5fe7fc640 1 -- 172.21.15.77:0/1471636362 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fc5f8060e90 con 0x7fc6080ca950 2024-05-15T12:10:12.972 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc5ec0762d0 msgr2=0x7fc5ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc5ec0762d0 0x7fc5ec078790 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc604007fd0 tx=0x7fc604009040 comp rx=0 tx=0).stop 2024-05-15T12:10:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 msgr2=0x7fc608151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc608151bc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc5f800c820 tx=0x7fc5f800cce0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 shutdown_connections 2024-05-15T12:10:12.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc5ec0762d0 0x7fc5ec078790 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc60815f370 0x7fc608157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6080ca950 0x7fc608151bc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 --2- 172.21.15.77:0/1471636362 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc60806eac0 0x7fc6081606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 >> 172.21.15.77:0/1471636362 conn(0x7fc6080d1600 msgr2=0x7fc6080cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 shutdown_connections 2024-05-15T12:10:12.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:12.980+0000 7fc60ff96640 1 -- 172.21.15.77:0/1471636362 wait complete. 2024-05-15T12:10:12.985 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2024-05-15T12:10:12.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:12.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-05-15T12:10:13.010 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:13.011 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T12:10:13.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:13.011 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-15T12:10:13.066 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:10:13.066 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:13.085 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:10:13.085 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:13.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:13.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.250+0000 7fe796389640 1 Processor -- start 2024-05-15T12:10:13.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.250+0000 7fe796389640 1 -- start start 2024-05-15T12:10:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe796389640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe79015f780 0x7fe7900d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe796389640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7900d3d60 0x7fe7900cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe796389640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7900d0bf0 con 0x7fe7900d0300 2024-05-15T12:10:13.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe796389640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe7900d41c0 con 0x7fe7900d3d60 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe796389640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe7900d11b0 con 0x7fe79015f780 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7900d3d60 0x7fe7900cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7900d3d60 0x7fe7900cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50840/0 (socket says 172.21.15.77:50840) 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 -- 172.21.15.77:0/563113142 learned_addr learned my addr 172.21.15.77:0/563113142 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe794926640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe7900d0300 0x7fe7900d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58338/0 (socket says 172.21.15.77:58338) 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78ffff640 1 --2- 172.21.15.77:0/563113142 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe79015f780 0x7fe7900d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 -- 172.21.15.77:0/563113142 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe79015f780 msgr2=0x7fe7900d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 --2- 172.21.15.77:0/563113142 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe79015f780 0x7fe7900d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 -- 172.21.15.77:0/563113142 >> v1:172.21.15.77:6789/0 conn(0x7fe7900d0300 legacy=0x7fe7900d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78f7fe640 1 -- 172.21.15.77:0/563113142 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7900d0ed0 con 0x7fe7900d3d60 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.251+0000 7fe78effd640 1 -- 172.21.15.77:0/563113142 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114870682 0 0) 0x7fe7900d0bf0 con 0x7fe7900d0300 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.252+0000 7fe78f7fe640 1 --2- 172.21.15.77:0/563113142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7900d3d60 0x7fe7900cfdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe784009870 tx=0x7fe78402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cadb5582e3f993 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.252+0000 7fe78effd640 1 -- 172.21.15.77:0/563113142 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784037070 con 0x7fe7900d3d60 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.252+0000 7fe78effd640 1 -- 172.21.15.77:0/563113142 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe784032440 con 0x7fe7900d3d60 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.252+0000 7fe78effd640 1 -- 172.21.15.77:0/563113142 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784032810 con 0x7fe7900d3d60 2024-05-15T12:10:13.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 -- 172.21.15.77:0/563113142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7900d3d60 msgr2=0x7fe7900cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 --2- 172.21.15.77:0/563113142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7900d3d60 0x7fe7900cfdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe784009870 tx=0x7fe78402a1c0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 -- 172.21.15.77:0/563113142 shutdown_connections 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 --2- 172.21.15.77:0/563113142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7900d3d60 0x7fe7900cfdc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 --2- 172.21.15.77:0/563113142 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe79015f780 0x7fe7900d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 -- 172.21.15.77:0/563113142 >> 172.21.15.77:0/563113142 conn(0x7fe79009e510 msgr2=0x7fe7900d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 -- 172.21.15.77:0/563113142 shutdown_connections 2024-05-15T12:10:13.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.253+0000 7fe796389640 1 -- 172.21.15.77:0/563113142 wait complete. 2024-05-15T12:10:13.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.254+0000 7fe796389640 1 Processor -- start 2024-05-15T12:10:13.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.254+0000 7fe796389640 1 -- start start 2024-05-15T12:10:13.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7900d0300 0x7fe79015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7900d3d60 0x7fe7900cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 0x7fe7900ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900d0790 con 0x7fe79015f780 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe7900b4f80 con 0x7fe7900d3d60 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe7900d0910 con 0x7fe7900d0300 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 0x7fe7900ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 0x7fe7900ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50852/0 (socket says 172.21.15.77:50852) 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 -- 172.21.15.77:0/1754973332 learned_addr learned my addr 172.21.15.77:0/1754973332 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe78ffff640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7900d0300 0x7fe79015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe78f7fe640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7900d3d60 0x7fe7900cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 -- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7900d0300 msgr2=0x7fe79015db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7900d0300 0x7fe79015db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 -- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7900d3d60 msgr2=0x7fe7900cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7900d3d60 0x7fe7900cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 -- 172.21.15.77:0/1754973332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79015e610 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe78f7fe640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7900d3d60 0x7fe7900cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe794926640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 0x7fe7900ccab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c6e0 tx=0x7fe78800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe788018070 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe788004d60 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.255+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7900cd0e0 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.256+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78800a880 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.256+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7900cd6a0 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.256+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7900694d0 con 0x7fe79015f780 2024-05-15T12:10:13.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.257+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe78801b070 con 0x7fe79015f780 2024-05-15T12:10:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.258+0000 7fe78cff9640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe77c0762d0 0x7fe77c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.258+0000 7fe78ffff640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe77c0762d0 0x7fe77c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.258+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe788096ad0 con 0x7fe79015f780 2024-05-15T12:10:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.258+0000 7fe78ffff640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe77c0762d0 0x7fe77c078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe780006fd0 tx=0x7fe780008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:13.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.262+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7900694d0 con 0x7fe79015f780 2024-05-15T12:10:13.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.453+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe7900d3600 con 0x7fe79015f780 2024-05-15T12:10:13.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.453+0000 7fe78cff9640 1 -- 172.21.15.77:0/1754973332 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fe788060430 con 0x7fe79015f780 2024-05-15T12:10:13.448 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:13.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe77c0762d0 msgr2=0x7fe77c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe77c0762d0 0x7fe77c078790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe780006fd0 tx=0x7fe780008040 comp rx=0 tx=0).stop 2024-05-15T12:10:13.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 msgr2=0x7fe7900ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 0x7fe7900ccab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe78800c6e0 tx=0x7fe78800cba0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 shutdown_connections 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe77c0762d0 0x7fe77c078790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe79015f780 0x7fe7900ccab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe7900d3d60 0x7fe7900cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 --2- 172.21.15.77:0/1754973332 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe7900d0300 0x7fe79015db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 >> 172.21.15.77:0/1754973332 conn(0x7fe79009e510 msgr2=0x7fe7900d5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 shutdown_connections 2024-05-15T12:10:13.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.455+0000 7fe796389640 1 -- 172.21.15.77:0/1754973332 wait complete. 2024-05-15T12:10:13.461 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T12:10:13.462 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T12:10:13.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-15T12:10:13.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.588+0000 7fc3a9d24640 1 Processor -- start 2024-05-15T12:10:13.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.588+0000 7fc3a9d24640 1 -- start start 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a9d24640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3a415f3a0 0x7fc3a406ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a9d24640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a4160790 con 0x7fc3a4162f00 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a9d24640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a4163670 con 0x7fc3a40b1090 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a9d24640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a4070ab0 con 0x7fc3a415f3a0 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3a415f3a0 0x7fc3a406ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a2ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc3a4162f00 0x7fc3a40af690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58354/0 (socket says 172.21.15.77:58354) 2024-05-15T12:10:13.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a37fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3a415f3a0 0x7fc3a406ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50866/0 (socket says 172.21.15.77:50866) 2024-05-15T12:10:13.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a2ffd640 1 -- 172.21.15.77:0/1014351259 learned_addr learned my addr 172.21.15.77:0/1014351259 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:13.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a37fe640 1 -- 172.21.15.77:0/1014351259 >> v1:172.21.15.83:6789/0 conn(0x7fc3a40b1090 legacy=0x7fc3a4070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:13.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a37fe640 1 -- 172.21.15.77:0/1014351259 >> v1:172.21.15.77:6789/0 conn(0x7fc3a4162f00 legacy=0x7fc3a40af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a37fe640 1 -- 172.21.15.77:0/1014351259 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a4163950 con 0x7fc3a415f3a0 2024-05-15T12:10:13.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.589+0000 7fc3a27fc640 1 -- 172.21.15.77:0/1014351259 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579495394 0 0) 0x7fc3a4160790 con 0x7fc3a4162f00 2024-05-15T12:10:13.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.590+0000 7fc3a37fe640 1 --2- 172.21.15.77:0/1014351259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a415f3a0 0x7fc3a406ff00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc39402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8379fff46f402aef server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.590+0000 7fc3a27fc640 1 -- 172.21.15.77:0/1014351259 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394007740 con 0x7fc3a415f3a0 2024-05-15T12:10:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.590+0000 7fc3a27fc640 1 -- 172.21.15.77:0/1014351259 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3940078e0 con 0x7fc3a415f3a0 2024-05-15T12:10:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.590+0000 7fc3a27fc640 1 -- 172.21.15.77:0/1014351259 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394007cb0 con 0x7fc3a415f3a0 2024-05-15T12:10:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 -- 172.21.15.77:0/1014351259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a415f3a0 msgr2=0x7fc3a406ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/1014351259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a415f3a0 0x7fc3a406ff00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc39402a660 comp rx=0 tx=0).stop 2024-05-15T12:10:13.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 -- 172.21.15.77:0/1014351259 shutdown_connections 2024-05-15T12:10:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/1014351259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a415f3a0 0x7fc3a406ff00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 -- 172.21.15.77:0/1014351259 >> 172.21.15.77:0/1014351259 conn(0x7fc3a406f2e0 msgr2=0x7fc3a406f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 -- 172.21.15.77:0/1014351259 shutdown_connections 2024-05-15T12:10:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.591+0000 7fc3a9d24640 1 -- 172.21.15.77:0/1014351259 wait complete. 2024-05-15T12:10:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.592+0000 7fc3a9d24640 1 Processor -- start 2024-05-15T12:10:13.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.592+0000 7fc3a9d24640 1 -- start start 2024-05-15T12:10:13.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a9d24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 0x7fc3a40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a9d24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3a415f3a0 0x7fc3a40b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a9d24640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3a4162f00 0x7fc3a4142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a9d24640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4071650 con 0x7fc3a40b1090 2024-05-15T12:10:13.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a9d24640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a4163360 con 0x7fc3a4162f00 2024-05-15T12:10:13.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a9d24640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a40717d0 con 0x7fc3a415f3a0 2024-05-15T12:10:13.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 0x7fc3a40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 0x7fc3a40ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50870/0 (socket says 172.21.15.77:50870) 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 -- 172.21.15.77:0/2785625781 learned_addr learned my addr 172.21.15.77:0/2785625781 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a2ffd640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3a415f3a0 0x7fc3a40b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a3fff640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3a4162f00 0x7fc3a4142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 -- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3a415f3a0 msgr2=0x7fc3a40b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3a415f3a0 0x7fc3a40b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 -- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3a4162f00 msgr2=0x7fc3a4142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3a4162f00 0x7fc3a4142650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 -- 172.21.15.77:0/2785625781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a41432a0 con 0x7fc3a40b1090 2024-05-15T12:10:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a3fff640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3a4162f00 0x7fc3a4142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a2ffd640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3a415f3a0 0x7fc3a40b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc3a37fe640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 0x7fc3a40ce280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:13.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.593+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394040070 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.594+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc394031c40 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.594+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a4143580 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.594+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394003990 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.594+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a4143b40 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.595+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a40768e0 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.595+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc394039040 con 0x7fc3a40b1090 2024-05-15T12:10:13.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.596+0000 7fc38bfff640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3900762d0 0x7fc390078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.596+0000 7fc3a2ffd640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3900762d0 0x7fc390078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.596+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc3940b8990 con 0x7fc3a40b1090 2024-05-15T12:10:13.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.596+0000 7fc3a2ffd640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3900762d0 0x7fc390078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc3a41540c0 tx=0x7fc398007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:13.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.600+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc394082270 con 0x7fc3a40b1090 2024-05-15T12:10:13.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.793+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc3a4143f20 con 0x7fc3a40b1090 2024-05-15T12:10:13.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.794+0000 7fc38bfff640 1 -- 172.21.15.77:0/2785625781 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7fc394081b70 con 0x7fc3a40b1090 2024-05-15T12:10:13.789 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2024-05-15T12:10:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3900762d0 msgr2=0x7fc390078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3900762d0 0x7fc390078790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc3a41540c0 tx=0x7fc398007ca0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 msgr2=0x7fc3a40ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 0x7fc3a40ce280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc394004a40 comp rx=0 tx=0).stop 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 shutdown_connections 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc3900762d0 0x7fc390078790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc3a415f3a0 0x7fc3a40b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc3a4162f00 0x7fc3a4142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 --2- 172.21.15.77:0/2785625781 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3a40b1090 0x7fc3a40ce280 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 >> 172.21.15.77:0/2785625781 conn(0x7fc3a406f2e0 msgr2=0x7fc3a415d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 shutdown_connections 2024-05-15T12:10:13.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.796+0000 7fc3a9d24640 1 -- 172.21.15.77:0/2785625781 wait complete. 2024-05-15T12:10:13.802 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi083.front.sepia.ceph.com... 2024-05-15T12:10:13.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:13.803 DEBUG:teuthology.orchestra.run.smithi083:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-05-15T12:10:13.833 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:13.834 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T12:10:13.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:13.834 DEBUG:teuthology.orchestra.run.smithi083:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-15T12:10:13.892 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-15T12:10:13.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.998+0000 7fb6b9e5c640 1 Processor -- start 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.998+0000 7fb6b9e5c640 1 -- start start 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b9e5c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b415f4b0 0x7fb6b40cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b9e5c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b40b5ec0 con 0x7fb6b40d4100 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b9e5c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b40d2f10 con 0x7fb6b40d0380 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b9e5c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b40d31f0 con 0x7fb6b415f4b0 2024-05-15T12:10:13.994 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b3fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb6b40d4100 0x7fb6b40d5230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58356/0 (socket says 172.21.15.77:58356) 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b3fff640 1 -- 172.21.15.77:0/575627246 learned_addr learned my addr 172.21.15.77:0/575627246 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b37fe640 1 --2- 172.21.15.77:0/575627246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b415f4b0 0x7fb6b40cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b27fc640 1 -- 172.21.15.77:0/575627246 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399517331 0 0) 0x7fb6b40b5ec0 con 0x7fb6b40d4100 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b27fc640 1 -- 172.21.15.77:0/575627246 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb69c003520 con 0x7fb6b40d4100 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b37fe640 1 -- 172.21.15.77:0/575627246 >> v1:172.21.15.83:6789/0 conn(0x7fb6b40d0380 legacy=0x7fb6b40d39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b37fe640 1 -- 172.21.15.77:0/575627246 >> v1:172.21.15.77:6789/0 conn(0x7fb6b40d4100 legacy=0x7fb6b40d5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b27fc640 1 -- 172.21.15.77:0/575627246 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742555569 0 0) 0x7fb6b40d2f10 con 0x7fb6b40d0380 2024-05-15T12:10:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:13.999+0000 7fb6b37fe640 1 -- 172.21.15.77:0/575627246 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b40b61a0 con 0x7fb6b415f4b0 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.000+0000 7fb6b37fe640 1 --2- 172.21.15.77:0/575627246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b415f4b0 0x7fb6b40cfe40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009dc0 tx=0x7fb6a402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f69afa5e16ee4843 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.000+0000 7fb6b27fc640 1 -- 172.21.15.77:0/575627246 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4007740 con 0x7fb6b415f4b0 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.000+0000 7fb6b27fc640 1 -- 172.21.15.77:0/575627246 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a40078e0 con 0x7fb6b415f4b0 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.000+0000 7fb6b27fc640 1 -- 172.21.15.77:0/575627246 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4007c90 con 0x7fb6b415f4b0 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/575627246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b415f4b0 msgr2=0x7fb6b40cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/575627246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b415f4b0 0x7fb6b40cfe40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009dc0 tx=0x7fb6a402a6d0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/575627246 shutdown_connections 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/575627246 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b415f4b0 0x7fb6b40cfe40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/575627246 >> 172.21.15.77:0/575627246 conn(0x7fb6b408ec60 msgr2=0x7fb6b409e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/575627246 shutdown_connections 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.001+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/575627246 wait complete. 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.002+0000 7fb6b9e5c640 1 Processor -- start 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.002+0000 7fb6b9e5c640 1 -- start start 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b9e5c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b40d0380 0x7fb6b40ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b9e5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 0x7fb6b41625f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b9e5c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6b414f750 0x7fb6b40cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b9e5c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b40d5ac0 con 0x7fb6b415f4b0 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b9e5c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b40d5940 con 0x7fb6b414f750 2024-05-15T12:10:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b9e5c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b40b51d0 con 0x7fb6b40d0380 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 0x7fb6b41625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 0x7fb6b41625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50884/0 (socket says 172.21.15.77:50884) 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 -- 172.21.15.77:0/358326991 learned_addr learned my addr 172.21.15.77:0/358326991 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b3fff640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6b414f750 0x7fb6b40cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b37fe640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b40d0380 0x7fb6b40ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 -- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b40d0380 msgr2=0x7fb6b40ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b40d0380 0x7fb6b40ccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 -- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6b414f750 msgr2=0x7fb6b40cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6b414f750 0x7fb6b40cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.003+0000 7fb6b2ffd640 1 -- 172.21.15.77:0/358326991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b414fc00 con 0x7fb6b415f4b0 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.004+0000 7fb6b2ffd640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 0x7fb6b41625f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c460 tx=0x7fb6a800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.004+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8017070 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.004+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80035f0 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.004+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8003a20 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.004+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b40cd460 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.004+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b415faa0 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.005+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b415e660 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.005+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb6a801a070 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.006+0000 7fb69bfff640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb6a0076300 0x7fb6a00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.006+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb6a8096970 con 0x7fb6b415f4b0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.006+0000 7fb6b37fe640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb6a0076300 0x7fb6a00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.006+0000 7fb6b37fe640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb6a0076300 0x7fb6a00787c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4034000 tx=0x7fb6a4033040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.010+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb6b415e660 con 0x7fb6b415f4b0 2024-05-15T12:10:14.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:10:14.113 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:10:14.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.231+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6b40d6190 con 0x7fb6b415f4b0 2024-05-15T12:10:14.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.232+0000 7fb69bfff640 1 -- 172.21.15.77:0/358326991 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7fb6a80602d0 con 0x7fb6b415f4b0 2024-05-15T12:10:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:14.228 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.233+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb6a0076300 msgr2=0x7fb6a00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.233+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb6a0076300 0x7fb6a00787c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4034000 tx=0x7fb6a4033040 comp rx=0 tx=0).stop 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.233+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 msgr2=0x7fb6b41625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.233+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 0x7fb6b41625f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c460 tx=0x7fb6a800c920 comp rx=0 tx=0).stop 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 shutdown_connections 2024-05-15T12:10:14.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb6a0076300 0x7fb6a00787c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb6b414f750 0x7fb6b40cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6b415f4b0 0x7fb6b41625f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 --2- 172.21.15.77:0/358326991 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb6b40d0380 0x7fb6b40ccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 >> 172.21.15.77:0/358326991 conn(0x7fb6b408ec60 msgr2=0x7fb6b406d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:14.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 shutdown_connections 2024-05-15T12:10:14.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.234+0000 7fb6b9e5c640 1 -- 172.21.15.77:0/358326991 wait complete. 2024-05-15T12:10:14.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:10:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.384+0000 7f56b9f71640 1 Processor -- start 2024-05-15T12:10:14.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b9f71640 1 -- start start 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b9f71640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b40d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b9f71640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56b415f840 0x7f56b40d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b9f71640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56b40d0dd0 con 0x7f56b415f460 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b9f71640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f56b40d19e0 con 0x7f56b415f840 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b9f71640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f56b40d10b0 con 0x7f56b40d3fd0 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.385+0000 7f56b3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56b415f840 0x7f56b40d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b37fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f56b415f460 0x7f56b40d38c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58366/0 (socket says 172.21.15.77:58366) 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b37fe640 1 -- 172.21.15.77:0/3346219180 learned_addr learned my addr 172.21.15.77:0/3346219180 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56aaffd640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b40d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b3fff640 1 -- 172.21.15.77:0/3346219180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 msgr2=0x7f56b40d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b3fff640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b40d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b3fff640 1 -- 172.21.15.77:0/3346219180 >> v1:172.21.15.77:6789/0 conn(0x7f56b415f460 legacy=0x7f56b40d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b2ffd640 1 -- 172.21.15.77:0/3346219180 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906243721 0 0) 0x7f56b40d0dd0 con 0x7f56b415f460 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b3fff640 1 -- 172.21.15.77:0/3346219180 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b40d1390 con 0x7f56b415f840 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56aaffd640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b40d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.386+0000 7f56b3fff640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40d05a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009d90 tx=0x7f56ac02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88aff54d0d65a702 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b2ffd640 1 -- 172.21.15.77:0/3346219180 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac031600 con 0x7f56b415f840 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b2ffd640 1 -- 172.21.15.77:0/3346219180 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac0317a0 con 0x7f56b415f840 2024-05-15T12:10:14.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b2ffd640 1 -- 172.21.15.77:0/3346219180 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac031b70 con 0x7f56b415f840 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 -- 172.21.15.77:0/3346219180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 msgr2=0x7f56b40d05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40d05a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009d90 tx=0x7f56ac02a5d0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 -- 172.21.15.77:0/3346219180 shutdown_connections 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40d05a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 --2- 172.21.15.77:0/3346219180 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b40d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 -- 172.21.15.77:0/3346219180 >> 172.21.15.77:0/3346219180 conn(0x7f56b408ec10 msgr2=0x7f56b409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 -- 172.21.15.77:0/3346219180 shutdown_connections 2024-05-15T12:10:14.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.387+0000 7f56b9f71640 1 -- 172.21.15.77:0/3346219180 wait complete. 2024-05-15T12:10:14.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.388+0000 7f56b9f71640 1 Processor -- start 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 -- start start 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b4157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b415f460 0x7f56b4157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40b4a00 con 0x7f56b415f840 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f56b40d0ae0 con 0x7f56b415f460 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b9f71640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f56b40b4b80 con 0x7f56b40d3fd0 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50906/0 (socket says 172.21.15.77:50906) 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.389+0000 7f56b3fff640 1 -- 172.21.15.77:0/655025590 learned_addr learned my addr 172.21.15.77:0/655025590 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b37fe640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b4157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56aaffd640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b415f460 0x7f56b4157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b3fff640 1 -- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 msgr2=0x7f56b4157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b3fff640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b4157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b3fff640 1 -- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b415f460 msgr2=0x7f56b4157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b3fff640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b415f460 0x7f56b4157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b3fff640 1 -- 172.21.15.77:0/655025590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b41621c0 con 0x7f56b415f840 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56aaffd640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b415f460 0x7f56b4157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b3fff640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40ccfd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009eb0 tx=0x7f56ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac03f070 con 0x7f56b415f840 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56ac030b60 con 0x7f56b415f840 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b41607b0 con 0x7f56b415f840 2024-05-15T12:10:14.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ac044460 con 0x7f56b415f840 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.390+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b4162460 con 0x7f56b415f840 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.391+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b406a640 con 0x7f56b415f840 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.392+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f56ac03b410 con 0x7f56b415f840 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.392+0000 7f56b0ff9640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f56940762d0 0x7f5694078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.392+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f56ac0b8d00 con 0x7f56b415f840 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.392+0000 7f56b37fe640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f56940762d0 0x7f5694078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.392+0000 7f56b37fe640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f56940762d0 0x7f5694078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56a4000f60 tx=0x7f56a4007b10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.396+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f56ac082720 con 0x7f56b415f840 2024-05-15T12:10:14.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.610+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56b40d2400 con 0x7f56b415f840 2024-05-15T12:10:14.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.610+0000 7f56b0ff9640 1 -- 172.21.15.77:0/655025590 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f56ac082020 con 0x7f56b415f840 2024-05-15T12:10:14.605 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:10:14.606 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:10:14.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f56940762d0 msgr2=0x7f5694078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f56940762d0 0x7f5694078790 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f56a4000f60 tx=0x7f56a4007b10 comp rx=0 tx=0).stop 2024-05-15T12:10:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 msgr2=0x7f56b40ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40ccfd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009eb0 tx=0x7f56ac004a40 comp rx=0 tx=0).stop 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 shutdown_connections 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f56940762d0 0x7f5694078790 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56b415f840 0x7f56b40ccfd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f56b415f460 0x7f56b4157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 --2- 172.21.15.77:0/655025590 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f56b40d3fd0 0x7f56b4157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.612+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 >> 172.21.15.77:0/655025590 conn(0x7f56b408ec10 msgr2=0x7f56b406d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.613+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 shutdown_connections 2024-05-15T12:10:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.613+0000 7f56b9f71640 1 -- 172.21.15.77:0/655025590 wait complete. 2024-05-15T12:10:14.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:10:14.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.725+0000 7f09b2445640 1 Processor -- start 2024-05-15T12:10:14.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.725+0000 7f09b2445640 1 -- start start 2024-05-15T12:10:14.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09b2445640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f09ac13ee10 0x7f09ac141730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09b2445640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f09ac0cff90 0x7f09ac072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09b2445640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09ac0d0640 con 0x7f09ac141c70 2024-05-15T12:10:14.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09b2445640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f09ac0d0420 con 0x7f09ac0cff90 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09b2445640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f09ac0d0920 con 0x7f09ac13ee10 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09b09e2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f09ac0cff90 0x7f09ac072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09ab7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f09ac141c70 0x7f09ac0cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58376/0 (socket says 172.21.15.77:58376) 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.726+0000 7f09ab7fe640 1 -- 172.21.15.77:0/283221227 learned_addr learned my addr 172.21.15.77:0/283221227 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09abfff640 1 --2- 172.21.15.77:0/283221227 >> v2:172.21.15.83:3300/0 conn(0x7f09ac13ee10 0x7f09ac141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09b09e2640 1 -- 172.21.15.77:0/283221227 >> v2:172.21.15.83:3300/0 conn(0x7f09ac13ee10 msgr2=0x7f09ac141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09b09e2640 1 --2- 172.21.15.77:0/283221227 >> v2:172.21.15.83:3300/0 conn(0x7f09ac13ee10 0x7f09ac141730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09b09e2640 1 -- 172.21.15.77:0/283221227 >> v1:172.21.15.77:6789/0 conn(0x7f09ac141c70 legacy=0x7f09ac0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09aaffd640 1 -- 172.21.15.77:0/283221227 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57169466 0 0) 0x7f09ac0d0640 con 0x7f09ac141c70 2024-05-15T12:10:14.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09b09e2640 1 -- 172.21.15.77:0/283221227 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ac0d0c00 con 0x7f09ac0cff90 2024-05-15T12:10:14.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09b09e2640 1 --2- 172.21.15.77:0/283221227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac072aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f09ac070230 tx=0x7f09a402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ad83c72c97eb9b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09aaffd640 1 -- 172.21.15.77:0/283221227 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a4032790 con 0x7f09ac0cff90 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09aaffd640 1 -- 172.21.15.77:0/283221227 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09a4038070 con 0x7f09ac0cff90 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.727+0000 7f09aaffd640 1 -- 172.21.15.77:0/283221227 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09a4032b50 con 0x7f09ac0cff90 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 -- 172.21.15.77:0/283221227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 msgr2=0x7f09ac072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 --2- 172.21.15.77:0/283221227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac072aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f09ac070230 tx=0x7f09a402c890 comp rx=0 tx=0).stop 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 -- 172.21.15.77:0/283221227 shutdown_connections 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 --2- 172.21.15.77:0/283221227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac072aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 --2- 172.21.15.77:0/283221227 >> v2:172.21.15.83:3300/0 conn(0x7f09ac13ee10 0x7f09ac141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 -- 172.21.15.77:0/283221227 >> 172.21.15.77:0/283221227 conn(0x7f09ac06c810 msgr2=0x7f09ac06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 -- 172.21.15.77:0/283221227 shutdown_connections 2024-05-15T12:10:14.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.728+0000 7f09b2445640 1 -- 172.21.15.77:0/283221227 wait complete. 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.729+0000 7f09b2445640 1 Processor -- start 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 -- start start 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac1f59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09ac13ee10 0x7f09ac13dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09ac141c70 0x7f09ac0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac13f1f0 con 0x7f09ac0cff90 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f09ac072580 con 0x7f09ac13ee10 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09b2445640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f09ac13f370 con 0x7f09ac141c70 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac1f59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09abfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac1f59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50928/0 (socket says 172.21.15.77:50928) 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.730+0000 7f09abfff640 1 -- 172.21.15.77:0/4179380524 learned_addr learned my addr 172.21.15.77:0/4179380524 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:14.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09ab7fe640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09ac13ee10 0x7f09ac13dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09abfff640 1 -- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09ac141c70 msgr2=0x7f09ac0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09abfff640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09ac141c70 0x7f09ac0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09abfff640 1 -- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09ac13ee10 msgr2=0x7f09ac13dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09abfff640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09ac13ee10 0x7f09ac13dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09abfff640 1 -- 172.21.15.77:0/4179380524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09ac1f5f20 con 0x7f09ac0cff90 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09abfff640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac1f59e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f099c00c610 tx=0x7f099c00cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c015070 con 0x7f09ac0cff90 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099c004220 con 0x7f09ac0cff90 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09ac13ce10 con 0x7f09ac0cff90 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f099c003610 con 0x7f09ac0cff90 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.731+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09ac13d7c0 con 0x7f09ac0cff90 2024-05-15T12:10:14.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.732+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ac06a640 con 0x7f09ac0cff90 2024-05-15T12:10:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.733+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f099c0037d0 con 0x7f09ac0cff90 2024-05-15T12:10:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.733+0000 7f09a8ff9640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f09980762d0 0x7f0998078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.733+0000 7f09ab7fe640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f09980762d0 0x7f0998078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.733+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f099c097360 con 0x7f09ac0cff90 2024-05-15T12:10:14.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.734+0000 7f09ab7fe640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f09980762d0 0x7f0998078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f09ac13ca70 tx=0x7f09a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:14.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.738+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f09ac1f5f20 con 0x7f09ac0cff90 2024-05-15T12:10:14.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.918+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09ac0742e0 con 0x7f09ac0cff90 2024-05-15T12:10:14.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.919+0000 7f09a8ff9640 1 -- 172.21.15.77:0/4179380524 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7f099c060d50 con 0x7f09ac0cff90 2024-05-15T12:10:14.914 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:14.914 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:10:14.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f09980762d0 msgr2=0x7f0998078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f09980762d0 0x7f0998078790 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f09ac13ca70 tx=0x7f09a0009040 comp rx=0 tx=0).stop 2024-05-15T12:10:14.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 msgr2=0x7f09ac1f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac1f59e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f099c00c610 tx=0x7f099c00cad0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 shutdown_connections 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f09980762d0 0x7f0998078790 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f09ac141c70 0x7f09ac0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f09ac13ee10 0x7f09ac13dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 --2- 172.21.15.77:0/4179380524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09ac0cff90 0x7f09ac1f59e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 >> 172.21.15.77:0/4179380524 conn(0x7f09ac06c810 msgr2=0x7f09ac15b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 shutdown_connections 2024-05-15T12:10:14.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:14.921+0000 7f09b2445640 1 -- 172.21.15.77:0/4179380524 wait complete. 2024-05-15T12:10:14.928 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-15T12:10:14.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:10:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.033+0000 7f7a43e9c640 1 Processor -- start 2024-05-15T12:10:15.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.033+0000 7f7a43e9c640 1 -- start start 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.034+0000 7f7a43e9c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7a3c073ab0 0x7f7a3c0cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.034+0000 7f7a43e9c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3c0d0640 con 0x7f7a3c13ee10 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.034+0000 7f7a43e9c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3c0d0920 con 0x7f7a3c141e40 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.034+0000 7f7a43e9c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7a3c0d0c00 con 0x7f7a3c073ab0 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.034+0000 7f7a41c38640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7a3c13ee10 0x7f7a3c141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58388/0 (socket says 172.21.15.77:58388) 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.034+0000 7f7a41c38640 1 -- 172.21.15.77:0/2381815133 learned_addr learned my addr 172.21.15.77:0/2381815133 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:15.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 --2- 172.21.15.77:0/2381815133 >> v2:172.21.15.83:3300/0 conn(0x7f7a3c073ab0 0x7f7a3c0cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1676041234 0 0) 0x7f7a3c0d0640 con 0x7f7a3c13ee10 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a24005730 con 0x7f7a3c13ee10 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2190547276 0 0) 0x7f7a24005730 con 0x7f7a3c13ee10 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 >> v2:172.21.15.83:3300/0 conn(0x7f7a3c073ab0 msgr2=0x7f7a3c0cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 --2- 172.21.15.77:0/2381815133 >> v2:172.21.15.83:3300/0 conn(0x7f7a3c073ab0 0x7f7a3c0cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 >> v1:172.21.15.83:6789/0 conn(0x7f7a3c141e40 legacy=0x7f7a3c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c0722a0 con 0x7f7a3c13ee10 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f7a2c0016f0 con 0x7f7a3c13ee10 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 >> v1:172.21.15.77:6789/0 conn(0x7f7a3c13ee10 legacy=0x7f7a3c141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24005cd0 0x7f7a240060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a24006a10 0x7f7a24006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a24007440 0x7f7a2400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c0d0c00 con 0x7f7a24007440 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2400e3a0 con 0x7f7a24006a10 2024-05-15T12:10:15.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7a2400e5a0 con 0x7f7a24005cd0 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a24007440 0x7f7a2400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a41437640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a24006a10 0x7f7a24006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a41c38640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24005cd0 0x7f7a240060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 -- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24005cd0 msgr2=0x7f7a240060f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24005cd0 0x7f7a240060f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 -- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a24006a10 msgr2=0x7f7a24006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a24006a10 0x7f7a24006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a42439640 1 -- 172.21.15.77:0/2381815133 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a24005730 con 0x7f7a24007440 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.035+0000 7f7a41c38640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24005cd0 0x7f7a240060f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.036+0000 7f7a42439640 1 -- 172.21.15.77:0/2381815133 reap_dead start 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.036+0000 7f7a42439640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a24007440 0x7f7a2400dbd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009f90 tx=0x7f7a24007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10705342bb136b3c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.036+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34037070 con 0x7f7a24007440 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.036+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a34032620 con 0x7f7a24007440 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.036+0000 7f7a40c36640 1 -- 172.21.15.77:0/2381815133 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a34009c10 con 0x7f7a24007440 2024-05-15T12:10:15.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 -- 172.21.15.77:0/2381815133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a24007440 msgr2=0x7f7a2400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a24007440 0x7f7a2400dbd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009f90 tx=0x7f7a24007a40 comp rx=0 tx=0).stop 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 -- 172.21.15.77:0/2381815133 shutdown_connections 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/2381815133 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a24007440 0x7f7a2400dbd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 -- 172.21.15.77:0/2381815133 >> 172.21.15.77:0/2381815133 conn(0x7f7a3c06c810 msgr2=0x7f7a3c06cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 -- 172.21.15.77:0/2381815133 shutdown_connections 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.037+0000 7f7a43e9c640 1 -- 172.21.15.77:0/2381815133 wait complete. 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.038+0000 7f7a43e9c640 1 Processor -- start 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.038+0000 7f7a43e9c640 1 -- start start 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24007440 0x7f7a3c13a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 0x7f7a3c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a3c0b53d0 0x7f7a3c0b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c13f370 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7a3c13f1f0 con 0x7f7a3c0b53d0 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7a3c141730 con 0x7f7a24007440 2024-05-15T12:10:15.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 0x7f7a3c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 0x7f7a3c153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50940/0 (socket says 172.21.15.77:50940) 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 -- 172.21.15.77:0/1005581291 learned_addr learned my addr 172.21.15.77:0/1005581291 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a42439640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a3c0b53d0 0x7f7a3c0b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41c38640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24007440 0x7f7a3c13a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 -- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24007440 msgr2=0x7f7a3c13a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24007440 0x7f7a3c13a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 -- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a3c0b53d0 msgr2=0x7f7a3c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a3c0b53d0 0x7f7a3c0b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 -- 172.21.15.77:0/1005581291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3c13a7e0 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a41437640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 0x7f7a3c153730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000f850 tx=0x7f7a3000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3001a070 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3000fe40 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a3c154060 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30007050 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.039+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a3c154620 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.040+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3c06a640 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.041+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7a3001d070 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.041+0000 7f7a3a7fc640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7a280762d0 0x7f7a28078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.041+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7a30096e00 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.041+0000 7f7a41c38640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7a280762d0 0x7f7a28078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.042+0000 7f7a41c38640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7a280762d0 0x7f7a28078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c13f750 tx=0x7f7a2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.046+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7a30060760 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.263+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a3c156ad0 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.263+0000 7f7a3a7fc640 1 -- 172.21.15.77:0/1005581291 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f7a3c156ad0 con 0x7f7a3c1f54b0 2024-05-15T12:10:15.258 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:15.259 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:10:15.259 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7a280762d0 msgr2=0x7f7a28078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7a280762d0 0x7f7a28078790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c13f750 tx=0x7f7a2c009040 comp rx=0 tx=0).stop 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 msgr2=0x7f7a3c153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 0x7f7a3c153730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000f850 tx=0x7f7a3000fd10 comp rx=0 tx=0).stop 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 shutdown_connections 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7a280762d0 0x7f7a28078790 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7a3c0b53d0 0x7f7a3c0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7a3c1f54b0 0x7f7a3c153730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 --2- 172.21.15.77:0/1005581291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7a24007440 0x7f7a3c13a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 >> 172.21.15.77:0/1005581291 conn(0x7f7a3c06c810 msgr2=0x7f7a3c0728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:15.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 shutdown_connections 2024-05-15T12:10:15.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.266+0000 7f7a43e9c640 1 -- 172.21.15.77:0/1005581291 wait complete. 2024-05-15T12:10:15.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:10:15.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.377+0000 7f0d04a1c640 1 Processor -- start 2024-05-15T12:10:15.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.377+0000 7f0d04a1c640 1 -- start start 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.378+0000 7f0d04a1c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0d000cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.378+0000 7f0d04a1c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d000d0640 con 0x7f0d0013ee10 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.378+0000 7f0d04a1c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d000d0920 con 0x7f0d00141e40 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.378+0000 7f0d04a1c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0d000d0c00 con 0x7f0d00073ab0 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.378+0000 7f0cfe59c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0d0013ee10 0x7f0d00141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58404/0 (socket says 172.21.15.77:58404) 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.378+0000 7f0cfe59c640 1 -- 172.21.15.77:0/3329829055 learned_addr learned my addr 172.21.15.77:0/3329829055 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfed9d640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0d000cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806353264 0 0) 0x7f0d000d0640 con 0x7f0d0013ee10 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ce8003520 con 0x7f0d0013ee10 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 473976238 0 0) 0x7f0ce8003520 con 0x7f0d0013ee10 2024-05-15T12:10:15.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 msgr2=0x7f0d000cff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0d000cff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 >> v1:172.21.15.83:6789/0 conn(0x7f0d00141e40 legacy=0x7f0d000cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d000722a0 con 0x7f0d0013ee10 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f0cf00016f0 con 0x7f0d0013ee10 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 >> v1:172.21.15.77:6789/0 conn(0x7f0d0013ee10 legacy=0x7f0d00141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce8003a50 0x7f0ce8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0ce8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce8004d40 0x7f0ce80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d000d0c00 con 0x7f0ce8003a50 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce800bb00 con 0x7f0ce8004d40 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce800bd00 con 0x7f0d00073ab0 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce8003a50 0x7f0ce8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfed9d640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce8004d40 0x7f0ce80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfdd9b640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0ce8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfe59c640 1 -- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 msgr2=0x7f0ce8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0ce8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfe59c640 1 -- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce8004d40 msgr2=0x7f0ce80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0ce8004d40 0x7f0ce80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfe59c640 1 -- 172.21.15.77:0/3329829055 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce8003520 con 0x7f0ce8003a50 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.379+0000 7f0cfdd9b640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0d00073ab0 0x7f0ce8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.380+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce8003a50 0x7f0ce8003e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c210 tx=0x7f0ce8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13150eacca991a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.380+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0007d10 con 0x7f0ce8003a50 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.380+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf0005ad0 con 0x7f0ce8003a50 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.380+0000 7f0cfd59a640 1 -- 172.21.15.77:0/3329829055 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0007070 con 0x7f0ce8003a50 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0d04a1c640 1 -- 172.21.15.77:0/3329829055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce8003a50 msgr2=0x7f0ce8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/3329829055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ce8003a50 0x7f0ce8003e30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0cf000c210 tx=0x7f0ce8005830 comp rx=0 tx=0).stop 2024-05-15T12:10:15.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0cfed9d640 1 -- 172.21.15.77:0/3329829055 reap_dead start 2024-05-15T12:10:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0d04a1c640 1 -- 172.21.15.77:0/3329829055 shutdown_connections 2024-05-15T12:10:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0d04a1c640 1 -- 172.21.15.77:0/3329829055 >> 172.21.15.77:0/3329829055 conn(0x7f0d0006c810 msgr2=0x7f0d0006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0d04a1c640 1 -- 172.21.15.77:0/3329829055 shutdown_connections 2024-05-15T12:10:15.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.381+0000 7f0d04a1c640 1 -- 172.21.15.77:0/3329829055 wait complete. 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.382+0000 7f0d04a1c640 1 Processor -- start 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.382+0000 7f0d04a1c640 1 -- start start 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0d04a1c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce8003a50 0x7f0d0013c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0d04a1c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d0015f1d0 0x7f0d0013a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0d04a1c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 0x7f0d001f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0d04a1c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0013f370 con 0x7f0d001f8b70 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0d04a1c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0013f1f0 con 0x7f0d0015f1d0 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0d04a1c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0d000cff90 con 0x7f0ce8003a50 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 0x7f0d001f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 0x7f0d001f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50960/0 (socket says 172.21.15.77:50960) 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 -- 172.21.15.77:0/814290384 learned_addr learned my addr 172.21.15.77:0/814290384 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfdd9b640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d0015f1d0 0x7f0d0013a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce8003a50 0x7f0d0013c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 -- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce8003a50 msgr2=0x7f0d0013c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce8003a50 0x7f0d0013c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 -- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d0015f1d0 msgr2=0x7f0d0013a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d0015f1d0 0x7f0d0013a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 -- 172.21.15.77:0/814290384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0013aba0 con 0x7f0d001f8b70 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce8003a50 0x7f0d0013c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.383+0000 7f0cfed9d640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 0x7f0d001f8ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009fd0 tx=0x7f0cf800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.384+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8011e90 con 0x7f0d001f8b70 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.384+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cf801c070 con 0x7f0d001f8b70 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.384+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8003bd0 con 0x7f0d001f8b70 2024-05-15T12:10:15.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.384+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0013ca20 con 0x7f0d001f8b70 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.384+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d0013dce0 con 0x7f0d001f8b70 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.385+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0006a640 con 0x7f0d001f8b70 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.385+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0cf8004030 con 0x7f0d001f8b70 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.386+0000 7f0ceeffd640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0ce00764a0 0x7f0ce0078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.386+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0cf8097ce0 con 0x7f0d001f8b70 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.386+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0ce00764a0 0x7f0ce0078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.386+0000 7f0cfe59c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0ce00764a0 0x7f0ce0078960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0032000 tx=0x7f0cf0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.390+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0cf8010040 con 0x7f0d001f8b70 2024-05-15T12:10:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.604+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d00142490 con 0x7f0d001f8b70 2024-05-15T12:10:15.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.605+0000 7f0ceeffd640 1 -- 172.21.15.77:0/814290384 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5172 (secure 0 0 0) 0x7f0cf8061640 con 0x7f0d001f8b70 2024-05-15T12:10:15.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:15.600 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1144799750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1144799750},{"type":"v1","addr":"172.21.15.83:6834","nonce":1144799750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/370582993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":370582993},{"type":"v1","addr":"172.21.15.77:6836","nonce":370582993}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1007619036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1007619036},{"type":"v1","addr":"172.21.15.77:6837","nonce":1007619036}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:09:43.024878+0000","modified":"2024-05-15T12:09:46.032593+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.83:6835/4120523335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":4120523335},{"type":"v1","addr":"172.21.15.83:6835","nonce":4120523335}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4302,"qdb_cluster":[4302]},"id":1}]} 2024-05-15T12:10:15.600 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 8 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0ce00764a0 msgr2=0x7f0ce0078960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0ce00764a0 0x7f0ce0078960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0032000 tx=0x7f0cf0009030 comp rx=0 tx=0).stop 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 msgr2=0x7f0d001f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 0x7f0d001f8ff0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009fd0 tx=0x7f0cf800f580 comp rx=0 tx=0).stop 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 shutdown_connections 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0ce00764a0 0x7f0ce0078960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d001f8b70 0x7f0d001f8ff0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0d0015f1d0 0x7f0d0013a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 --2- 172.21.15.77:0/814290384 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0ce8003a50 0x7f0d0013c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 >> 172.21.15.77:0/814290384 conn(0x7f0d0006c810 msgr2=0x7f0d0006f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 shutdown_connections 2024-05-15T12:10:15.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.607+0000 7f0d04a1c640 1 -- 172.21.15.77:0/814290384 wait complete. 2024-05-15T12:10:15.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:10:15.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.721+0000 7f7d66ff0640 1 Processor -- start 2024-05-15T12:10:15.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.721+0000 7f7d66ff0640 1 -- start start 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d66ff0640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7d601469b0 0x7f7d6015e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d66ff0640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d600b4a40 0x7f7d600ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d66ff0640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6015e620 con 0x7f7d600ceaa0 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d66ff0640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7d600b6430 con 0x7f7d600b4a40 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d66ff0640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f7d600b4f00 con 0x7f7d601469b0 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d600b4a40 0x7f7d600ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d6558d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7d600ceaa0 0x7f7d60160c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58408/0 (socket says 172.21.15.77:58408) 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5ffff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d600b4a40 0x7f7d600ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50974/0 (socket says 172.21.15.77:50974) 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d6558d640 1 -- 172.21.15.77:0/169184352 learned_addr learned my addr 172.21.15.77:0/169184352 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:15.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d64d8c640 1 --2- 172.21.15.77:0/169184352 >> v2:172.21.15.83:3300/0 conn(0x7f7d601469b0 0x7f7d6015e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5ffff640 1 -- 172.21.15.77:0/169184352 >> v2:172.21.15.83:3300/0 conn(0x7f7d601469b0 msgr2=0x7f7d6015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/169184352 >> v2:172.21.15.83:3300/0 conn(0x7f7d601469b0 0x7f7d6015e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5ffff640 1 -- 172.21.15.77:0/169184352 >> v1:172.21.15.77:6789/0 conn(0x7f7d600ceaa0 legacy=0x7f7d60160c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/169184352 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2746932318 0 0) 0x7f7d58001490 con 0x7f7d600ceaa0 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.722+0000 7f7d5ffff640 1 -- 172.21.15.77:0/169184352 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d600b51e0 con 0x7f7d600b4a40 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.723+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/169184352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d600ce560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7d600704b0 tx=0x7f7d5402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed48943c3ad952df server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.723+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/169184352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54037070 con 0x7f7d600b4a40 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.723+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/169184352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d54032440 con 0x7f7d600b4a40 2024-05-15T12:10:15.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.723+0000 7f7d5f7fe640 1 -- 172.21.15.77:0/169184352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5402ae60 con 0x7f7d600b4a40 2024-05-15T12:10:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 -- 172.21.15.77:0/169184352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 msgr2=0x7f7d600ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/169184352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d600ce560 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7d600704b0 tx=0x7f7d5402a110 comp rx=0 tx=0).stop 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 -- 172.21.15.77:0/169184352 shutdown_connections 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/169184352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d600ce560 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/169184352 >> v2:172.21.15.83:3300/0 conn(0x7f7d601469b0 0x7f7d6015e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 -- 172.21.15.77:0/169184352 >> 172.21.15.77:0/169184352 conn(0x7f7d6006c810 msgr2=0x7f7d6006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 -- 172.21.15.77:0/169184352 shutdown_connections 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.724+0000 7f7d66ff0640 1 -- 172.21.15.77:0/169184352 wait complete. 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.725+0000 7f7d66ff0640 1 Processor -- start 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.725+0000 7f7d66ff0640 1 -- start start 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d66ff0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d6015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d66ff0640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d600ceaa0 0x7f7d60072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d66ff0640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d601469b0 0x7f7d60159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d66ff0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7d600b5a80 con 0x7f7d600b4a40 2024-05-15T12:10:15.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d66ff0640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7d600b57a0 con 0x7f7d601469b0 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d66ff0640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6006f970 con 0x7f7d600ceaa0 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d6015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d6015fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50978/0 (socket says 172.21.15.77:50978) 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 -- 172.21.15.77:0/2630331185 learned_addr learned my addr 172.21.15.77:0/2630331185 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d6558d640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d601469b0 0x7f7d60159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d600ceaa0 0x7f7d60072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 -- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d600ceaa0 msgr2=0x7f7d60072db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d600ceaa0 0x7f7d60072db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 -- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d601469b0 msgr2=0x7f7d60159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d601469b0 0x7f7d60159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 -- 172.21.15.77:0/2630331185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d601442e0 con 0x7f7d600b4a40 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d6558d640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d601469b0 0x7f7d60159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:15.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d600ceaa0 0x7f7d60072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.726+0000 7f7d64d8c640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d6015fac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c5e0 tx=0x7f7d5000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.727+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50015070 con 0x7f7d600b4a40 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.727+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d50004260 con 0x7f7d600b4a40 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.727+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d601445c0 con 0x7f7d600b4a40 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.727+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50003610 con 0x7f7d600b4a40 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.727+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d60144b80 con 0x7f7d600b4a40 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.728+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6006a640 con 0x7f7d600b4a40 2024-05-15T12:10:15.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.728+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7d500037b0 con 0x7f7d600b4a40 2024-05-15T12:10:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.729+0000 7f7d5d7fa640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d4c0762d0 0x7f7d4c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.729+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d4c0762d0 0x7f7d4c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.729+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7d50097420 con 0x7f7d600b4a40 2024-05-15T12:10:15.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.729+0000 7f7d5ffff640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d4c0762d0 0x7f7d4c078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d54034000 tx=0x7f7d5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:15.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.733+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7d50060d80 con 0x7f7d600b4a40 2024-05-15T12:10:15.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.913+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d600b38b0 con 0x7f7d600b4a40 2024-05-15T12:10:15.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.914+0000 7f7d5d7fa640 1 -- 172.21.15.77:0/2630331185 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16537 (secure 0 0 0) 0x7f7d50060680 con 0x7f7d600b4a40 2024-05-15T12:10:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:15.909 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:09:44.660372+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:09:40.874294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-15T12:09:41.980772+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:10:15.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d4c0762d0 msgr2=0x7f7d4c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d4c0762d0 0x7f7d4c078790 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7d54034000 tx=0x7f7d5402e000 comp rx=0 tx=0).stop 2024-05-15T12:10:15.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 msgr2=0x7f7d6015fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:15.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d6015fac0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000c5e0 tx=0x7f7d5000caa0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 shutdown_connections 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7d4c0762d0 0x7f7d4c078790 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.916+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7d600ceaa0 0x7f7d60072db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.917+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7d601469b0 0x7f7d60159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.917+0000 7f7d66ff0640 1 --2- 172.21.15.77:0/2630331185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d600b4a40 0x7f7d6015fac0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.917+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 >> 172.21.15.77:0/2630331185 conn(0x7f7d6006c810 msgr2=0x7f7d6006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.917+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 shutdown_connections 2024-05-15T12:10:15.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:15.917+0000 7f7d66ff0640 1 -- 172.21.15.77:0/2630331185 wait complete. 2024-05-15T12:10:15.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-15T12:10:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.029+0000 7f5a3f951640 1 Processor -- start 2024-05-15T12:10:16.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.029+0000 7f5a3f951640 1 -- start start 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.030+0000 7f5a3f951640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 0x7f5a3806c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.030+0000 7f5a3f951640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380cebc0 con 0x7f5a38070a50 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.030+0000 7f5a3f951640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380ceea0 con 0x7f5a38146a90 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.030+0000 7f5a3f951640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5a3806cd70 con 0x7f5a3806c3f0 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.030+0000 7f5a3deee640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5a38070a50 0x7f5a38070e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58414/0 (socket says 172.21.15.77:58414) 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.030+0000 7f5a3deee640 1 -- 172.21.15.77:0/623834287 learned_addr learned my addr 172.21.15.77:0/623834287 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3ceec640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 0x7f5a3806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127949524 0 0) 0x7f5a380cebc0 con 0x7f5a38070a50 2024-05-15T12:10:16.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a24003520 con 0x7f5a38070a50 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609601605 0 0) 0x7f5a380ceea0 con 0x7f5a38146a90 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a380cebc0 con 0x7f5a38146a90 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1545536453 0 0) 0x7f5a24003520 con 0x7f5a38070a50 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 msgr2=0x7f5a3806c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 0x7f5a3806c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 >> v1:172.21.15.83:6789/0 conn(0x7f5a38146a90 legacy=0x7f5a3806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a380cf180 con 0x7f5a38070a50 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f5a300016f0 con 0x7f5a38070a50 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 >> v1:172.21.15.77:6789/0 conn(0x7f5a38070a50 legacy=0x7f5a38070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a24003c10 0x7f5a24004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 0x7f5a24004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a24004d40 0x7f5a240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a3806cd70 con 0x7f5a24004d40 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2400bb50 con 0x7f5a24003c10 2024-05-15T12:10:16.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2400bd50 con 0x7f5a3806c3f0 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3deee640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a24004d40 0x7f5a240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3d6ed640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a24003c10 0x7f5a24004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3ceec640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 0x7f5a24004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3deee640 1 -- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 msgr2=0x7f5a24004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3deee640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a3806c3f0 0x7f5a24004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3deee640 1 -- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a24003c10 msgr2=0x7f5a24004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3deee640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a24003c10 0x7f5a24004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3deee640 1 -- 172.21.15.77:0/623834287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a24003520 con 0x7f5a24004d40 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.031+0000 7f5a3d6ed640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a24003c10 0x7f5a24004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.032+0000 7f5a3deee640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a24004d40 0x7f5a240051c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c190 tx=0x7f5a24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dc261f8f2670d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.032+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007cc0 con 0x7f5a24004d40 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.032+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a30005ad0 con 0x7f5a24004d40 2024-05-15T12:10:16.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.032+0000 7f5a2ffff640 1 -- 172.21.15.77:0/623834287 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007070 con 0x7f5a24004d40 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3f951640 1 -- 172.21.15.77:0/623834287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a24004d40 msgr2=0x7f5a240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3f951640 1 --2- 172.21.15.77:0/623834287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a24004d40 0x7f5a240051c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c190 tx=0x7f5a24005830 comp rx=0 tx=0).stop 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3deee640 1 -- 172.21.15.77:0/623834287 reap_dead start 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3f951640 1 -- 172.21.15.77:0/623834287 shutdown_connections 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3f951640 1 -- 172.21.15.77:0/623834287 >> 172.21.15.77:0/623834287 conn(0x7f5a3806f2e0 msgr2=0x7f5a3806f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3f951640 1 -- 172.21.15.77:0/623834287 shutdown_connections 2024-05-15T12:10:16.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.033+0000 7f5a3f951640 1 -- 172.21.15.77:0/623834287 wait complete. 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.034+0000 7f5a3f951640 1 Processor -- start 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.034+0000 7f5a3f951640 1 -- start start 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a24004d40 0x7f5a38140430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a3813e0b0 0x7f5a381f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 0x7f5a38143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a38146e70 con 0x7f5a38142b80 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a380cf740 con 0x7f5a3813e0b0 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5a38146ff0 con 0x7f5a24004d40 2024-05-15T12:10:16.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 0x7f5a38143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 0x7f5a38143030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50988/0 (socket says 172.21.15.77:50988) 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 -- 172.21.15.77:0/4013412027 learned_addr learned my addr 172.21.15.77:0/4013412027 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3ceec640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a3813e0b0 0x7f5a381f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3d6ed640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a24004d40 0x7f5a38140430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 -- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a24004d40 msgr2=0x7f5a38140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a24004d40 0x7f5a38140430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 -- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a3813e0b0 msgr2=0x7f5a381f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a3813e0b0 0x7f5a381f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 -- 172.21.15.77:0/4013412027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a381f2e00 con 0x7f5a38142b80 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3ceec640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a3813e0b0 0x7f5a381f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3deee640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 0x7f5a38143030 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c1f0 tx=0x7f5a380cf350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30037040 con 0x7f5a38142b80 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a30041070 con 0x7f5a38142b80 2024-05-15T12:10:16.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.035+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3813e870 con 0x7f5a38142b80 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.036+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007cc0 con 0x7f5a38142b80 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.036+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a3813ee30 con 0x7f5a38142b80 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.037+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a380768e0 con 0x7f5a38142b80 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.037+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a30007070 con 0x7f5a38142b80 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.038+0000 7f5a2dffb640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a1c076300 0x7f5a1c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.038+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5a300b7430 con 0x7f5a38142b80 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.038+0000 7f5a3d6ed640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a1c076300 0x7f5a1c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.038+0000 7f5a3d6ed640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a1c076300 0x7f5a1c0787c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a34007fd0 tx=0x7f5a34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:16.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.042+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a30080d90 con 0x7f5a38142b80 2024-05-15T12:10:16.257 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.262+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5a3815caf0 con 0x7f5a38142b80 2024-05-15T12:10:16.257 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-05-15T12:10:16.263+0000 7f9551be8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-15T12:10:16.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.264+0000 7f5a2dffb640 1 -- 172.21.15.77:0/4013412027 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f5a30080690 con 0x7f5a38142b80 2024-05-15T12:10:16.259 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a1c076300 msgr2=0x7f5a1c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a1c076300 0x7f5a1c0787c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5a34007fd0 tx=0x7f5a34009040 comp rx=0 tx=0).stop 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 msgr2=0x7f5a38143030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 0x7f5a38143030 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c1f0 tx=0x7f5a380cf350 comp rx=0 tx=0).stop 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 shutdown_connections 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a1c076300 0x7f5a1c0787c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a38142b80 0x7f5a38143030 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a3813e0b0 0x7f5a381f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 --2- 172.21.15.77:0/4013412027 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a24004d40 0x7f5a38140430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 >> 172.21.15.77:0/4013412027 conn(0x7f5a3806f2e0 msgr2=0x7f5a38070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 shutdown_connections 2024-05-15T12:10:16.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.267+0000 7f5a3f951640 1 -- 172.21.15.77:0/4013412027 wait complete. 2024-05-15T12:10:16.263 INFO:tasks.ceph.mds.b.smithi083.stderr: -2087> 2024-05-15T12:09:48.643+0000 7fc66347e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-15T12:10:16.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-15T12:10:16.293 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2024-05-15T12:10:16.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.381+0000 7f430603f640 1 Processor -- start 2024-05-15T12:10:16.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.381+0000 7f430603f640 1 -- start start 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f430603f640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f430015bd80 0x7f4300160530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f430603f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43000b5b00 0x7f43000d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f430603f640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4300073010 con 0x7f430015c160 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f430603f640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f43000b4370 con 0x7f430015bd80 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f430603f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f43000b4650 con 0x7f43000b5b00 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42ff7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f430015bd80 0x7f4300160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42feffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f430015c160 0x7f43000b53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58430/0 (socket says 172.21.15.77:58430) 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42feffd640 1 -- 172.21.15.77:0/4015426502 learned_addr learned my addr 172.21.15.77:0/4015426502 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42fffff640 1 --2- 172.21.15.77:0/4015426502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43000b5b00 0x7f43000d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42ff7fe640 1 -- 172.21.15.77:0/4015426502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43000b5b00 msgr2=0x7f43000d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:16.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42ff7fe640 1 --2- 172.21.15.77:0/4015426502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43000b5b00 0x7f43000d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42ff7fe640 1 -- 172.21.15.77:0/4015426502 >> v1:172.21.15.77:6789/0 conn(0x7f430015c160 legacy=0x7f43000b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.382+0000 7f42ff7fe640 1 -- 172.21.15.77:0/4015426502 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43000b4930 con 0x7f430015bd80 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.383+0000 7f42ff7fe640 1 --2- 172.21.15.77:0/4015426502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430015bd80 0x7f4300160530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009d90 tx=0x7f42f002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96931f984fb49194 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.383+0000 7f42fe7fc640 1 -- 172.21.15.77:0/4015426502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0031600 con 0x7f430015bd80 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.383+0000 7f42fe7fc640 1 -- 172.21.15.77:0/4015426502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f00317a0 con 0x7f430015bd80 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.383+0000 7f42fe7fc640 1 -- 172.21.15.77:0/4015426502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0031b70 con 0x7f430015bd80 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 -- 172.21.15.77:0/4015426502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430015bd80 msgr2=0x7f4300160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 --2- 172.21.15.77:0/4015426502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430015bd80 0x7f4300160530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009d90 tx=0x7f42f002a5d0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 -- 172.21.15.77:0/4015426502 shutdown_connections 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 --2- 172.21.15.77:0/4015426502 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43000b5b00 0x7f43000d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 --2- 172.21.15.77:0/4015426502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f430015bd80 0x7f4300160530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 -- 172.21.15.77:0/4015426502 >> 172.21.15.77:0/4015426502 conn(0x7f430006c5d0 msgr2=0x7f430006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:16.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 -- 172.21.15.77:0/4015426502 shutdown_connections 2024-05-15T12:10:16.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.384+0000 7f430603f640 1 -- 172.21.15.77:0/4015426502 wait complete. 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.385+0000 7f430603f640 1 Processor -- start 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.385+0000 7f430603f640 1 -- start start 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f430603f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 0x7f43001f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f430603f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f430015bd80 0x7f430014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f430603f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f430015c160 0x7f4300155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f430603f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43000b3f20 con 0x7f43000b5b00 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f430603f640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f43000b4ef0 con 0x7f430015c160 2024-05-15T12:10:16.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f430603f640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f43000b40a0 con 0x7f430015bd80 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 0x7f43001f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 0x7f43001f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51018/0 (socket says 172.21.15.77:51018) 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 -- 172.21.15.77:0/1084367526 learned_addr learned my addr 172.21.15.77:0/1084367526 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42feffd640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f430015bd80 0x7f430014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42fffff640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f430015c160 0x7f4300155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 -- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f430015bd80 msgr2=0x7f430014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f430015bd80 0x7f430014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 -- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f430015c160 msgr2=0x7f4300155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f430015c160 0x7f4300155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 -- 172.21.15.77:0/1084367526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4300154330 con 0x7f43000b5b00 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42fffff640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f430015c160 0x7f4300155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.386+0000 7f42ff7fe640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 0x7f43001f5a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009d90 tx=0x7f42f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.387+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0040070 con 0x7f43000b5b00 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.387+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42f0030be0 con 0x7f43000b5b00 2024-05-15T12:10:16.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.387+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4300154610 con 0x7f43000b5b00 2024-05-15T12:10:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.387+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f0009450 con 0x7f43000b5b00 2024-05-15T12:10:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.387+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4300154bd0 con 0x7f43000b5b00 2024-05-15T12:10:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.388+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430006a640 con 0x7f43000b5b00 2024-05-15T12:10:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.388+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42f0039040 con 0x7f43000b5b00 2024-05-15T12:10:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.389+0000 7f42e7fff640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42ec0762d0 0x7f42ec078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:16.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.389+0000 7f42feffd640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42ec0762d0 0x7f42ec078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:16.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.389+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f42f00b8d10 con 0x7f43000b5b00 2024-05-15T12:10:16.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.389+0000 7f42feffd640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42ec0762d0 0x7f42ec078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f43000b0d40 tx=0x7f42f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:16.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.393+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42f0082050 con 0x7f43000b5b00 2024-05-15T12:10:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:16.611+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4300155c60 con 0x7f43000b5b00 2024-05-15T12:10:17.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.268+0000 7f42e7fff640 1 -- 172.21.15.77:0/1084367526 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f42f0086350 con 0x7f43000b5b00 2024-05-15T12:10:17.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42ec0762d0 msgr2=0x7f42ec078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:17.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42ec0762d0 0x7f42ec078790 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f43000b0d40 tx=0x7f42f4009040 comp rx=0 tx=0).stop 2024-05-15T12:10:17.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 msgr2=0x7f43001f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:17.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 0x7f43001f5a90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009d90 tx=0x7f42f0004a40 comp rx=0 tx=0).stop 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 shutdown_connections 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42ec0762d0 0x7f42ec078790 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f430015bd80 0x7f430014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f430015c160 0x7f4300155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 --2- 172.21.15.77:0/1084367526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43000b5b00 0x7f43001f5a90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.270+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 >> 172.21.15.77:0/1084367526 conn(0x7f430006c5d0 msgr2=0x7f430015f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.271+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 shutdown_connections 2024-05-15T12:10:17.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.271+0000 7f430603f640 1 -- 172.21.15.77:0/1084367526 wait complete. 2024-05-15T12:10:17.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-15T12:10:17.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.393+0000 7f42caff7640 1 Processor -- start 2024-05-15T12:10:17.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.393+0000 7f42caff7640 1 -- start start 2024-05-15T12:10:17.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42caff7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4155df0 0x7f42c40cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42caff7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f42c40721e0 0x7f42c415f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42caff7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42c415f730 0x7f42c415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42caff7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f42c415fba0 con 0x7f42c415f730 2024-05-15T12:10:17.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42caff7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f42c40cd6e0 con 0x7f42c40721e0 2024-05-15T12:10:17.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42caff7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f42c40731f0 con 0x7f42c4155df0 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42c415f730 0x7f42c415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f42c415f730 0x7f42c415bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51034/0 (socket says 172.21.15.77:51034) 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 -- 172.21.15.77:0/3002130260 learned_addr learned my addr 172.21.15.77:0/3002130260 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c8d93640 1 --2- 172.21.15.77:0/3002130260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4155df0 0x7f42c40cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 -- 172.21.15.77:0/3002130260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4155df0 msgr2=0x7f42c40cd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c3fff640 1 --2- 172.21.15.77:0/3002130260 >> v2:172.21.15.83:3300/0 conn(0x7f42c40721e0 0x7f42c415f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 --2- 172.21.15.77:0/3002130260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4155df0 0x7f42c40cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 -- 172.21.15.77:0/3002130260 >> v2:172.21.15.83:3300/0 conn(0x7f42c40721e0 msgr2=0x7f42c415f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 --2- 172.21.15.77:0/3002130260 >> v2:172.21.15.83:3300/0 conn(0x7f42c40721e0 0x7f42c415f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.394+0000 7f42c9594640 1 -- 172.21.15.77:0/3002130260 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c4072670 con 0x7f42c415f730 2024-05-15T12:10:17.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.395+0000 7f42c9594640 1 --2- 172.21.15.77:0/3002130260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c415bc00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f42c4071ed0 tx=0x7f42bc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d660c741812d05 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:17.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.395+0000 7f42c37fe640 1 -- 172.21.15.77:0/3002130260 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc036070 con 0x7f42c415f730 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.395+0000 7f42c37fe640 1 -- 172.21.15.77:0/3002130260 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42bc031600 con 0x7f42c415f730 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.395+0000 7f42c37fe640 1 -- 172.21.15.77:0/3002130260 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0319d0 con 0x7f42c415f730 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 -- 172.21.15.77:0/3002130260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 msgr2=0x7f42c415bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 --2- 172.21.15.77:0/3002130260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c415bc00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f42c4071ed0 tx=0x7f42bc02a6a0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 -- 172.21.15.77:0/3002130260 shutdown_connections 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 --2- 172.21.15.77:0/3002130260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c415bc00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 --2- 172.21.15.77:0/3002130260 >> v2:172.21.15.83:3300/0 conn(0x7f42c40721e0 0x7f42c415f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 --2- 172.21.15.77:0/3002130260 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4155df0 0x7f42c40cd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 -- 172.21.15.77:0/3002130260 >> 172.21.15.77:0/3002130260 conn(0x7f42c40b2c20 msgr2=0x7f42c40b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 -- 172.21.15.77:0/3002130260 shutdown_connections 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.396+0000 7f42caff7640 1 -- 172.21.15.77:0/3002130260 wait complete. 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.397+0000 7f42caff7640 1 Processor -- start 2024-05-15T12:10:17.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.397+0000 7f42caff7640 1 -- start start 2024-05-15T12:10:17.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42caff7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42c4155df0 0x7f42c4148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42caff7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c4167f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42caff7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4166d30 0x7f42c41fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42caff7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4072f10 con 0x7f42c415f730 2024-05-15T12:10:17.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42caff7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4072c30 con 0x7f42c4155df0 2024-05-15T12:10:17.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42caff7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f42c415fff0 con 0x7f42c4166d30 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c4167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c4167f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51046/0 (socket says 172.21.15.77:51046) 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 -- 172.21.15.77:0/192246216 learned_addr learned my addr 172.21.15.77:0/192246216 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c9594640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4166d30 0x7f42c41fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c8d93640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42c4155df0 0x7f42c4148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 -- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4166d30 msgr2=0x7f42c41fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4166d30 0x7f42c41fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 -- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42c4155df0 msgr2=0x7f42c4148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42c4155df0 0x7f42c4148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 -- 172.21.15.77:0/192246216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c4153830 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c3fff640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c4167f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c820 tx=0x7f42b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.398+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0015070 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.399+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b0004220 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.399+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c41551c0 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.399+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b000ce10 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.399+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c41671e0 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.400+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c40ce8c0 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.400+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f42b0007830 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.401+0000 7f42c17fa640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42a8076300 0x7f42a80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.401+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f42b0097380 con 0x7f42c415f730 2024-05-15T12:10:17.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.401+0000 7f42c8d93640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42a8076300 0x7f42a80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:17.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.401+0000 7f42c8d93640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42a8076300 0x7f42a80787c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42b800aac0 tx=0x7f42b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:17.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.405+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f42c40ce8c0 con 0x7f42c415f730 2024-05-15T12:10:17.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:17.589+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42c406a640 con 0x7f42c415f730 2024-05-15T12:10:18.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.269+0000 7f42c17fa640 1 -- 172.21.15.77:0/192246216 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f42b00605a0 con 0x7f42c415f730 2024-05-15T12:10:18.264 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42a8076300 msgr2=0x7f42a80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42a8076300 0x7f42a80787c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f42b800aac0 tx=0x7f42b8008040 comp rx=0 tx=0).stop 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 msgr2=0x7f42c4167f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c4167f40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f42b000c820 tx=0x7f42b000cce0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 shutdown_connections 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42a8076300 0x7f42a80787c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f42c4166d30 0x7f42c41fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f42c415f730 0x7f42c4167f40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 --2- 172.21.15.77:0/192246216 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f42c4155df0 0x7f42c4148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 >> 172.21.15.77:0/192246216 conn(0x7f42c40b2c20 msgr2=0x7f42c40d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 shutdown_connections 2024-05-15T12:10:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.271+0000 7f42caff7640 1 -- 172.21.15.77:0/192246216 wait complete. 2024-05-15T12:10:18.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-15T12:10:18.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.391+0000 7ff858ea7640 1 Processor -- start 2024-05-15T12:10:18.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.391+0000 7ff858ea7640 1 -- start start 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff858ea7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 0x7ff8540b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff858ea7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8540cf910 con 0x7ff8540d09b0 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff858ea7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8540cfbf0 con 0x7ff8540cdff0 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff858ea7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540cfed0 con 0x7ff854145930 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff84bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff8540d09b0 0x7ff8540cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58432/0 (socket says 172.21.15.77:58432) 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff84bfff640 1 -- 172.21.15.77:0/3789768284 learned_addr learned my addr 172.21.15.77:0/3789768284 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1397572188 0 0) 0x7ff8540cf910 con 0x7ff8540d09b0 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff85259c640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 0x7ff8540b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.392+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff840003520 con 0x7ff8540d09b0 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3233428470 0 0) 0x7ff840003520 con 0x7ff8540d09b0 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 msgr2=0x7ff8540b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:18.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 0x7ff8540b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 >> v1:172.21.15.83:6789/0 conn(0x7ff8540cdff0 legacy=0x7ff8540721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8540d01b0 con 0x7ff8540d09b0 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7ff83c0016f0 con 0x7ff8540d09b0 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 >> v1:172.21.15.77:6789/0 conn(0x7ff8540d09b0 legacy=0x7ff8540cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff840003a30 0x7ff840003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840004800 0x7ff840004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 0x7ff840005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540cfed0 con 0x7ff840003a30 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff84000bb80 con 0x7ff840004800 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff84000bd80 con 0x7ff854145930 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff85259c640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff840003a30 0x7ff840003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff852d9d640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 0x7ff840005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff84bfff640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840004800 0x7ff840004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff85259c640 1 -- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 msgr2=0x7ff840005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff85259c640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854145930 0x7ff840005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff85259c640 1 -- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840004800 msgr2=0x7ff840004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff85259c640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840004800 0x7ff840004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.393+0000 7ff85259c640 1 -- 172.21.15.77:0/3789768284 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff840003520 con 0x7ff840003a30 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.394+0000 7ff85259c640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff840003a30 0x7ff840003e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff844009650 tx=0x7ff840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4188cd6672a7db4d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.394+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844038070 con 0x7ff840003a30 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.394+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff844033400 con 0x7ff840003a30 2024-05-15T12:10:18.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.394+0000 7ff851d9b640 1 -- 172.21.15.77:0/3789768284 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844009690 con 0x7ff840003a30 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff858ea7640 1 -- 172.21.15.77:0/3789768284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff840003a30 msgr2=0x7ff840003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff858ea7640 1 --2- 172.21.15.77:0/3789768284 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff840003a30 0x7ff840003e50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff844009650 tx=0x7ff840005830 comp rx=0 tx=0).stop 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff852d9d640 1 -- 172.21.15.77:0/3789768284 reap_dead start 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff858ea7640 1 -- 172.21.15.77:0/3789768284 shutdown_connections 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff858ea7640 1 -- 172.21.15.77:0/3789768284 >> 172.21.15.77:0/3789768284 conn(0x7ff8540b2c20 msgr2=0x7ff8540b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff858ea7640 1 -- 172.21.15.77:0/3789768284 shutdown_connections 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.395+0000 7ff858ea7640 1 -- 172.21.15.77:0/3789768284 wait complete. 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.396+0000 7ff858ea7640 1 Processor -- start 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.396+0000 7ff858ea7640 1 -- start start 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff858ea7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840003a30 0x7ff85415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff858ea7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854139560 0x7ff8541600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff858ea7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 0x7ff8541605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff858ea7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff85406fe40 con 0x7ff85415e6c0 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff858ea7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff85406fcc0 con 0x7ff840003a30 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff858ea7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff85406ffc0 con 0x7ff854139560 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 0x7ff8541605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 0x7ff8541605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51066/0 (socket says 172.21.15.77:51066) 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 -- 172.21.15.77:0/20448821 learned_addr learned my addr 172.21.15.77:0/20448821 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff85259c640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840003a30 0x7ff85415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff84bfff640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854139560 0x7ff8541600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 -- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854139560 msgr2=0x7ff8541600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854139560 0x7ff8541600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 -- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840003a30 msgr2=0x7ff85415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840003a30 0x7ff85415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:18.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.397+0000 7ff852d9d640 1 -- 172.21.15.77:0/20448821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85415c9e0 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.398+0000 7ff852d9d640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 0x7ff8541605f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff854070650 tx=0x7ff84c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.398+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c019070 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.398+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff84c006d60 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.398+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c003bb0 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.398+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85415df80 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.398+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85415cee0 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.399+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff85406a640 con 0x7ff85415e6c0 2024-05-15T12:10:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.399+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff84c005030 con 0x7ff85415e6c0 2024-05-15T12:10:18.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.400+0000 7ff84affd640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8340762d0 0x7ff834078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:18.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.400+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7ff84c096560 con 0x7ff85415e6c0 2024-05-15T12:10:18.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.400+0000 7ff85259c640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8340762d0 0x7ff834078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:18.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.401+0000 7ff85259c640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8340762d0 0x7ff834078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff844035000 tx=0x7ff844010040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:18.399 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.404+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff84c05f9d0 con 0x7ff85415e6c0 2024-05-15T12:10:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:18.589+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8540b3770 con 0x7ff85415e6c0 2024-05-15T12:10:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.278+0000 7ff84affd640 1 -- 172.21.15.77:0/20448821 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7ff84c063cd0 con 0x7ff85415e6c0 2024-05-15T12:10:19.273 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2024-05-15T12:10:19.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.283+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8340762d0 msgr2=0x7ff834078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.283+0000 7ff858ea7640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8340762d0 0x7ff834078790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff844035000 tx=0x7ff844010040 comp rx=0 tx=0).stop 2024-05-15T12:10:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.283+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 msgr2=0x7ff8541605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.283+0000 7ff858ea7640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 0x7ff8541605f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff854070650 tx=0x7ff84c00fc90 comp rx=0 tx=0).stop 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 shutdown_connections 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff8340762d0 0x7ff834078790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff854139560 0x7ff8541600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff85415e6c0 0x7ff8541605f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 --2- 172.21.15.77:0/20448821 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff840003a30 0x7ff85415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 >> 172.21.15.77:0/20448821 conn(0x7ff8540b2c20 msgr2=0x7ff8540b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 shutdown_connections 2024-05-15T12:10:19.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.284+0000 7ff858ea7640 1 -- 172.21.15.77:0/20448821 wait complete. 2024-05-15T12:10:19.292 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-15T12:10:19.293 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-15T12:10:19.293 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-15T12:10:19.293 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:19.293 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-15T12:10:19.293 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-15T12:10:19.293 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-15T12:10:19.294 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:19.294 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-15T12:10:19.294 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-15T12:10:19.294 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-15T12:10:19.294 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:19.294 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-15T12:10:19.294 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-15T12:10:19.294 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-15T12:10:19.295 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T12:10:19.303 INFO:tasks.ceph.mds.a:Stopped 2024-05-15T12:10:19.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-15T12:10:19.303 INFO:tasks.ceph.mds.c:Stopped 2024-05-15T12:10:19.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-15T12:10:19.305 INFO:tasks.ceph.mds.d:Stopped 2024-05-15T12:10:19.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-15T12:10:19.306 INFO:tasks.ceph.mds.b:Stopped 2024-05-15T12:10:19.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-15T12:10:19.346 INFO:tasks.ceph.mds.a:Started 2024-05-15T12:10:19.346 DEBUG:teuthology.parallel:result is None 2024-05-15T12:10:19.347 INFO:tasks.ceph.mds.c:Started 2024-05-15T12:10:19.347 DEBUG:teuthology.parallel:result is None 2024-05-15T12:10:19.349 INFO:tasks.ceph.mds.d:Started 2024-05-15T12:10:19.349 DEBUG:teuthology.parallel:result is None 2024-05-15T12:10:19.350 INFO:tasks.ceph.mds.b:Started 2024-05-15T12:10:19.350 DEBUG:teuthology.parallel:result is None 2024-05-15T12:10:19.350 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-15T12:10:19.422 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2024-05-15T12:10:19.422 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-05-15T12:10:19.432 INFO:tasks.ceph.mds.d.smithi083.stdout:starting mds.d at 2024-05-15T12:10:19.433 INFO:tasks.ceph.mds.b.smithi083.stdout:starting mds.b at 2024-05-15T12:10:19.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.461+0000 7fd7bca72640 1 Processor -- start 2024-05-15T12:10:19.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.461+0000 7fd7bca72640 1 -- start start 2024-05-15T12:10:19.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.462+0000 7fd7bca72640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 0x7fd7b80d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.462+0000 7fd7bca72640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b80d0960 con 0x7fd7b80d3d60 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.462+0000 7fd7bca72640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b80d0bf0 con 0x7fd7b80d04d0 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.462+0000 7fd7bca72640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b80d41c0 con 0x7fd7b815f780 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.462+0000 7fd7b5d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd7b80d3d60 0x7fd7b80cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58444/0 (socket says 172.21.15.77:58444) 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.462+0000 7fd7b5d9b640 1 -- 172.21.15.77:0/4056988271 learned_addr learned my addr 172.21.15.77:0/4056988271 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 0x7fd7b80d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773751538 0 0) 0x7fd7b80d0960 con 0x7fd7b80d3d60 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7a4003520 con 0x7fd7b80d3d60 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296612519 0 0) 0x7fd7b80d0bf0 con 0x7fd7b80d04d0 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7b80d0960 con 0x7fd7b80d04d0 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3830511823 0 0) 0x7fd7a4003520 con 0x7fd7b80d3d60 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 msgr2=0x7fd7b80d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:19.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 0x7fd7b80d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 >> v1:172.21.15.83:6789/0 conn(0x7fd7b80d04d0 legacy=0x7fd7b80b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b80d0ed0 con 0x7fd7b80d3d60 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fd7a0001670 con 0x7fd7b80d3d60 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 >> v1:172.21.15.77:6789/0 conn(0x7fd7b80d3d60 legacy=0x7fd7b80cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7a4003c60 0x7fd7a4004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4004800 0x7fd7a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 0x7fd7a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a40054e0 con 0x7fd7a4003c60 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4005690 con 0x7fd7a4004800 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd7a400bf80 con 0x7fd7b815f780 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7a4003c60 0x7fd7a4004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b5d9b640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4004800 0x7fd7a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b6d9d640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 0x7fd7a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 -- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 msgr2=0x7fd7a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:19.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815f780 0x7fd7a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 -- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4004800 msgr2=0x7fd7a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4004800 0x7fd7a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.463+0000 7fd7b659c640 1 -- 172.21.15.77:0/4056988271 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7a4003520 con 0x7fd7a4003c60 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.464+0000 7fd7b659c640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7a4003c60 0x7fd7a4004060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009fc0 tx=0x7fd7a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791302aa39ddc939 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.464+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0009c10 con 0x7fd7a4003c60 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.464+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7b0036070 con 0x7fd7a4003c60 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.464+0000 7fd7b559a640 1 -- 172.21.15.77:0/4056988271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0031880 con 0x7fd7a4003c60 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7bca72640 1 -- 172.21.15.77:0/4056988271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7a4003c60 msgr2=0x7fd7a4004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7bca72640 1 --2- 172.21.15.77:0/4056988271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7a4003c60 0x7fd7a4004060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009fc0 tx=0x7fd7a4005830 comp rx=0 tx=0).stop 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7b6d9d640 1 -- 172.21.15.77:0/4056988271 reap_dead start 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7bca72640 1 -- 172.21.15.77:0/4056988271 shutdown_connections 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7bca72640 1 -- 172.21.15.77:0/4056988271 >> 172.21.15.77:0/4056988271 conn(0x7fd7b809e510 msgr2=0x7fd7b80d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7bca72640 1 -- 172.21.15.77:0/4056988271 shutdown_connections 2024-05-15T12:10:19.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.465+0000 7fd7bca72640 1 -- 172.21.15.77:0/4056988271 wait complete. 2024-05-15T12:10:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.466+0000 7fd7bca72640 1 Processor -- start 2024-05-15T12:10:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.466+0000 7fd7bca72640 1 -- start start 2024-05-15T12:10:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7bca72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4003c60 0x7fd7b81f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7bca72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 0x7fd7b80b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7bca72640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815fbd0 0x7fd7b8160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7bca72640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b80b4f80 con 0x7fd7b80b2e50 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7bca72640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b80d11b0 con 0x7fd7a4003c60 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7bca72640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b80d3820 con 0x7fd7b815fbd0 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 0x7fd7b80b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 0x7fd7b80b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51116/0 (socket says 172.21.15.77:51116) 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 -- 172.21.15.77:0/3929824473 learned_addr learned my addr 172.21.15.77:0/3929824473 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b659c640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4003c60 0x7fd7b81f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b6d9d640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815fbd0 0x7fd7b8160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 -- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815fbd0 msgr2=0x7fd7b8160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815fbd0 0x7fd7b8160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 -- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4003c60 msgr2=0x7fd7b81f81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4003c60 0x7fd7b81f81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b5d9b640 1 -- 172.21.15.77:0/3929824473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b8160920 con 0x7fd7b80b2e50 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b659c640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4003c60 0x7fd7b81f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:19.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.467+0000 7fd7b6d9d640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815fbd0 0x7fd7b8160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.468+0000 7fd7b5d9b640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 0x7fd7b80b32b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0000fb0 tx=0x7fd7a0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.468+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a001a070 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.468+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a000f750 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.468+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b814cac0 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.468+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000fb00 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.468+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b814d080 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.469+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b80768e0 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.469+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd7a001d070 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.470+0000 7fd7aeffd640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd798076300 0x7fd7980787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.470+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7fd7a0096b70 con 0x7fd7b80b2e50 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.470+0000 7fd7b659c640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd798076300 0x7fd7980787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:19.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.471+0000 7fd7b659c640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd798076300 0x7fd7980787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0035000 tx=0x7fd7b002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:19.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.474+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd7a00607d0 con 0x7fd7b80b2e50 2024-05-15T12:10:19.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:19.665+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd7b80d3600 con 0x7fd7b80b2e50 2024-05-15T12:10:20.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.286+0000 7fd7aeffd640 1 -- 172.21.15.77:0/3929824473 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7fd7a00600d0 con 0x7fd7b80b2e50 2024-05-15T12:10:20.281 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2024-05-15T12:10:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.289+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd798076300 msgr2=0x7fd7980787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd798076300 0x7fd7980787c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0035000 tx=0x7fd7b002f000 comp rx=0 tx=0).stop 2024-05-15T12:10:20.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 msgr2=0x7fd7b80b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 0x7fd7b80b32b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0000fb0 tx=0x7fd7a0007430 comp rx=0 tx=0).stop 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 shutdown_connections 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd798076300 0x7fd7980787c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd7b815fbd0 0x7fd7b8160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7b80b2e50 0x7fd7b80b32b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 --2- 172.21.15.77:0/3929824473 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd7a4003c60 0x7fd7b81f81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 >> 172.21.15.77:0/3929824473 conn(0x7fd7b809e510 msgr2=0x7fd7b80b53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 shutdown_connections 2024-05-15T12:10:20.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.290+0000 7fd7bca72640 1 -- 172.21.15.77:0/3929824473 wait complete. 2024-05-15T12:10:20.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-15T12:10:20.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.403+0000 7f114a420640 1 Processor -- start 2024-05-15T12:10:20.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.403+0000 7f114a420640 1 -- start start 2024-05-15T12:10:20.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.404+0000 7f114a420640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f114416a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.404+0000 7f114a420640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114406fea0 con 0x7f11441603a0 2024-05-15T12:10:20.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.404+0000 7f114a420640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114406ee60 con 0x7f11440b0e30 2024-05-15T12:10:20.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.404+0000 7f114a420640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1144160800 con 0x7f1144168290 2024-05-15T12:10:20.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.404+0000 7f113bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f11441603a0 0x7f114406f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58452/0 (socket says 172.21.15.77:58452) 2024-05-15T12:10:20.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.404+0000 7f113bfff640 1 -- 172.21.15.77:0/3356277137 learned_addr learned my addr 172.21.15.77:0/3356277137 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11489bd640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f114416a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873877473 0 0) 0x7f114406fea0 con 0x7f11441603a0 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1130003520 con 0x7f11441603a0 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812331467 0 0) 0x7f114406ee60 con 0x7f11440b0e30 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f114406fea0 con 0x7f11440b0e30 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1430351470 0 0) 0x7f1130003520 con 0x7f11441603a0 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 msgr2=0x7f114416a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f114416a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 >> v1:172.21.15.83:6789/0 conn(0x7f11440b0e30 legacy=0x7f114406f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11440b4aa0 con 0x7f11441603a0 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f112c0016f0 con 0x7f11441603a0 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11489bd640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f114416a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 >> v1:172.21.15.77:6789/0 conn(0x7f11441603a0 legacy=0x7f114406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1130003cd0 0x7f11300040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130004850 0x7f1130004cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f113000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11300055e0 con 0x7f1130003cd0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f113000bf00 con 0x7f1130004850 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f113000c080 con 0x7f1144168290 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f1143fff640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1130003cd0 0x7f11300040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f113bfff640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130004850 0x7f1130004cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f11489bd640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f113000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f1143fff640 1 -- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 msgr2=0x7f113000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f1143fff640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1144168290 0x7f113000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f1143fff640 1 -- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130004850 msgr2=0x7f1130004cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.405+0000 7f1143fff640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130004850 0x7f1130004cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.406+0000 7f1143fff640 1 -- 172.21.15.77:0/3356277137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1130003520 con 0x7f1130003cd0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.406+0000 7f1143fff640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1130003cd0 0x7f11300040d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f11340018a0 tx=0x7f1130005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5b7848caff8676 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.406+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11340014c0 con 0x7f1130003cd0 2024-05-15T12:10:20.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.406+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f113402acf0 con 0x7f1130003cd0 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.406+0000 7f11437fe640 1 -- 172.21.15.77:0/3356277137 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1134005310 con 0x7f1130003cd0 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f114a420640 1 -- 172.21.15.77:0/3356277137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1130003cd0 msgr2=0x7f11300040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f114a420640 1 --2- 172.21.15.77:0/3356277137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1130003cd0 0x7f11300040d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f11340018a0 tx=0x7f1130005830 comp rx=0 tx=0).stop 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f11489bd640 1 -- 172.21.15.77:0/3356277137 reap_dead start 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f114a420640 1 -- 172.21.15.77:0/3356277137 shutdown_connections 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f114a420640 1 -- 172.21.15.77:0/3356277137 >> 172.21.15.77:0/3356277137 conn(0x7f11440d1dd0 msgr2=0x7f11440b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f114a420640 1 -- 172.21.15.77:0/3356277137 shutdown_connections 2024-05-15T12:10:20.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.407+0000 7f114a420640 1 -- 172.21.15.77:0/3356277137 wait complete. 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.408+0000 7f114a420640 1 Processor -- start 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.408+0000 7f114a420640 1 -- start start 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f114a420640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130003cd0 0x7f11441518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f114a420640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 0x7f11440aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f114a420640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11440cded0 0x7f11440ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f114a420640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11440b53d0 con 0x7f1144154be0 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f114a420640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f11440b4850 con 0x7f1130003cd0 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f114a420640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f11440b5060 con 0x7f11440cded0 2024-05-15T12:10:20.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 0x7f11440aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 0x7f11440aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51140/0 (socket says 172.21.15.77:51140) 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 -- 172.21.15.77:0/1933238162 learned_addr learned my addr 172.21.15.77:0/1933238162 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f1143fff640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130003cd0 0x7f11441518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f11489bd640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11440cded0 0x7f11440ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 -- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11440cded0 msgr2=0x7f11440ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11440cded0 0x7f11440ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 -- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130003cd0 msgr2=0x7f11441518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130003cd0 0x7f11441518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 -- 172.21.15.77:0/1933238162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114414fa10 con 0x7f1144154be0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f11489bd640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11440cded0 0x7f11440ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.409+0000 7f113bfff640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 0x7f11440aeb10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f112c004ef0 tx=0x7f112c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.410+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c00f7b0 con 0x7f1144154be0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.410+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f112c018070 con 0x7f1144154be0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.410+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112c00fb50 con 0x7f1144154be0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.410+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114414fcb0 con 0x7f1144154be0 2024-05-15T12:10:20.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.410+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11441531e0 con 0x7f1144154be0 2024-05-15T12:10:20.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.411+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114406a640 con 0x7f1144154be0 2024-05-15T12:10:20.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.411+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f112c00fcf0 con 0x7f1144154be0 2024-05-15T12:10:20.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.412+0000 7f11417fa640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11240762d0 0x7f1124078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.412+0000 7f1143fff640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11240762d0 0x7f1124078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.412+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f112c0970a0 con 0x7f1144154be0 2024-05-15T12:10:20.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.412+0000 7f1143fff640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11240762d0 0x7f1124078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1134031000 tx=0x7f1134036040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:20.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.417+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f112c060d50 con 0x7f1144154be0 2024-05-15T12:10:20.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.667+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f11440cdc60 con 0x7f1144154be0 2024-05-15T12:10:20.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.667+0000 7f11417fa640 1 -- 172.21.15.77:0/1933238162 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f112c060650 con 0x7f1144154be0 2024-05-15T12:10:20.662 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T12:10:20.662 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2024-05-15T12:10:20.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmPQWfGBAAHSoWA6UXefSjVeas6BpRlQ==", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmRLjdJBAA2fzt9Z8l066728ZHrXWA0A==", 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.663 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURm71exHxAAfmsDUiC+f5gctJQhvYpH7Q==", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmhmUpLBAAZvmSvkRacIMJ/1cAlKbsOA==", 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDSpURmU87XCxAAk7dypTDoAL4sTsDM7EZFMg==", 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDVpURmesM9CxAACPShZdNm7pYxsLx95/uJ1A==", 2024-05-15T12:10:20.666 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDYpURmWc6uCRAAPxJixhd4YDWrS29JTGhmJg==", 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDbpURmqv1oBxAAQmkHFkdd8oZ6v1VHqOyMoQ==", 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDhpURm7qaeCxAA8H5STPDYUWloZ0tAVjW4Gg==", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDkpURmvST8CRAAm007+uyr69XNOPSLJVmPyw==", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.669 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDnpURmjO4BCRAAknmlO6FeYzkuNd/BG2kuPw==", 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.670 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDqpURm4Q2cBxAAfLgYSw6SymfSLB5oOL0WUw==", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmdXQ6MBAAk41w2IfO9gjcJKGZ1RHHGw==", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2024-05-15T12:10:20.671 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURm4YD3OBAAgy0xc2R1JVhjP10MHnCC3Q==", 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmd4TJNRAAOsMdxg2YpGWm5MQKi5S33A==", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDPpURmGOPoAhAAeKJT2McM5wGpHs3DdWsf4w==", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2024-05-15T12:10:20.673 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDNpURmt205NxAANzOI5QpeQabOt5CM1+83vQ==", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mds", 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDvpURmvyzDNxAADdtB14nOgR08tBsXN9vkJA==", 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mds" 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mgr", 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDvpURmDDXDNxAAUV1PgwBS3PvmtSdRmTdsJA==", 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-osd", 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDvpURmkjvDNxAAZQD0YyBGiv+g2KtjdD+rxA==", 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-osd" 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd", 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDvpURm/UHDNxAAenhM7px2wAHIvDu88c3mXg==", 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDvpURmA0rDNxAAjJ0eSkkD1tP927BB7jAIVg==", 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rgw", 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDvpURmz1DDNxAA2WyFm1tdXYpFVJh6xbJDrQ==", 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmAqZiFRAA4et0Z7YLaaT11fP5+vdY/Q==", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDOpURmZUbBEBAAz0B5Um5iI/QibgapEVk2pQ==", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2024-05-15T12:10:20.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2024-05-15T12:10:20.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:20.679 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-05-15T12:10:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T12:10:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11240762d0 msgr2=0x7f1124078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11240762d0 0x7f1124078790 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1134031000 tx=0x7f1134036040 comp rx=0 tx=0).stop 2024-05-15T12:10:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 msgr2=0x7f11440aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 0x7f11440aeb10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f112c004ef0 tx=0x7f112c007430 comp rx=0 tx=0).stop 2024-05-15T12:10:20.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 shutdown_connections 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11240762d0 0x7f1124078790 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f11440cded0 0x7f11440ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1144154be0 0x7f11440aeb10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 --2- 172.21.15.77:0/1933238162 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1130003cd0 0x7f11441518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.669+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 >> 172.21.15.77:0/1933238162 conn(0x7f11440d1dd0 msgr2=0x7f114406f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.670+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 shutdown_connections 2024-05-15T12:10:20.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.670+0000 7f114a420640 1 -- 172.21.15.77:0/1933238162 wait complete. 2024-05-15T12:10:20.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-15T12:10:20.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.787+0000 7f336341c640 1 Processor -- start 2024-05-15T12:10:20.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.787+0000 7f336341c640 1 -- start start 2024-05-15T12:10:20.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f336341c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c06c3f0 0x7f335c06c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f336341c640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f335c070a50 0x7f335c070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f336341c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f335c0cebc0 con 0x7f335c146a90 2024-05-15T12:10:20.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f336341c640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f335c06cd70 con 0x7f335c070a50 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f336341c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f335c0ceea0 con 0x7f335c06c3f0 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f33611b8640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f335c146a90 0x7f335c06fe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58462/0 (socket says 172.21.15.77:58462) 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f33611b8640 1 -- 172.21.15.77:0/1389656804 learned_addr learned my addr 172.21.15.77:0/1389656804 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f33609b7640 1 --2- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c06c3f0 0x7f335c06c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f33619b9640 1 --2- 172.21.15.77:0/1389656804 >> v2:172.21.15.83:3300/0 conn(0x7f335c070a50 0x7f335c070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f3353fff640 1 -- 172.21.15.77:0/1389656804 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725258346 0 0) 0x7f335c0cebc0 con 0x7f335c146a90 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.788+0000 7f3353fff640 1 -- 172.21.15.77:0/1389656804 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3348003520 con 0x7f335c146a90 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.789+0000 7f33619b9640 1 -- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c06c3f0 msgr2=0x7f335c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.789+0000 7f33619b9640 1 --2- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c06c3f0 0x7f335c06c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.789+0000 7f33619b9640 1 -- 172.21.15.77:0/1389656804 >> v1:172.21.15.77:6789/0 conn(0x7f335c146a90 legacy=0x7f335c06fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.789+0000 7f3353fff640 1 -- 172.21.15.77:0/1389656804 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4242815575 0 0) 0x7f3348003520 con 0x7f335c146a90 2024-05-15T12:10:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.789+0000 7f33619b9640 1 -- 172.21.15.77:0/1389656804 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c0cf180 con 0x7f335c070a50 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.789+0000 7f33619b9640 1 --2- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c070a50 0x7f335c070e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce451300f8d63f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f3353fff640 1 -- 172.21.15.77:0/1389656804 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33580016f0 con 0x7f335c070a50 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f3353fff640 1 -- 172.21.15.77:0/1389656804 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354007540 con 0x7f335c070a50 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f3353fff640 1 -- 172.21.15.77:0/1389656804 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33540078f0 con 0x7f335c070a50 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 -- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c070a50 msgr2=0x7f335c070e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 --2- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c070a50 0x7f335c070e90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335402a5f0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 -- 172.21.15.77:0/1389656804 shutdown_connections 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 --2- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c070a50 0x7f335c070e90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 --2- 172.21.15.77:0/1389656804 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c06c3f0 0x7f335c06c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 -- 172.21.15.77:0/1389656804 >> 172.21.15.77:0/1389656804 conn(0x7f335c06f2e0 msgr2=0x7f335c06f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:20.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 -- 172.21.15.77:0/1389656804 shutdown_connections 2024-05-15T12:10:20.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.790+0000 7f336341c640 1 -- 172.21.15.77:0/1389656804 wait complete. 2024-05-15T12:10:20.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.791+0000 7f336341c640 1 Processor -- start 2024-05-15T12:10:20.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.791+0000 7f336341c640 1 -- start start 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f336341c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 0x7f335c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f336341c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c070a50 0x7f335c0cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f336341c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c146a90 0x7f335c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f336341c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f335c146e70 con 0x7f335c06c3f0 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f336341c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f335c0cf740 con 0x7f335c146a90 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f336341c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f335c146ff0 con 0x7f335c070a50 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f33611b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 0x7f335c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f33611b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 0x7f335c0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51154/0 (socket says 172.21.15.77:51154) 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.792+0000 7f33611b8640 1 -- 172.21.15.77:0/1274119683 learned_addr learned my addr 172.21.15.77:0/1274119683 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f33611b8640 1 -- 172.21.15.77:0/1274119683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c070a50 msgr2=0x7f335c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f33611b8640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c070a50 0x7f335c0cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f33611b8640 1 -- 172.21.15.77:0/1274119683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c146a90 msgr2=0x7f335c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f33611b8640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c146a90 0x7f335c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f33611b8640 1 -- 172.21.15.77:0/1274119683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c15ba40 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f33611b8640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 0x7f335c0b5110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f335800c490 tx=0x7f335800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358005ce0 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3358007070 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c0b57a0 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358007460 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.793+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c0b5d60 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.794+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335c074570 con 0x7f335c06c3f0 2024-05-15T12:10:20.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.794+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3358007600 con 0x7f335c06c3f0 2024-05-15T12:10:20.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.795+0000 7f3351ffb640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f33400762d0 0x7f3340078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:20.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.795+0000 7f33609b7640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f33400762d0 0x7f3340078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:20.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.795+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f3358096ef0 con 0x7f335c06c3f0 2024-05-15T12:10:20.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.796+0000 7f33609b7640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f33400762d0 0x7f3340078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f334c006a90 tx=0x7f334c006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:20.800+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f335c074570 con 0x7f335c06c3f0 2024-05-15T12:10:21.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.051+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f335c143e20 con 0x7f335c06c3f0 2024-05-15T12:10:21.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.053+0000 7f3351ffb640 1 -- 172.21.15.77:0/1274119683 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f335c143e20 con 0x7f335c06c3f0 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f33400762d0 msgr2=0x7f3340078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f33400762d0 0x7f3340078790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f334c006a90 tx=0x7f334c006a20 comp rx=0 tx=0).stop 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 msgr2=0x7f335c0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 0x7f335c0b5110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f335800c490 tx=0x7f335800c950 comp rx=0 tx=0).stop 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 shutdown_connections 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f33400762d0 0x7f3340078790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f335c070a50 0x7f335c0cd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f335c146a90 0x7f335c15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 --2- 172.21.15.77:0/1274119683 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f335c06c3f0 0x7f335c0b5110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 >> 172.21.15.77:0/1274119683 conn(0x7f335c06f2e0 msgr2=0x7f335c15cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 shutdown_connections 2024-05-15T12:10:21.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.056+0000 7f336341c640 1 -- 172.21.15.77:0/1274119683 wait complete. 2024-05-15T12:10:21.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-15T12:10:21.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.168+0000 7f485dd9e640 1 Processor -- start 2024-05-15T12:10:21.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.168+0000 7f485dd9e640 1 -- start start 2024-05-15T12:10:21.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.169+0000 7f485dd9e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f485815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.169+0000 7f485dd9e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485815d060 con 0x7f485815c4f0 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.169+0000 7f485dd9e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485815d340 con 0x7f4858159a30 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.169+0000 7f485dd9e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f48580744c0 con 0x7f485806fc00 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.169+0000 7f4856ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f485815c4f0 0x7f485806f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58470/0 (socket says 172.21.15.77:58470) 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.169+0000 7f4856ffd640 1 -- 172.21.15.77:0/2522352704 learned_addr learned my addr 172.21.15.77:0/2522352704 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f485815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675381167 0 0) 0x7f485815d060 con 0x7f485815c4f0 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4840003520 con 0x7f485815c4f0 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699545672 0 0) 0x7f4840003520 con 0x7f485815c4f0 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 msgr2=0x7f485815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f485815c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 >> v1:172.21.15.83:6789/0 conn(0x7f4858159a30 legacy=0x7f4858073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48580735b0 con 0x7f485815c4f0 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f484c001a70 con 0x7f485815c4f0 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f485815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 >> v1:172.21.15.77:6789/0 conn(0x7f485815c4f0 legacy=0x7f485806f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f48400039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4840003f70 0x7f4840004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48580744c0 con 0x7f4840004d40 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f484000bad0 con 0x7f4840003f70 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f484000bcd0 con 0x7f485806fc00 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f48577fe640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f48400039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4856ffd640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4840003f70 0x7f4840004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 -- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 msgr2=0x7f48400039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f485806fc00 0x7f48400039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 -- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4840003f70 msgr2=0x7f4840004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4840003f70 0x7f4840004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.170+0000 7f4857fff640 1 -- 172.21.15.77:0/2522352704 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4840003520 con 0x7f4840004d40 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.171+0000 7f4857fff640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48400051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4850009c20 tx=0x7f4840005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d445939af85631 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.171+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4850036070 con 0x7f4840004d40 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.171+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4850031400 con 0x7f4840004d40 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.171+0000 7f48567fc640 1 -- 172.21.15.77:0/2522352704 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4850009820 con 0x7f4840004d40 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f485dd9e640 1 -- 172.21.15.77:0/2522352704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 msgr2=0x7f48400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f485dd9e640 1 --2- 172.21.15.77:0/2522352704 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48400051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4850009c20 tx=0x7f4840005830 comp rx=0 tx=0).stop 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f4857fff640 1 -- 172.21.15.77:0/2522352704 reap_dead start 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f485dd9e640 1 -- 172.21.15.77:0/2522352704 shutdown_connections 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f485dd9e640 1 -- 172.21.15.77:0/2522352704 >> 172.21.15.77:0/2522352704 conn(0x7f485806c3f0 msgr2=0x7f485806c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f485dd9e640 1 -- 172.21.15.77:0/2522352704 shutdown_connections 2024-05-15T12:10:21.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.172+0000 7f485dd9e640 1 -- 172.21.15.77:0/2522352704 wait complete. 2024-05-15T12:10:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.173+0000 7f485dd9e640 1 Processor -- start 2024-05-15T12:10:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.173+0000 7f485dd9e640 1 -- start start 2024-05-15T12:10:21.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48581e7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4858143d90 0x7f48580ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48580cd130 0x7f48580ca090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4858159e10 con 0x7f4840004d40 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f48580b5090 con 0x7f48580cd130 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4858159f90 con 0x7f4858143d90 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48581e7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48581e7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51172/0 (socket says 172.21.15.77:51172) 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 -- 172.21.15.77:0/180866738 learned_addr learned my addr 172.21.15.77:0/180866738 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f4857fff640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48580cd130 0x7f48580ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f4856ffd640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4858143d90 0x7f48580ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 -- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4858143d90 msgr2=0x7f48580ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4858143d90 0x7f48580ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 -- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48580cd130 msgr2=0x7f48580ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48580cd130 0x7f48580ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 -- 172.21.15.77:0/180866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48581e83f0 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f4857fff640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48580cd130 0x7f48580ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f4856ffd640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4858143d90 0x7f48580ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f48577fe640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48581e7eb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f484800f810 tx=0x7f484800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48480052e0 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4848016030 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48581e6e10 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.174+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484800d970 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.175+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48581e73d0 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.175+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48580768e0 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.176+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f484800db10 con 0x7f4840004d40 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.176+0000 7f483ffff640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4844076300 0x7f48440787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.177+0000 7f4856ffd640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4844076300 0x7f48440787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.177+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f4848098e20 con 0x7f4840004d40 2024-05-15T12:10:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.177+0000 7f4856ffd640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4844076300 0x7f48440787c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48581f4d40 tx=0x7f484c006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.181+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4848062ad0 con 0x7f4840004d40 2024-05-15T12:10:21.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.435+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f485806d400 con 0x7f4840004d40 2024-05-15T12:10:21.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.437+0000 7f483ffff640 1 -- 172.21.15.77:0/180866738 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f48480623d0 con 0x7f4840004d40 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4844076300 msgr2=0x7f48440787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4844076300 0x7f48440787c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f48581f4d40 tx=0x7f484c006040 comp rx=0 tx=0).stop 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 msgr2=0x7f48581e7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48581e7eb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f484800f810 tx=0x7f484800fcd0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 shutdown_connections 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4844076300 0x7f48440787c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4858143d90 0x7f48580ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f48580cd130 0x7f48580ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 --2- 172.21.15.77:0/180866738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4840004d40 0x7f48581e7eb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 >> 172.21.15.77:0/180866738 conn(0x7f485806c3f0 msgr2=0x7f485815bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 shutdown_connections 2024-05-15T12:10:21.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.439+0000 7f485dd9e640 1 -- 172.21.15.77:0/180866738 wait complete. 2024-05-15T12:10:21.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-15T12:10:21.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.550+0000 7f0fd0379640 1 Processor -- start 2024-05-15T12:10:21.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.551+0000 7f0fd0379640 1 -- start start 2024-05-15T12:10:21.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fd0379640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0fc80b64b0 0x7f0fc80d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fd0379640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc80d0bf0 con 0x7f0fc80d3f30 2024-05-15T12:10:21.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fd0379640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc80d0ed0 con 0x7f0fc815f780 2024-05-15T12:10:21.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fd0379640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80d11b0 con 0x7f0fc80b64b0 2024-05-15T12:10:21.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd914640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0fc80d3f30 0x7f0fc80cfdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58480/0 (socket says 172.21.15.77:58480) 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd914640 1 -- 172.21.15.77:0/1889486809 learned_addr learned my addr 172.21.15.77:0/1889486809 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128558794 0 0) 0x7f0fc80d0bf0 con 0x7f0fc80d3f30 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fb4003520 con 0x7f0fc80d3f30 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fce916640 1 --2- 172.21.15.77:0/1889486809 >> v2:172.21.15.83:3300/0 conn(0x7f0fc80b64b0 0x7f0fc80d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2692904066 0 0) 0x7f0fb4003520 con 0x7f0fc80d3f30 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 >> v2:172.21.15.83:3300/0 conn(0x7f0fc80b64b0 msgr2=0x7f0fc80d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 --2- 172.21.15.77:0/1889486809 >> v2:172.21.15.83:3300/0 conn(0x7f0fc80b64b0 0x7f0fc80d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 >> v1:172.21.15.83:6789/0 conn(0x7f0fc815f780 legacy=0x7f0fc80d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80b4ca0 con 0x7f0fc80d3f30 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f0fc40016f0 con 0x7f0fc80d3f30 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 >> v1:172.21.15.77:6789/0 conn(0x7f0fc80d3f30 legacy=0x7f0fc80cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fb4003a50 0x7f0fb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fb4004800 0x7f0fb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d11b0 con 0x7f0fb40053c0 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb400c250 con 0x7f0fb4003a50 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.552+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb400c450 con 0x7f0fb4004800 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce115640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fb4003a50 0x7f0fb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fcd914640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fb4004800 0x7f0fb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 -- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fb4004800 msgr2=0x7f0fb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fb4004800 0x7f0fb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 -- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fb4003a50 msgr2=0x7f0fb4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fb4003a50 0x7f0fb4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 -- 172.21.15.77:0/1889486809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb4003520 con 0x7f0fb40053c0 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 -- 172.21.15.77:0/1889486809 reap_dead start 2024-05-15T12:10:21.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.553+0000 7f0fce916640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fb400b9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007360 tx=0x7f0fb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869681f76c058da4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0009be0 con 0x7f0fb40053c0 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0003bd0 con 0x7f0fb40053c0 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fcd113640 1 -- 172.21.15.77:0/1889486809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0004020 con 0x7f0fb40053c0 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 -- 172.21.15.77:0/1889486809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 msgr2=0x7f0fb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fb400b9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0007360 tx=0x7f0fb4005830 comp rx=0 tx=0).stop 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 -- 172.21.15.77:0/1889486809 shutdown_connections 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 --2- 172.21.15.77:0/1889486809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fb400b9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 -- 172.21.15.77:0/1889486809 >> 172.21.15.77:0/1889486809 conn(0x7f0fc809e510 msgr2=0x7f0fc80d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 -- 172.21.15.77:0/1889486809 shutdown_connections 2024-05-15T12:10:21.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.554+0000 7f0fd0379640 1 -- 172.21.15.77:0/1889486809 wait complete. 2024-05-15T12:10:21.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.555+0000 7f0fd0379640 1 Processor -- start 2024-05-15T12:10:21.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.555+0000 7f0fd0379640 1 -- start start 2024-05-15T12:10:21.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fd0379640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fc80b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fd0379640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fc815fde0 0x7f0fc81f8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fd0379640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fc815ae50 0x7f0fc815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fd0379640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d39a0 con 0x7f0fb40053c0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fd0379640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d3820 con 0x7f0fc815fde0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fd0379640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc80d3b20 con 0x7f0fc815ae50 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fce115640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fc80b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fce115640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fc80b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51196/0 (socket says 172.21.15.77:51196) 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fce115640 1 -- 172.21.15.77:0/3262533827 learned_addr learned my addr 172.21.15.77:0/3262533827 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fcd914640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fc815fde0 0x7f0fc81f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.556+0000 7f0fce916640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fc815ae50 0x7f0fc815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fce115640 1 -- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fc815ae50 msgr2=0x7f0fc815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fce115640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fc815ae50 0x7f0fc815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fce115640 1 -- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fc815fde0 msgr2=0x7f0fc81f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fce115640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fc815fde0 0x7f0fc81f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fce115640 1 -- 172.21.15.77:0/3262533827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80b9950 con 0x7f0fb40053c0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fcd914640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fc815fde0 0x7f0fc81f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fce115640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fc80b80a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00f5f0 tx=0x7f0fbc00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc01a070 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fbc005320 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc8161180 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc007270 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.557+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc8161740 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.558+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc80768e0 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.558+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0fbc01d070 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.559+0000 7f0fbaffd640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0fac076300 0x7f0fac0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.559+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0fbc096970 con 0x7f0fb40053c0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.559+0000 7f0fcd914640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0fac076300 0x7f0fac0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.559+0000 7f0fcd914640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0fac076300 0x7f0fac0787c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806d8f0 tx=0x7f0fc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.563+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0fbc060620 con 0x7f0fb40053c0 2024-05-15T12:10:21.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.814+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f0fc80d3600 con 0x7f0fb40053c0 2024-05-15T12:10:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.816+0000 7f0fbaffd640 1 -- 172.21.15.77:0/3262533827 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f0fbc05ff20 con 0x7f0fb40053c0 2024-05-15T12:10:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0fac076300 msgr2=0x7f0fac0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0fac076300 0x7f0fac0787c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fc806d8f0 tx=0x7f0fc4009040 comp rx=0 tx=0).stop 2024-05-15T12:10:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 msgr2=0x7f0fc80b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fc80b80a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00f5f0 tx=0x7f0fbc00fab0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 shutdown_connections 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0fac076300 0x7f0fac0787c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0fc815ae50 0x7f0fc815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0fc815fde0 0x7f0fc81f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 --2- 172.21.15.77:0/3262533827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0fb40053c0 0x7f0fc80b80a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 >> 172.21.15.77:0/3262533827 conn(0x7f0fc809e510 msgr2=0x7f0fc806e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 shutdown_connections 2024-05-15T12:10:21.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.818+0000 7f0fd0379640 1 -- 172.21.15.77:0/3262533827 wait complete. 2024-05-15T12:10:21.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-15T12:10:21.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.930+0000 7f2496f6a640 1 Processor -- start 2024-05-15T12:10:21.925 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.930+0000 7f2496f6a640 1 -- start start 2024-05-15T12:10:21.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2496f6a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f24900b4f20 0x7f249006f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2496f6a640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24900cdbe0 con 0x7f249015b610 2024-05-15T12:10:21.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2496f6a640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f249006f8e0 con 0x7f249006e3e0 2024-05-15T12:10:21.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2496f6a640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f24900728f0 con 0x7f24900b4f20 2024-05-15T12:10:21.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2494d06640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f249015b610 0x7f24900b4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:58482/0 (socket says 172.21.15.77:58482) 2024-05-15T12:10:21.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2494d06640 1 -- 172.21.15.77:0/419078836 learned_addr learned my addr 172.21.15.77:0/419078836 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f2487fff640 1 --2- 172.21.15.77:0/419078836 >> v2:172.21.15.83:3300/0 conn(0x7f24900b4f20 0x7f249006f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1452035510 0 0) 0x7f248c001490 con 0x7f249015b610 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2478003520 con 0x7f249015b610 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2929291608 0 0) 0x7f2478003520 con 0x7f249015b610 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 >> v2:172.21.15.83:3300/0 conn(0x7f24900b4f20 msgr2=0x7f249006f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 --2- 172.21.15.77:0/419078836 >> v2:172.21.15.83:3300/0 conn(0x7f24900b4f20 0x7f249006f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 >> v1:172.21.15.83:6789/0 conn(0x7f249006e3e0 legacy=0x7f2490073340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249006fbc0 con 0x7f249015b610 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f248c001c40 con 0x7f249015b610 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.931+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 >> v1:172.21.15.77:6789/0 conn(0x7f249015b610 legacy=0x7f24900b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f24877fe640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f2478003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f24877fe640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f24877fe640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24780052e0 0x7f247800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24900728f0 con 0x7f2478003a50 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f247800c1b0 con 0x7f24780052e0 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f247800e5c0 con 0x7f2478004800 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2494d06640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f2478003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2495507640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24780052e0 0x7f247800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2487fff640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2494d06640 1 -- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2478004800 msgr2=0x7f2478004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2494d06640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2494d06640 1 -- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24780052e0 msgr2=0x7f247800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2494d06640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f24780052e0 0x7f247800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2494d06640 1 -- 172.21.15.77:0/419078836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2478003520 con 0x7f2478003a50 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2495507640 1 -- 172.21.15.77:0/419078836 reap_dead start 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.932+0000 7f2487fff640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2478004800 0x7f2478004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2494d06640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f2478003e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f248c0013d0 tx=0x7f2478005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c89fdc21cf95ca server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c00a650 con 0x7f2478003a50 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c02f070 con 0x7f2478003a50 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f24877fe640 1 -- 172.21.15.77:0/419078836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c02bd90 con 0x7f2478003a50 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 -- 172.21.15.77:0/419078836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 msgr2=0x7f2478003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f2478003e70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f248c0013d0 tx=0x7f2478005830 comp rx=0 tx=0).stop 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 -- 172.21.15.77:0/419078836 shutdown_connections 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 --2- 172.21.15.77:0/419078836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f2478003e70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 -- 172.21.15.77:0/419078836 >> 172.21.15.77:0/419078836 conn(0x7f249006c3f0 msgr2=0x7f249006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 -- 172.21.15.77:0/419078836 shutdown_connections 2024-05-15T12:10:21.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.933+0000 7f2496f6a640 1 -- 172.21.15.77:0/419078836 wait complete. 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.934+0000 7f2496f6a640 1 Processor -- start 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 -- start start 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f249014bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f249015e670 0x7f24900af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24900b2c00 0x7f24900b3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f249015b9f0 con 0x7f2478003a50 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2490072e20 con 0x7f249015e670 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2496f6a640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f24900d0590 con 0x7f24900b2c00 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.935+0000 7f2494d06640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f249014bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f249014bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51204/0 (socket says 172.21.15.77:51204) 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 -- 172.21.15.77:0/312016862 learned_addr learned my addr 172.21.15.77:0/312016862 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2487fff640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f249015e670 0x7f24900af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2495507640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24900b2c00 0x7f24900b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 -- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24900b2c00 msgr2=0x7f24900b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24900b2c00 0x7f24900b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 -- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f249015e670 msgr2=0x7f24900af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f249015e670 0x7f24900af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 -- 172.21.15.77:0/312016862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24901f5ac0 con 0x7f2478003a50 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2487fff640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f249015e670 0x7f24900af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2494d06640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f249014bbf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f248c02b600 tx=0x7f249006fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c038030 con 0x7f2478003a50 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f248c02b950 con 0x7f2478003a50 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f248c02bd00 con 0x7f2478003a50 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24901f6840 con 0x7f2478003a50 2024-05-15T12:10:21.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.936+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24901f6040 con 0x7f2478003a50 2024-05-15T12:10:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.937+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2490074340 con 0x7f2478003a50 2024-05-15T12:10:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.938+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f248c034470 con 0x7f2478003a50 2024-05-15T12:10:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.938+0000 7f24857fa640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f247c0762d0 0x7f247c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.938+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f248c0b7200 con 0x7f2478003a50 2024-05-15T12:10:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.938+0000 7f2487fff640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f247c0762d0 0x7f247c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:21.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.939+0000 7f2487fff640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f247c0762d0 0x7f247c078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24900b21b0 tx=0x7f2480008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:21.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:21.943+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2490074340 con 0x7f2478003a50 2024-05-15T12:10:22.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.195+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f24900768e0 con 0x7f2478003a50 2024-05-15T12:10:22.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.197+0000 7f24857fa640 1 -- 172.21.15.77:0/312016862 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f24900cdbe0 con 0x7f2478003a50 2024-05-15T12:10:22.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f247c0762d0 msgr2=0x7f247c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f247c0762d0 0x7f247c078790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f24900b21b0 tx=0x7f2480008040 comp rx=0 tx=0).stop 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 msgr2=0x7f249014bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f249014bbf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f248c02b600 tx=0x7f249006fd90 comp rx=0 tx=0).stop 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 shutdown_connections 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f247c0762d0 0x7f247c078790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f24900b2c00 0x7f24900b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f249015e670 0x7f24900af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 --2- 172.21.15.77:0/312016862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2478003a50 0x7f249014bbf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 >> 172.21.15.77:0/312016862 conn(0x7f249006c3f0 msgr2=0x7f24900b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 shutdown_connections 2024-05-15T12:10:22.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.199+0000 7f2496f6a640 1 -- 172.21.15.77:0/312016862 wait complete. 2024-05-15T12:10:22.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-15T12:10:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.313+0000 7f68f9a93640 1 Processor -- start 2024-05-15T12:10:22.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.313+0000 7f68f9a93640 1 -- start start 2024-05-15T12:10:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f9a93640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409ba30 0x7f68f40d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f9a93640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68f4163630 0x7f68f415ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f9a93640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f40d2540 con 0x7f68f409be10 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f9a93640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f68f40d1730 con 0x7f68f4163630 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f9a93640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f68f40d19e0 con 0x7f68f409ba30 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68f4163630 0x7f68f415ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68f4163630 0x7f68f415ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51206/0 (socket says 172.21.15.77:51206) 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 -- 172.21.15.77:0/3189369680 learned_addr learned my addr 172.21.15.77:0/3189369680 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f37fe640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409ba30 0x7f68f40d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 -- 172.21.15.77:0/3189369680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409ba30 msgr2=0x7f68f40d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409ba30 0x7f68f40d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 -- 172.21.15.77:0/3189369680 >> v1:172.21.15.83:6789/0 conn(0x7f68f409be10 legacy=0x7f68f4162f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:22.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f3fff640 1 -- 172.21.15.77:0/3189369680 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40d1ca0 con 0x7f68f4163630 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.314+0000 7f68f37fe640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409ba30 0x7f68f40d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.315+0000 7f68f3fff640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ec20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009870 tx=0x7f68ec02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa0dae994888bee server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.315+0000 7f68f27fc640 1 -- 172.21.15.77:0/3189369680 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec037070 con 0x7f68f4163630 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.315+0000 7f68f27fc640 1 -- 172.21.15.77:0/3189369680 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec032440 con 0x7f68f4163630 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.315+0000 7f68f27fc640 1 -- 172.21.15.77:0/3189369680 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec032810 con 0x7f68f4163630 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 -- 172.21.15.77:0/3189369680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 msgr2=0x7f68f415ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ec20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f68ec009870 tx=0x7f68ec02a130 comp rx=0 tx=0).stop 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 -- 172.21.15.77:0/3189369680 shutdown_connections 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ec20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3189369680 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409ba30 0x7f68f40d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 -- 172.21.15.77:0/3189369680 >> 172.21.15.77:0/3189369680 conn(0x7f68f40b4aa0 msgr2=0x7f68f40b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:22.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 -- 172.21.15.77:0/3189369680 shutdown_connections 2024-05-15T12:10:22.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.316+0000 7f68f9a93640 1 -- 172.21.15.77:0/3189369680 wait complete. 2024-05-15T12:10:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.317+0000 7f68f9a93640 1 Processor -- start 2024-05-15T12:10:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.317+0000 7f68f9a93640 1 -- start start 2024-05-15T12:10:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f9a93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 0x7f68f40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f9a93640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409be10 0x7f68f40cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f9a93640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f9a93640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40717c0 con 0x7f68f4163630 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f9a93640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40d2260 con 0x7f68f409ba30 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f9a93640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f68f4160d20 con 0x7f68f409be10 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 0x7f68f40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f2ffd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409be10 0x7f68f40cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 0x7f68f40cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:46764/0 (socket says 172.21.15.77:46764) 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 -- 172.21.15.77:0/3764949156 learned_addr learned my addr 172.21.15.77:0/3764949156 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f3fff640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 -- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409be10 msgr2=0x7f68f40cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409be10 0x7f68f40cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 -- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 msgr2=0x7f68f415ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f37fe640 1 -- 172.21.15.77:0/3764949156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f40ce480 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.318+0000 7f68f2ffd640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409be10 0x7f68f40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.319+0000 7f68f37fe640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 0x7f68f40cf240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68e400ce00 tx=0x7f68e400a650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.319+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e400f890 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.319+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e400fa30 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.319+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f40ce760 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.319+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e400fe40 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.319+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f40ced20 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.320+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f40768e0 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.320+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f68e4018400 con 0x7f68f409ba30 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.321+0000 7f68dbfff640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f68e00762d0 0x7f68e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.321+0000 7f68f2ffd640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f68e00762d0 0x7f68e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.321+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f68e4097fe0 con 0x7f68f409ba30 2024-05-15T12:10:22.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.321+0000 7f68f2ffd640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f68e00762d0 0x7f68e0078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68f40cb260 tx=0x7f68e8009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:22.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.326+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f68e4014030 con 0x7f68f409ba30 2024-05-15T12:10:22.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.578+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f68f415fe50 con 0x7f68f409ba30 2024-05-15T12:10:22.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.583+0000 7f68dbfff640 1 -- 172.21.15.77:0/3764949156 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f68e400ae20 con 0x7f68f409ba30 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f68e00762d0 msgr2=0x7f68e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f68e00762d0 0x7f68e0078790 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68f40cb260 tx=0x7f68e8009060 comp rx=0 tx=0).stop 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 msgr2=0x7f68f40cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 0x7f68f40cf240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68e400ce00 tx=0x7f68e400a650 comp rx=0 tx=0).stop 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 shutdown_connections 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f68e00762d0 0x7f68e0078790 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f68f409be10 0x7f68f40cbbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68f4163630 0x7f68f415ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 --2- 172.21.15.77:0/3764949156 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f68f409ba30 0x7f68f40cf240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 >> 172.21.15.77:0/3764949156 conn(0x7f68f40b4aa0 msgr2=0x7f68f4162ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:22.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 shutdown_connections 2024-05-15T12:10:22.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.586+0000 7f68f9a93640 1 -- 172.21.15.77:0/3764949156 wait complete. 2024-05-15T12:10:22.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-15T12:10:22.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.698+0000 7f1de2c20640 1 Processor -- start 2024-05-15T12:10:22.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.699+0000 7f1de2c20640 1 -- start start 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.699+0000 7f1de2c20640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1ddc148b30 0x7f1ddc0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.699+0000 7f1de2c20640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 0x7f1ddc0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.699+0000 7f1de2c20640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ddc15fec0 con 0x7f1ddc06c3f0 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.699+0000 7f1de2c20640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1ddc162f20 con 0x7f1ddc148b30 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.699+0000 7f1de2c20640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc1601a0 con 0x7f1ddc15f920 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1de11bd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1ddc06c3f0 0x7f1ddc1633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37304/0 (socket says 172.21.15.77:37304) 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1de11bd640 1 -- 172.21.15.77:0/342914330 learned_addr learned my addr 172.21.15.77:0/342914330 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1de09bc640 1 --2- 172.21.15.77:0/342914330 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc148b30 0x7f1ddc0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 0x7f1ddc0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112610388 0 0) 0x7f1ddc15fec0 con 0x7f1ddc06c3f0 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc8003520 con 0x7f1ddc06c3f0 2024-05-15T12:10:22.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3822436714 0 0) 0x7f1dc8003520 con 0x7f1ddc06c3f0 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 msgr2=0x7f1ddc0707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 0x7f1ddc0707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc148b30 msgr2=0x7f1ddc0b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 --2- 172.21.15.77:0/342914330 >> v2:172.21.15.83:3300/0 conn(0x7f1ddc148b30 0x7f1ddc0b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc160480 con 0x7f1ddc06c3f0 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f1dd40016f0 con 0x7f1ddc06c3f0 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 >> v1:172.21.15.77:6789/0 conn(0x7f1ddc06c3f0 legacy=0x7f1ddc1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dc8003a00 0x7f1dc8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dc8004800 0x7f1dc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 0x7f1dc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc162f20 con 0x7f1dc8004800 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc1601a0 con 0x7f1dc8003a00 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc800b9c0 con 0x7f1ddc15f920 2024-05-15T12:10:22.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dc8004800 0x7f1dc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1de09bc640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dc8003a00 0x7f1dc8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.700+0000 7f1de11bd640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 0x7f1dc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddbfff640 1 -- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 msgr2=0x7f1dc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1ddc15f920 0x7f1dc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddbfff640 1 -- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dc8003a00 msgr2=0x7f1dc8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1dc8003a00 0x7f1dc8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddbfff640 1 -- 172.21.15.77:0/342914330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc8003520 con 0x7f1dc8004800 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dc8004800 0x7f1dc8004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009af0 tx=0x7f1dc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb76b291cdf1e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4036070 con 0x7f1dc8004800 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc4031400 con 0x7f1dc8004800 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.701+0000 7f1ddb7fe640 1 -- 172.21.15.77:0/342914330 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4009690 con 0x7f1dc8004800 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de2c20640 1 -- 172.21.15.77:0/342914330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dc8004800 msgr2=0x7f1dc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de2c20640 1 --2- 172.21.15.77:0/342914330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1dc8004800 0x7f1dc8004c80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009af0 tx=0x7f1dc8005830 comp rx=0 tx=0).stop 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de11bd640 1 -- 172.21.15.77:0/342914330 reap_dead start 2024-05-15T12:10:22.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de2c20640 1 -- 172.21.15.77:0/342914330 shutdown_connections 2024-05-15T12:10:22.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de2c20640 1 -- 172.21.15.77:0/342914330 >> 172.21.15.77:0/342914330 conn(0x7f1ddc0d1fa0 msgr2=0x7f1ddc0d2380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:22.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de2c20640 1 -- 172.21.15.77:0/342914330 shutdown_connections 2024-05-15T12:10:22.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.702+0000 7f1de2c20640 1 -- 172.21.15.77:0/342914330 wait complete. 2024-05-15T12:10:22.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.703+0000 7f1de2c20640 1 Processor -- start 2024-05-15T12:10:22.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.703+0000 7f1de2c20640 1 -- start start 2024-05-15T12:10:22.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1de2c20640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dc8004800 0x7f1ddc13da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1de2c20640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 0x7f1ddc1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1de2c20640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc142770 0x7f1ddc142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1de2c20640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc148f10 con 0x7f1ddc140d40 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1de2c20640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc0741b0 con 0x7f1ddc142770 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1de2c20640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1ddc149090 con 0x7f1dc8004800 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 0x7f1ddc1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 0x7f1ddc1411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35384/0 (socket says 172.21.15.77:35384) 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 -- 172.21.15.77:0/424365250 learned_addr learned my addr 172.21.15.77:0/424365250 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 -- 172.21.15.77:0/424365250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dc8004800 msgr2=0x7f1ddc13da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dc8004800 0x7f1ddc13da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 -- 172.21.15.77:0/424365250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc142770 msgr2=0x7f1ddc142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc142770 0x7f1ddc142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.704+0000 7f1ddbfff640 1 -- 172.21.15.77:0/424365250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc13dfa0 con 0x7f1ddc140d40 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.705+0000 7f1ddbfff640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 0x7f1ddc1411c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4034040 tx=0x7f1dc4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.705+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4040020 con 0x7f1ddc140d40 2024-05-15T12:10:22.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.705+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc4003ac0 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.705+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc0ce740 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.705+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4036040 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.705+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc0ced00 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.706+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc06a640 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.706+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1dc4043020 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.707+0000 7f1dd97fa640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1dbc0762d0 0x7f1dbc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.707+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f1dc40b75a0 con 0x7f1ddc140d40 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.707+0000 7f1de09bc640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1dbc0762d0 0x7f1dbc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:22.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.707+0000 7f1de09bc640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1dbc0762d0 0x7f1dbc078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009f40 tx=0x7f1dcc009750 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:22.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.711+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1ddc06a640 con 0x7f1ddc140d40 2024-05-15T12:10:22.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.962+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f1ddc0768e0 con 0x7f1ddc140d40 2024-05-15T12:10:22.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.964+0000 7f1dd97fa640 1 -- 172.21.15.77:0/424365250 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f1dc404a030 con 0x7f1ddc140d40 2024-05-15T12:10:22.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1dbc0762d0 msgr2=0x7f1dbc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1dbc0762d0 0x7f1dbc078790 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009f40 tx=0x7f1dcc009750 comp rx=0 tx=0).stop 2024-05-15T12:10:22.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 msgr2=0x7f1ddc1411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 0x7f1ddc1411c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4034040 tx=0x7f1dc4004730 comp rx=0 tx=0).stop 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 shutdown_connections 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1dbc0762d0 0x7f1dbc078790 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.966+0000 7f1de2c20640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1ddc142770 0x7f1ddc142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.967+0000 7f1de2c20640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1ddc140d40 0x7f1ddc1411c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.967+0000 7f1de2c20640 1 --2- 172.21.15.77:0/424365250 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1dc8004800 0x7f1ddc13da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.967+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 >> 172.21.15.77:0/424365250 conn(0x7f1ddc0d1fa0 msgr2=0x7f1ddc1632b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.967+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 shutdown_connections 2024-05-15T12:10:22.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:22.967+0000 7f1de2c20640 1 -- 172.21.15.77:0/424365250 wait complete. 2024-05-15T12:10:22.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-15T12:10:23.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.078+0000 7f0e9e4da640 1 Processor -- start 2024-05-15T12:10:23.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.078+0000 7f0e9e4da640 1 -- start start 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9e4da640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0e980b1780 0x7f0e980b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9e4da640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e980b6920 0x7f0e980b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9e4da640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e980b6fc0 con 0x7f0e9815cdd0 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9e4da640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f0e980707b0 con 0x7f0e980b6920 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9e4da640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0e980b6d70 con 0x7f0e980b1780 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e980b6920 0x7f0e980b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e980b6920 0x7f0e980b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35388/0 (socket says 172.21.15.77:35388) 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 -- 172.21.15.77:0/4151464105 learned_addr learned my addr 172.21.15.77:0/4151464105 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 -- 172.21.15.77:0/4151464105 >> v2:172.21.15.83:3300/0 conn(0x7f0e980b1780 msgr2=0x7f0e980b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 --2- 172.21.15.77:0/4151464105 >> v2:172.21.15.83:3300/0 conn(0x7f0e980b1780 0x7f0e980b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 -- 172.21.15.77:0/4151464105 >> v1:172.21.15.83:6789/0 conn(0x7f0e9815cdd0 legacy=0x7f0e980b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:23.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.079+0000 7f0e9ca77640 1 -- 172.21.15.77:0/4151464105 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e98074700 con 0x7f0e980b6920 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.080+0000 7f0e9ca77640 1 --2- 172.21.15.77:0/4151464105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b6920 0x7f0e980b4fa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e9806ef90 tx=0x7f0e9002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34295e3d3f2f6f15 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.080+0000 7f0e96ffd640 1 -- 172.21.15.77:0/4151464105 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90036070 con 0x7f0e980b6920 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.080+0000 7f0e96ffd640 1 -- 172.21.15.77:0/4151464105 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90031600 con 0x7f0e980b6920 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.080+0000 7f0e96ffd640 1 -- 172.21.15.77:0/4151464105 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e900319d0 con 0x7f0e980b6920 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.080+0000 7f0e9e4da640 1 -- 172.21.15.77:0/4151464105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b6920 msgr2=0x7f0e980b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.080+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/4151464105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b6920 0x7f0e980b4fa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0e9806ef90 tx=0x7f0e9002a610 comp rx=0 tx=0).stop 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.081+0000 7f0e9e4da640 1 -- 172.21.15.77:0/4151464105 shutdown_connections 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.081+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/4151464105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b6920 0x7f0e980b4fa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.081+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/4151464105 >> v2:172.21.15.83:3300/0 conn(0x7f0e980b1780 0x7f0e980b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.081+0000 7f0e9e4da640 1 -- 172.21.15.77:0/4151464105 >> 172.21.15.77:0/4151464105 conn(0x7f0e9806f160 msgr2=0x7f0e9806f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:23.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.081+0000 7f0e9e4da640 1 -- 172.21.15.77:0/4151464105 shutdown_connections 2024-05-15T12:10:23.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.081+0000 7f0e9e4da640 1 -- 172.21.15.77:0/4151464105 wait complete. 2024-05-15T12:10:23.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.082+0000 7f0e9e4da640 1 Processor -- start 2024-05-15T12:10:23.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.082+0000 7f0e9e4da640 1 -- start start 2024-05-15T12:10:23.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 0x7f0e9815ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e980b6920 0x7f0e98161aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e9815cdd0 0x7f0e98161fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e981600f0 con 0x7f0e980b1780 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9815fe10 con 0x7f0e980b6920 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9815d1b0 con 0x7f0e9815cdd0 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 0x7f0e9815ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 0x7f0e9815ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35390/0 (socket says 172.21.15.77:35390) 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 -- 172.21.15.77:0/704335356 learned_addr learned my addr 172.21.15.77:0/704335356 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e977fe640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e980b6920 0x7f0e98161aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9ca77640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e9815cdd0 0x7f0e98161fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 -- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e9815cdd0 msgr2=0x7f0e98161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e9815cdd0 0x7f0e98161fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 -- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e980b6920 msgr2=0x7f0e98161aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e980b6920 0x7f0e98161aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 -- 172.21.15.77:0/704335356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e981564b0 con 0x7f0e980b1780 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e977fe640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e980b6920 0x7f0e98161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e97fff640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 0x7f0e9815ada0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b410 tx=0x7f0e8800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:23.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88015020 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88011830 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e98156790 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88011c20 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.083+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e98156d50 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.084+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e98156f50 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.085+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e88018020 con 0x7f0e980b1780 2024-05-15T12:10:23.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.085+0000 7f0e94ff9640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e840762d0 0x7f0e84078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.086+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f0e880971d0 con 0x7f0e980b1780 2024-05-15T12:10:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.086+0000 7f0e977fe640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e840762d0 0x7f0e84078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.086+0000 7f0e977fe640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e840762d0 0x7f0e84078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c006fd0 tx=0x7f0e8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:23.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.090+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e98156f50 con 0x7f0e980b1780 2024-05-15T12:10:23.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.274+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0e9806a640 con 0x7f0e980b1780 2024-05-15T12:10:23.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.274+0000 7f0e94ff9640 1 -- 172.21.15.77:0/704335356 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f0e88067e20 con 0x7f0e980b1780 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:23.269 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e840762d0 msgr2=0x7f0e84078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e840762d0 0x7f0e84078790 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c006fd0 tx=0x7f0e8c008040 comp rx=0 tx=0).stop 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 msgr2=0x7f0e9815ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 0x7f0e9815ada0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b410 tx=0x7f0e8800b8d0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 shutdown_connections 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0e840762d0 0x7f0e84078790 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0e9815cdd0 0x7f0e98161fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0e980b6920 0x7f0e98161aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 --2- 172.21.15.77:0/704335356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e980b1780 0x7f0e9815ada0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 >> 172.21.15.77:0/704335356 conn(0x7f0e9806f160 msgr2=0x7f0e980b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 shutdown_connections 2024-05-15T12:10:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.276+0000 7f0e9e4da640 1 -- 172.21.15.77:0/704335356 wait complete. 2024-05-15T12:10:23.282 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-15T12:10:23.282 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-15T12:10:23.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.392+0000 7f4e2f340640 1 Processor -- start 2024-05-15T12:10:23.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.392+0000 7f4e2f340640 1 -- start start 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2f340640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e280ce8b0 0x7f4e2809ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2f340640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e280d2230 con 0x7f4e2809bf70 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2f340640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e280cede0 con 0x7f4e2815d6e0 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2f340640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f4e2809c3e0 con 0x7f4e280ce8b0 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2c8db640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e280ce8b0 0x7f4e2809ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2d8dd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4e2809bf70 0x7f4e280b64b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37310/0 (socket says 172.21.15.77:37310) 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2d8dd640 1 -- 172.21.15.77:0/3554033256 learned_addr learned my addr 172.21.15.77:0/3554033256 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2c8db640 1 -- 172.21.15.77:0/3554033256 >> v1:172.21.15.83:6789/0 conn(0x7f4e2815d6e0 legacy=0x7f4e280b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2c8db640 1 -- 172.21.15.77:0/3554033256 >> v1:172.21.15.77:6789/0 conn(0x7f4e2809bf70 legacy=0x7f4e280b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e2c8db640 1 -- 172.21.15.77:0/3554033256 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e280cf0c0 con 0x7f4e280ce8b0 2024-05-15T12:10:23.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.393+0000 7f4e1ffff640 1 -- 172.21.15.77:0/3554033256 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782426350 0 0) 0x7f4e280d2230 con 0x7f4e2809bf70 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.394+0000 7f4e2c8db640 1 --2- 172.21.15.77:0/3554033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280ce8b0 0x7f4e2809ba30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e180097a0 tx=0x7f4e1802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b07b916840ef93 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.394+0000 7f4e1ffff640 1 -- 172.21.15.77:0/3554033256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18037070 con 0x7f4e280ce8b0 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.394+0000 7f4e1ffff640 1 -- 172.21.15.77:0/3554033256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e18032440 con 0x7f4e280ce8b0 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.394+0000 7f4e1ffff640 1 -- 172.21.15.77:0/3554033256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18032810 con 0x7f4e280ce8b0 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 -- 172.21.15.77:0/3554033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280ce8b0 msgr2=0x7f4e2809ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 --2- 172.21.15.77:0/3554033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280ce8b0 0x7f4e2809ba30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4e180097a0 tx=0x7f4e1802a230 comp rx=0 tx=0).stop 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 -- 172.21.15.77:0/3554033256 shutdown_connections 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 --2- 172.21.15.77:0/3554033256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e280ce8b0 0x7f4e2809ba30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 -- 172.21.15.77:0/3554033256 >> 172.21.15.77:0/3554033256 conn(0x7f4e280b49e0 msgr2=0x7f4e280b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 -- 172.21.15.77:0/3554033256 shutdown_connections 2024-05-15T12:10:23.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.395+0000 7f4e2f340640 1 -- 172.21.15.77:0/3554033256 wait complete. 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.396+0000 7f4e2f340640 1 Processor -- start 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.396+0000 7f4e2f340640 1 -- start start 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e2809bf70 0x7f4e28160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e280ce8b0 0x7f4e281581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 0x7f4e280c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4e280b5f90 con 0x7f4e2815d6e0 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f4e280b5d40 con 0x7f4e280ce8b0 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f4e2815dac0 con 0x7f4e2809bf70 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 0x7f4e280c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 0x7f4e280c57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35410/0 (socket says 172.21.15.77:35410) 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 -- 172.21.15.77:0/483027151 learned_addr learned my addr 172.21.15.77:0/483027151 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2c8db640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e280ce8b0 0x7f4e281581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d0dc640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e2809bf70 0x7f4e28160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 -- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e2809bf70 msgr2=0x7f4e28160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e2809bf70 0x7f4e28160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 -- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e280ce8b0 msgr2=0x7f4e281581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e280ce8b0 0x7f4e281581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 -- 172.21.15.77:0/483027151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e280d0540 con 0x7f4e2815d6e0 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2d8dd640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 0x7f4e280c57c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c7d0 tx=0x7f4e2000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e20018070 con 0x7f4e2815d6e0 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2000a5e0 con 0x7f4e2815d6e0 2024-05-15T12:10:23.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2806d500 con 0x7f4e2815d6e0 2024-05-15T12:10:23.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.397+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000aa10 con 0x7f4e2815d6e0 2024-05-15T12:10:23.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.398+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e280cfa60 con 0x7f4e2815d6e0 2024-05-15T12:10:23.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.399+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e2806a640 con 0x7f4e2815d6e0 2024-05-15T12:10:23.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.399+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e2001b070 con 0x7f4e2815d6e0 2024-05-15T12:10:23.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.399+0000 7f4e1dffb640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4e0c0762d0 0x7f4e0c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:23.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.400+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f4e20096750 con 0x7f4e2815d6e0 2024-05-15T12:10:23.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.400+0000 7f4e2d0dc640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4e0c0762d0 0x7f4e0c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:23.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.400+0000 7f4e2d0dc640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4e0c0762d0 0x7f4e0c078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e24000f60 tx=0x7f4e24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:23.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.404+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e2005fdb0 con 0x7f4e2815d6e0 2024-05-15T12:10:23.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:23.586+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4e280b8480 con 0x7f4e2815d6e0 2024-05-15T12:10:24.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.301+0000 7f4e1dffb640 1 -- 172.21.15.77:0/483027151 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f4e200640b0 con 0x7f4e2815d6e0 2024-05-15T12:10:24.296 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2024-05-15T12:10:24.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4e0c0762d0 msgr2=0x7f4e0c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4e0c0762d0 0x7f4e0c078790 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4e24000f60 tx=0x7f4e24009040 comp rx=0 tx=0).stop 2024-05-15T12:10:24.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 msgr2=0x7f4e280c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 0x7f4e280c57c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000c7d0 tx=0x7f4e2000cc90 comp rx=0 tx=0).stop 2024-05-15T12:10:24.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 shutdown_connections 2024-05-15T12:10:24.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f4e0c0762d0 0x7f4e0c078790 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e2815d6e0 0x7f4e280c57c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4e280ce8b0 0x7f4e281581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 --2- 172.21.15.77:0/483027151 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4e2809bf70 0x7f4e28160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 >> 172.21.15.77:0/483027151 conn(0x7f4e280b49e0 msgr2=0x7f4e280d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:24.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 shutdown_connections 2024-05-15T12:10:24.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.304+0000 7f4e2f340640 1 -- 172.21.15.77:0/483027151 wait complete. 2024-05-15T12:10:24.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-15T12:10:24.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.432+0000 7f420179e640 1 Processor -- start 2024-05-15T12:10:24.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.432+0000 7f420179e640 1 -- start start 2024-05-15T12:10:24.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.433+0000 7f420179e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f41fc162b60 0x7f41fc0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.433+0000 7f420179e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41fc0b43c0 con 0x7f41fc0d2f10 2024-05-15T12:10:24.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.433+0000 7f420179e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41fc0d1dd0 con 0x7f41fc0d3a80 2024-05-15T12:10:24.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.433+0000 7f420179e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f41fc0d20b0 con 0x7f41fc162b60 2024-05-15T12:10:24.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.433+0000 7f41fb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f41fc0d2f10 0x7f41fc0d3370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37318/0 (socket says 172.21.15.77:37318) 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1004474799 learned_addr learned my addr 172.21.15.77:0/1004474799 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620249812 0 0) 0x7f41fc0b43c0 con 0x7f41fc0d2f10 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1004474799 >> v2:172.21.15.83:3300/0 conn(0x7f41fc162b60 0x7f41fc0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e4003520 con 0x7f41fc0d2f10 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233544780 0 0) 0x7f41e4003520 con 0x7f41fc0d2f10 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 >> v2:172.21.15.83:3300/0 conn(0x7f41fc162b60 msgr2=0x7f41fc0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 --2- 172.21.15.77:0/1004474799 >> v2:172.21.15.83:3300/0 conn(0x7f41fc162b60 0x7f41fc0b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 >> v1:172.21.15.83:6789/0 conn(0x7f41fc0d3a80 legacy=0x7f41fc0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc0d2390 con 0x7f41fc0d2f10 2024-05-15T12:10:24.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f41f00016f0 con 0x7f41fc0d2f10 2024-05-15T12:10:24.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1004474799 >> v2:172.21.15.83:3300/0 conn(0x7f41fc162b60 0x7f41fc0b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:24.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 >> v1:172.21.15.77:6789/0 conn(0x7f41fc0d2f10 legacy=0x7f41fc0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41e4003a50 0x7f41e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004800 0x7f41e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e40052e0 0x7f41e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0d20b0 con 0x7f41e4004800 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f41e400c1b0 con 0x7f41e4003a50 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f41e400c3b0 con 0x7f41e40052e0 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004800 0x7f41e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41e4003a50 0x7f41e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f4200f9d640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e40052e0 0x7f41e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e40052e0 msgr2=0x7f41e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e40052e0 0x7f41e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41e4003a50 msgr2=0x7f41e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41e4003a50 0x7f41e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.434+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1004474799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e4003520 con 0x7f41e4004800 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.435+0000 7f4200f9d640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e40052e0 0x7f41e400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.435+0000 7f4200f9d640 1 -- 172.21.15.77:0/1004474799 reap_dead start 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.435+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004800 0x7f41e4004c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41fc08d790 tx=0x7f41e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=630d7f8f8a2efbd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:24.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.435+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0007d70 con 0x7f41e4004800 2024-05-15T12:10:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.435+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f0005ad0 con 0x7f41e4004800 2024-05-15T12:10:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.435+0000 7f41faffd640 1 -- 172.21.15.77:0/1004474799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f0007070 con 0x7f41e4004800 2024-05-15T12:10:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 -- 172.21.15.77:0/1004474799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004800 msgr2=0x7f41e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004800 0x7f41e4004c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41fc08d790 tx=0x7f41e4005830 comp rx=0 tx=0).stop 2024-05-15T12:10:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 -- 172.21.15.77:0/1004474799 shutdown_connections 2024-05-15T12:10:24.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 --2- 172.21.15.77:0/1004474799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41e4004800 0x7f41e4004c80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 -- 172.21.15.77:0/1004474799 >> 172.21.15.77:0/1004474799 conn(0x7f41fc0d5010 msgr2=0x7f41fc0d5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 -- 172.21.15.77:0/1004474799 shutdown_connections 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.436+0000 7f420179e640 1 -- 172.21.15.77:0/1004474799 wait complete. 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.437+0000 7f420179e640 1 Processor -- start 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.437+0000 7f420179e640 1 -- start start 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f420179e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e4004800 0x7f41fc0ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f420179e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 0x7f41fc0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f420179e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41fc0b7c30 0x7f41fc0b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f420179e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0b3de0 con 0x7f41fc0b5c00 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f420179e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc0d0ea0 con 0x7f41fc0b7c30 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f420179e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f41fc0b3f60 con 0x7f41e4004800 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f41fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 0x7f41fc0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f41fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 0x7f41fc0b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35420/0 (socket says 172.21.15.77:35420) 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1243678699 learned_addr learned my addr 172.21.15.77:0/1243678699 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:24.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e4004800 0x7f41fc0ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.438+0000 7f4200f9d640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41fc0b7c30 0x7f41fc0b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e4004800 msgr2=0x7f41fc0ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e4004800 0x7f41fc0ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41fc0b7c30 msgr2=0x7f41fc0b80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41fc0b7c30 0x7f41fc0b80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41fb7fe640 1 -- 172.21.15.77:0/1243678699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc1f5b00 con 0x7f41fc0b5c00 2024-05-15T12:10:24.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41fb7fe640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 0x7f41fc0b6080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41f002ad70 tx=0x7f41fc162f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f00014b0 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f0040070 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc0c9de0 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f00047e0 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.439+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc0ca3a0 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.440+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc0b65c0 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.441+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f41f003a070 con 0x7f41fc0b5c00 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.441+0000 7f41f8ff9640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41e8076300 0x7f41e80787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.441+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41e8076300 0x7f41e80787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:24.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.441+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f41f00b6650 con 0x7f41fc0b5c00 2024-05-15T12:10:24.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.442+0000 7f41fbfff640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41e8076300 0x7f41e80787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41ec006fd0 tx=0x7f41ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:24.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.446+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f41f0080190 con 0x7f41fc0b5c00 2024-05-15T12:10:24.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:24.626+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f41fc06a640 con 0x7f41fc0b5c00 2024-05-15T12:10:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.306+0000 7f41f8ff9640 1 -- 172.21.15.77:0/1243678699 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f41f0088180 con 0x7f41fc0b5c00 2024-05-15T12:10:25.301 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2024-05-15T12:10:25.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.310+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41e8076300 msgr2=0x7f41e80787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:25.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.310+0000 7f420179e640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41e8076300 0x7f41e80787c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41ec006fd0 tx=0x7f41ec008040 comp rx=0 tx=0).stop 2024-05-15T12:10:25.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.310+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 msgr2=0x7f41fc0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:25.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.310+0000 7f420179e640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 0x7f41fc0b6080 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41f002ad70 tx=0x7f41fc162f40 comp rx=0 tx=0).stop 2024-05-15T12:10:25.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.312+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 shutdown_connections 2024-05-15T12:10:25.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.312+0000 7f420179e640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f41e8076300 0x7f41e80787c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.312+0000 7f420179e640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f41fc0b7c30 0x7f41fc0b80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.312+0000 7f420179e640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41fc0b5c00 0x7f41fc0b6080 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.312+0000 7f420179e640 1 --2- 172.21.15.77:0/1243678699 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f41e4004800 0x7f41fc0ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.312+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 >> 172.21.15.77:0/1243678699 conn(0x7f41fc0d5010 msgr2=0x7f41fc0cfba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:25.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.314+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 shutdown_connections 2024-05-15T12:10:25.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.315+0000 7f420179e640 1 -- 172.21.15.77:0/1243678699 wait complete. 2024-05-15T12:10:25.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-15T12:10:25.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.437+0000 7fbb09245640 1 Processor -- start 2024-05-15T12:10:25.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.437+0000 7fbb09245640 1 -- start start 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb09245640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbb04147f80 0x7fbb04163960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb09245640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fbb04072b00 0x7fbb040710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb09245640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb040d1740 0x7fbb040d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb09245640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fbb040d20f0 con 0x7fbb04147f80 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb09245640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fbb04071d40 con 0x7fbb04072b00 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb09245640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbb04072020 con 0x7fbb040d1740 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbb04147f80 0x7fbb04163960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbb04147f80 0x7fbb04163960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35426/0 (socket says 172.21.15.77:35426) 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 -- 172.21.15.77:0/2493845803 learned_addr learned my addr 172.21.15.77:0/2493845803 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbafa59c640 1 --2- 172.21.15.77:0/2493845803 >> v2:172.21.15.83:3300/0 conn(0x7fbb04072b00 0x7fbb040710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb0359e640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb040d1740 0x7fbb040d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 -- 172.21.15.77:0/2493845803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb040d1740 msgr2=0x7fbb040d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb040d1740 0x7fbb040d1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 -- 172.21.15.77:0/2493845803 >> v2:172.21.15.83:3300/0 conn(0x7fbb04072b00 msgr2=0x7fbb040710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 --2- 172.21.15.77:0/2493845803 >> v2:172.21.15.83:3300/0 conn(0x7fbb04072b00 0x7fbb040710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb02d9d640 1 -- 172.21.15.77:0/2493845803 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb04072300 con 0x7fbb04147f80 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbafa59c640 1 --2- 172.21.15.77:0/2493845803 >> v2:172.21.15.83:3300/0 conn(0x7fbb04072b00 0x7fbb040710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.438+0000 7fbb0359e640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb040d1740 0x7fbb040d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb02d9d640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb04147f80 0x7fbb04163960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb040b91f0 tx=0x7fbaf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1498d8e82e07d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb0259c640 1 -- 172.21.15.77:0/2493845803 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4037070 con 0x7fbb04147f80 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb0259c640 1 -- 172.21.15.77:0/2493845803 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4032440 con 0x7fbb04147f80 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb0259c640 1 -- 172.21.15.77:0/2493845803 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4032810 con 0x7fbb04147f80 2024-05-15T12:10:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 -- 172.21.15.77:0/2493845803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb04147f80 msgr2=0x7fbb04163960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb04147f80 0x7fbb04163960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fbb040b91f0 tx=0x7fbaf402a1e0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 -- 172.21.15.77:0/2493845803 shutdown_connections 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb040d1740 0x7fbb040d1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 --2- 172.21.15.77:0/2493845803 >> v2:172.21.15.83:3300/0 conn(0x7fbb04072b00 0x7fbb040710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 --2- 172.21.15.77:0/2493845803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb04147f80 0x7fbb04163960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 -- 172.21.15.77:0/2493845803 >> 172.21.15.77:0/2493845803 conn(0x7fbb040d2fc0 msgr2=0x7fbb040d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 -- 172.21.15.77:0/2493845803 shutdown_connections 2024-05-15T12:10:25.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.439+0000 7fbb09245640 1 -- 172.21.15.77:0/2493845803 wait complete. 2024-05-15T12:10:25.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.441+0000 7fbb09245640 1 Processor -- start 2024-05-15T12:10:25.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.441+0000 7fbb09245640 1 -- start start 2024-05-15T12:10:25.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb04072b00 0x7fbb040ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 0x7fbb040af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb04147f80 0x7fbb041f8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbb040717c0 con 0x7fbb040d1740 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04148360 con 0x7fbb04147f80 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbb0406dda0 con 0x7fbb04072b00 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 0x7fbb040af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 0x7fbb040af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35428/0 (socket says 172.21.15.77:35428) 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 -- 172.21.15.77:0/2462018135 learned_addr learned my addr 172.21.15.77:0/2462018135 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb02d9d640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb04072b00 0x7fbb040ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb0359e640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb04147f80 0x7fbb041f8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 -- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb04072b00 msgr2=0x7fbb040ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb04072b00 0x7fbb040ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 -- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb04147f80 msgr2=0x7fbb041f8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb04147f80 0x7fbb041f8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:25.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 -- 172.21.15.77:0/2462018135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb040ab8c0 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafa59c640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 0x7fbb040af310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00c7c0 tx=0x7fbaec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec015070 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec007a30 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb040abba0 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec007e00 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.442+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb040ac160 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.443+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0406a640 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.444+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbaec018070 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.444+0000 7fbafbfff640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbae40762d0 0x7fbae4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.445+0000 7fbb02d9d640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbae40762d0 0x7fbae4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.445+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7fbaec097370 con 0x7fbb040d1740 2024-05-15T12:10:25.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.445+0000 7fbb02d9d640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbae40762d0 0x7fbae4078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4034000 tx=0x7fbaf402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:25.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.449+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbaec060770 con 0x7fbb040d1740 2024-05-15T12:10:25.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:25.665+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fbb041622b0 con 0x7fbb040d1740 2024-05-15T12:10:26.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.308+0000 7fbafbfff640 1 -- 172.21.15.77:0/2462018135 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) ==== 172+0+0 (secure 0 0 0) 0x7fbaec064a70 con 0x7fbb040d1740 2024-05-15T12:10:26.303 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 4 and data pool 5 2024-05-15T12:10:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.313+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbae40762d0 msgr2=0x7fbae4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.313+0000 7fbb09245640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbae40762d0 0x7fbae4078790 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4034000 tx=0x7fbaf402e000 comp rx=0 tx=0).stop 2024-05-15T12:10:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.313+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 msgr2=0x7fbb040af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.313+0000 7fbb09245640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 0x7fbb040af310 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00c7c0 tx=0x7fbaec00cc80 comp rx=0 tx=0).stop 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 shutdown_connections 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbae40762d0 0x7fbae4078790 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbb04147f80 0x7fbb041f8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbb040d1740 0x7fbb040af310 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 --2- 172.21.15.77:0/2462018135 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbb04072b00 0x7fbb040ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 >> 172.21.15.77:0/2462018135 conn(0x7fbb040d2fc0 msgr2=0x7fbb0406e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 shutdown_connections 2024-05-15T12:10:26.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.314+0000 7fbb09245640 1 -- 172.21.15.77:0/2462018135 wait complete. 2024-05-15T12:10:26.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:10:26.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.445+0000 7fa099072640 1 Processor -- start 2024-05-15T12:10:26.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.446+0000 7fa099072640 1 -- start start 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.446+0000 7fa099072640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa09415f460 0x7fa0940d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.446+0000 7fa099072640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fa09415f840 0x7fa0940d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.446+0000 7fa099072640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0940d0dd0 con 0x7fa0940d0060 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.446+0000 7fa099072640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fa0940d19e0 con 0x7fa09415f460 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.446+0000 7fa099072640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fa0940d10b0 con 0x7fa09415f840 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa09415f460 0x7fa0940d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa09415f460 0x7fa0940d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35442/0 (socket says 172.21.15.77:35442) 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 -- 172.21.15.77:0/1346080893 learned_addr learned my addr 172.21.15.77:0/1346080893 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa09259c640 1 --2- 172.21.15.77:0/1346080893 >> v2:172.21.15.83:3300/0 conn(0x7fa09415f840 0x7fa0940d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 -- 172.21.15.77:0/1346080893 >> v2:172.21.15.83:3300/0 conn(0x7fa09415f840 msgr2=0x7fa0940d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 --2- 172.21.15.77:0/1346080893 >> v2:172.21.15.83:3300/0 conn(0x7fa09415f840 0x7fa0940d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 -- 172.21.15.77:0/1346080893 >> v1:172.21.15.83:6789/0 conn(0x7fa0940d0060 legacy=0x7fa0940d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.447+0000 7fa092d9d640 1 -- 172.21.15.77:0/1346080893 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0940d1390 con 0x7fa09415f460 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa092d9d640 1 --2- 172.21.15.77:0/1346080893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa0940d38c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0940b6590 tx=0x7fa08c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30245c9385e2f1d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa091d9b640 1 -- 172.21.15.77:0/1346080893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c037070 con 0x7fa09415f460 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa091d9b640 1 -- 172.21.15.77:0/1346080893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c032440 con 0x7fa09415f460 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa091d9b640 1 -- 172.21.15.77:0/1346080893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c032810 con 0x7fa09415f460 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 -- 172.21.15.77:0/1346080893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 msgr2=0x7fa0940d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 --2- 172.21.15.77:0/1346080893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa0940d38c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa0940b6590 tx=0x7fa08c02a1e0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 -- 172.21.15.77:0/1346080893 shutdown_connections 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 --2- 172.21.15.77:0/1346080893 >> v2:172.21.15.83:3300/0 conn(0x7fa09415f840 0x7fa0940d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 --2- 172.21.15.77:0/1346080893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa0940d38c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 -- 172.21.15.77:0/1346080893 >> 172.21.15.77:0/1346080893 conn(0x7fa09408ec10 msgr2=0x7fa09409e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 -- 172.21.15.77:0/1346080893 shutdown_connections 2024-05-15T12:10:26.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.448+0000 7fa099072640 1 -- 172.21.15.77:0/1346080893 wait complete. 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.450+0000 7fa099072640 1 Processor -- start 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.450+0000 7fa099072640 1 -- start start 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.450+0000 7fa099072640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940d0060 0x7fa0940ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.450+0000 7fa099072640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa094160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa099072640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09415f840 0x7fa094154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa099072640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0940b4b80 con 0x7fa09415f460 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa099072640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa0940b4a00 con 0x7fa09415f840 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa099072640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa0940b4d00 con 0x7fa0940d0060 2024-05-15T12:10:26.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa094160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa094160dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35448/0 (socket says 172.21.15.77:35448) 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 -- 172.21.15.77:0/1655584637 learned_addr learned my addr 172.21.15.77:0/1655584637 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09359e640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09415f840 0x7fa094154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa092d9d640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940d0060 0x7fa0940ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 -- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940d0060 msgr2=0x7fa0940ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940d0060 0x7fa0940ced30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 -- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09415f840 msgr2=0x7fa094154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09415f840 0x7fa094154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 -- 172.21.15.77:0/1655584637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa094161550 con 0x7fa09415f460 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa09259c640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa094160dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa088007e40 tx=0x7fa08800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088014620 con 0x7fa09415f460 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa088019070 con 0x7fa09415f460 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088014a00 con 0x7fa09415f460 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa094161830 con 0x7fa09415f460 2024-05-15T12:10:26.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.451+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa094161df0 con 0x7fa09415f460 2024-05-15T12:10:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.453+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09406a640 con 0x7fa09415f460 2024-05-15T12:10:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.453+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa088014ba0 con 0x7fa09415f460 2024-05-15T12:10:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.453+0000 7fa07b7fe640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa0800762d0 0x7fa080078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.453+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fa088097eb0 con 0x7fa09415f460 2024-05-15T12:10:26.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.453+0000 7fa092d9d640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa0800762d0 0x7fa080078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.454+0000 7fa092d9d640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa0800762d0 0x7fa080078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa08c034000 tx=0x7fa08c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:26.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.458+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa088061810 con 0x7fa09415f460 2024-05-15T12:10:26.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.638+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa09406d300 con 0x7fa09415f460 2024-05-15T12:10:26.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.639+0000 7fa07b7fe640 1 -- 172.21.15.77:0/1655584637 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16550 (secure 0 0 0) 0x7fa088061110 con 0x7fa09415f460 2024-05-15T12:10:26.634 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:26.634 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":31,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:10:25.666931+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:10:23.590791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T12:10:24.630314+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:10:26.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa0800762d0 msgr2=0x7fa080078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa0800762d0 0x7fa080078790 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa08c034000 tx=0x7fa08c02e000 comp rx=0 tx=0).stop 2024-05-15T12:10:26.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 msgr2=0x7fa094160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa094160dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa088007e40 tx=0x7fa08800e4b0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 shutdown_connections 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa0800762d0 0x7fa080078790 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa09415f840 0x7fa094154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa09415f460 0x7fa094160dc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.641+0000 7fa099072640 1 --2- 172.21.15.77:0/1655584637 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa0940d0060 0x7fa0940ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.642+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 >> 172.21.15.77:0/1655584637 conn(0x7fa09408ec10 msgr2=0x7fa09406dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.642+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 shutdown_connections 2024-05-15T12:10:26.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.642+0000 7fa099072640 1 -- 172.21.15.77:0/1655584637 wait complete. 2024-05-15T12:10:26.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:10:26.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.753+0000 7f8975c23640 1 Processor -- start 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.753+0000 7f8975c23640 1 -- start start 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f8975c23640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f897015cdd0 0x7f89700b1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f8975c23640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f89700b6af0 0x7f89700b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f8975c23640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89700b6fc0 con 0x7f89700b15b0 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f8975c23640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f89700b1a20 con 0x7f897015cdd0 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f8975c23640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f89700707b0 con 0x7f89700b6af0 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f897015cdd0 0x7f89700b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f897015cdd0 0x7f89700b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35452/0 (socket says 172.21.15.77:35452) 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 -- 172.21.15.77:0/965539266 learned_addr learned my addr 172.21.15.77:0/965539266 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:26.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 -- 172.21.15.77:0/965539266 >> v2:172.21.15.83:3300/0 conn(0x7f89700b6af0 msgr2=0x7f89700b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 --2- 172.21.15.77:0/965539266 >> v2:172.21.15.83:3300/0 conn(0x7f89700b6af0 0x7f89700b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 -- 172.21.15.77:0/965539266 >> v1:172.21.15.83:6789/0 conn(0x7f89700b15b0 legacy=0x7f89700b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.754+0000 7f896f7fe640 1 -- 172.21.15.77:0/965539266 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8970074700 con 0x7f897015cdd0 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.755+0000 7f896f7fe640 1 --2- 172.21.15.77:0/965539266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f897015cdd0 0x7f89700b1070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f897006ed00 tx=0x7f896002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10ed5bb25ab2b73 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.755+0000 7f896effd640 1 -- 172.21.15.77:0/965539266 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960037070 con 0x7f897015cdd0 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.755+0000 7f896effd640 1 -- 172.21.15.77:0/965539266 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8960032440 con 0x7f897015cdd0 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.755+0000 7f896effd640 1 -- 172.21.15.77:0/965539266 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8960032810 con 0x7f897015cdd0 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 -- 172.21.15.77:0/965539266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f897015cdd0 msgr2=0x7f89700b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 --2- 172.21.15.77:0/965539266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f897015cdd0 0x7f89700b1070 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f897006ed00 tx=0x7f896002a140 comp rx=0 tx=0).stop 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 -- 172.21.15.77:0/965539266 shutdown_connections 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 --2- 172.21.15.77:0/965539266 >> v2:172.21.15.83:3300/0 conn(0x7f89700b6af0 0x7f89700b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 --2- 172.21.15.77:0/965539266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f897015cdd0 0x7f89700b1070 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 -- 172.21.15.77:0/965539266 >> 172.21.15.77:0/965539266 conn(0x7f897006f160 msgr2=0x7f897006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:26.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 -- 172.21.15.77:0/965539266 shutdown_connections 2024-05-15T12:10:26.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.756+0000 7f8975c23640 1 -- 172.21.15.77:0/965539266 wait complete. 2024-05-15T12:10:26.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.757+0000 7f8975c23640 1 Processor -- start 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.757+0000 7f8975c23640 1 -- start start 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89700b15b0 0x7f89701f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 0x7f897015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f897015cdd0 0x7f89700d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f89701600f0 con 0x7f89700b6af0 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f897015fe10 con 0x7f897015cdd0 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f897015d1b0 con 0x7f89700b15b0 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 0x7f897015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 0x7f897015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35454/0 (socket says 172.21.15.77:35454) 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 -- 172.21.15.77:0/3531008500 learned_addr learned my addr 172.21.15.77:0/3531008500 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f896ffff640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f897015cdd0 0x7f89700d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f896f7fe640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89700b15b0 0x7f89701f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 -- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89700b15b0 msgr2=0x7f89701f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89700b15b0 0x7f89701f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 -- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f897015cdd0 msgr2=0x7f89700d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f897015cdd0 0x7f89700d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 -- 172.21.15.77:0/3531008500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8970158410 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f896f7fe640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89700b15b0 0x7f89701f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8966ffd640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 0x7f897015e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f895800c410 tx=0x7f895800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8958017070 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89580035f0 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89701589d0 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89580039e0 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.758+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89701f5870 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.759+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897006a640 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.760+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f895801a070 con 0x7f89700b6af0 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.761+0000 7f896cff9640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f89500762d0 0x7f8950078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:26.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.761+0000 7f896f7fe640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f89500762d0 0x7f8950078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:26.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.761+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f8958096930 con 0x7f89700b6af0 2024-05-15T12:10:26.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.761+0000 7f896f7fe640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f89500762d0 0x7f8950078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8960034000 tx=0x7f896002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:26.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.765+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f895805fcd0 con 0x7f89700b6af0 2024-05-15T12:10:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.944+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8970071cd0 con 0x7f89700b6af0 2024-05-15T12:10:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.945+0000 7f896cff9640 1 -- 172.21.15.77:0/3531008500 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16550 (secure 0 0 0) 0x7f8958063fd0 con 0x7f89700b6af0 2024-05-15T12:10:26.940 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":31,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:10:25.666931+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:10:23.590791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T12:10:24.630314+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:10:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f89500762d0 msgr2=0x7f8950078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f89500762d0 0x7f8950078790 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8960034000 tx=0x7f896002e000 comp rx=0 tx=0).stop 2024-05-15T12:10:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 msgr2=0x7f897015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 0x7f897015e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f895800c410 tx=0x7f895800c8d0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 shutdown_connections 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f89500762d0 0x7f8950078790 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f897015cdd0 0x7f89700d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89700b6af0 0x7f897015e770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 --2- 172.21.15.77:0/3531008500 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f89700b15b0 0x7f89701f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.947+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 >> 172.21.15.77:0/3531008500 conn(0x7f897006f160 msgr2=0x7f89700d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.948+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 shutdown_connections 2024-05-15T12:10:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:26.948+0000 7f8975c23640 1 -- 172.21.15.77:0/3531008500 wait complete. 2024-05-15T12:10:26.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-15T12:10:27.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.062+0000 7f459d6bd640 1 Processor -- start 2024-05-15T12:10:27.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.062+0000 7f459d6bd640 1 -- start start 2024-05-15T12:10:27.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f459d6bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f45980d10b0 0x7f45980d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f459d6bd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f45980b44f0 0x7f45980b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f459d6bd640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45980d19d0 con 0x7f459815d970 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f459d6bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f459806f050 con 0x7f45980d10b0 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f459d6bd640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f459806e460 con 0x7f45980b44f0 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f4596ffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f45980d10b0 0x7f45980d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f45967fc640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f459815d970 0x7f459815de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37324/0 (socket says 172.21.15.77:37324) 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f45967fc640 1 -- 172.21.15.77:0/22293756 learned_addr learned my addr 172.21.15.77:0/22293756 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f45977fe640 1 --2- 172.21.15.77:0/22293756 >> v2:172.21.15.83:3300/0 conn(0x7f45980b44f0 0x7f45980b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f4596ffd640 1 -- 172.21.15.77:0/22293756 >> v2:172.21.15.83:3300/0 conn(0x7f45980b44f0 msgr2=0x7f45980b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f4596ffd640 1 --2- 172.21.15.77:0/22293756 >> v2:172.21.15.83:3300/0 conn(0x7f45980b44f0 0x7f45980b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f4596ffd640 1 -- 172.21.15.77:0/22293756 >> v1:172.21.15.77:6789/0 conn(0x7f459815d970 legacy=0x7f459815de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f4595ffb640 1 -- 172.21.15.77:0/22293756 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889028634 0 0) 0x7f45980d19d0 con 0x7f459815d970 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.063+0000 7f4596ffd640 1 -- 172.21.15.77:0/22293756 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459806e720 con 0x7f45980d10b0 2024-05-15T12:10:27.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.064+0000 7f4596ffd640 1 --2- 172.21.15.77:0/22293756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f45980d1490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f459806fc20 tx=0x7f458802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d75bcb3a3a025b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:27.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.064+0000 7f4595ffb640 1 -- 172.21.15.77:0/22293756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588007740 con 0x7f45980d10b0 2024-05-15T12:10:27.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.064+0000 7f4595ffb640 1 -- 172.21.15.77:0/22293756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45880078e0 con 0x7f45980d10b0 2024-05-15T12:10:27.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.064+0000 7f4595ffb640 1 -- 172.21.15.77:0/22293756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4588007cb0 con 0x7f45980d10b0 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 -- 172.21.15.77:0/22293756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 msgr2=0x7f45980d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 --2- 172.21.15.77:0/22293756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f45980d1490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f459806fc20 tx=0x7f458802a680 comp rx=0 tx=0).stop 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 -- 172.21.15.77:0/22293756 shutdown_connections 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 --2- 172.21.15.77:0/22293756 >> v2:172.21.15.83:3300/0 conn(0x7f45980b44f0 0x7f45980b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 --2- 172.21.15.77:0/22293756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f45980d1490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 -- 172.21.15.77:0/22293756 >> 172.21.15.77:0/22293756 conn(0x7f459806c5d0 msgr2=0x7f459806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 -- 172.21.15.77:0/22293756 shutdown_connections 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.065+0000 7f459d6bd640 1 -- 172.21.15.77:0/22293756 wait complete. 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.066+0000 7f459d6bd640 1 Processor -- start 2024-05-15T12:10:27.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.066+0000 7f459d6bd640 1 -- start start 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f459d6bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45980b44f0 0x7f4598072240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f459d6bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f4598156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f459d6bd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f459815d970 0x7f459815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f459d6bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f45981543f0 con 0x7f45980d10b0 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f459d6bd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f459806ece0 con 0x7f45980b44f0 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f459d6bd640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f45980cf650 con 0x7f459815d970 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f4598156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f4598156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35474/0 (socket says 172.21.15.77:35474) 2024-05-15T12:10:27.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 -- 172.21.15.77:0/1900242907 learned_addr learned my addr 172.21.15.77:0/1900242907 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f4596ffd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45980b44f0 0x7f4598072240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45977fe640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f459815d970 0x7f459815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 -- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f459815d970 msgr2=0x7f459815c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f459815d970 0x7f459815c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 -- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45980b44f0 msgr2=0x7f4598072240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45980b44f0 0x7f4598072240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45967fc640 1 -- 172.21.15.77:0/1900242907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45981546f0 con 0x7f45980d10b0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.067+0000 7f45977fe640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f459815d970 0x7f459815c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.068+0000 7f45967fc640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f4598156f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f458c00c3e0 tx=0x7f458c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.068+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0074e0 con 0x7f45980d10b0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.068+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f458c0047e0 con 0x7f45980d10b0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.068+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c004bd0 con 0x7f45980d10b0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.068+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45981549d0 con 0x7f45980d10b0 2024-05-15T12:10:27.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.068+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4598154f90 con 0x7f45980d10b0 2024-05-15T12:10:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.069+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f459806a640 con 0x7f45980d10b0 2024-05-15T12:10:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.069+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f458c011070 con 0x7f45980d10b0 2024-05-15T12:10:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.070+0000 7f457f7fe640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f45840762d0 0x7f4584078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.070+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f458c097150 con 0x7f45980d10b0 2024-05-15T12:10:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.070+0000 7f4596ffd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f45840762d0 0x7f4584078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.070+0000 7f4596ffd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f45840762d0 0x7f4584078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4588034000 tx=0x7f458802f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:27.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.074+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f458c060ab0 con 0x7f45980d10b0 2024-05-15T12:10:27.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.293+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f45980b42d0 con 0x7f45980d10b0 2024-05-15T12:10:27.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.323+0000 7f457f7fe640 1 -- 172.21.15.77:0/1900242907 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) ==== 118+0+0 (secure 0 0 0) 0x7f458c0603b0 con 0x7f45980d10b0 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f45840762d0 msgr2=0x7f4584078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f45840762d0 0x7f4584078790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4588034000 tx=0x7f458802f000 comp rx=0 tx=0).stop 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 msgr2=0x7f4598156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f4598156f20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f458c00c3e0 tx=0x7f458c00c8a0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 shutdown_connections 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f45840762d0 0x7f4584078790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f459815d970 0x7f459815c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f45980d10b0 0x7f4598156f20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 --2- 172.21.15.77:0/1900242907 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f45980b44f0 0x7f4598072240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 >> 172.21.15.77:0/1900242907 conn(0x7f459806c5d0 msgr2=0x7f45980b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 shutdown_connections 2024-05-15T12:10:27.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.326+0000 7f459d6bd640 1 -- 172.21.15.77:0/1900242907 wait complete. 2024-05-15T12:10:27.332 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-15T12:10:27.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-15T12:10:27.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.441+0000 7fab57850640 1 Processor -- start 2024-05-15T12:10:27.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.441+0000 7fab57850640 1 -- start start 2024-05-15T12:10:27.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab57850640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab500d10b0 0x7fab500d1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab57850640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab500d19d0 con 0x7fab5015d970 2024-05-15T12:10:27.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab57850640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5006e460 con 0x7fab500b44f0 2024-05-15T12:10:27.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab57850640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fab5006f050 con 0x7fab500d10b0 2024-05-15T12:10:27.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab555ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab500d10b0 0x7fab500d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab54deb640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fab5015d970 0x7fab5015de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37338/0 (socket says 172.21.15.77:37338) 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab555ec640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab500d10b0 0x7fab500d1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35488/0 (socket says 172.21.15.77:35488) 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab54deb640 1 -- 172.21.15.77:0/317328389 learned_addr learned my addr 172.21.15.77:0/317328389 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab555ec640 1 -- 172.21.15.77:0/317328389 >> v1:172.21.15.83:6789/0 conn(0x7fab500b44f0 legacy=0x7fab500b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab555ec640 1 -- 172.21.15.77:0/317328389 >> v1:172.21.15.77:6789/0 conn(0x7fab5015d970 legacy=0x7fab5015de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.442+0000 7fab47fff640 1 -- 172.21.15.77:0/317328389 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 544976348 0 0) 0x7fab500d19d0 con 0x7fab5015d970 2024-05-15T12:10:27.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.443+0000 7fab555ec640 1 -- 172.21.15.77:0/317328389 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5006e720 con 0x7fab500d10b0 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.443+0000 7fab555ec640 1 --2- 172.21.15.77:0/317328389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab500d1490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0097a0 tx=0x7fab4c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d625861f1a7e0e1c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.443+0000 7fab47fff640 1 -- 172.21.15.77:0/317328389 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c037070 con 0x7fab500d10b0 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.443+0000 7fab47fff640 1 -- 172.21.15.77:0/317328389 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c032440 con 0x7fab500d10b0 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.443+0000 7fab47fff640 1 -- 172.21.15.77:0/317328389 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c032810 con 0x7fab500d10b0 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 -- 172.21.15.77:0/317328389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 msgr2=0x7fab500d1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 --2- 172.21.15.77:0/317328389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab500d1490 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab4c0097a0 tx=0x7fab4c02a180 comp rx=0 tx=0).stop 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 -- 172.21.15.77:0/317328389 shutdown_connections 2024-05-15T12:10:27.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 --2- 172.21.15.77:0/317328389 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab500d1490 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 -- 172.21.15.77:0/317328389 >> 172.21.15.77:0/317328389 conn(0x7fab5006c5d0 msgr2=0x7fab5006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 -- 172.21.15.77:0/317328389 shutdown_connections 2024-05-15T12:10:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.444+0000 7fab57850640 1 -- 172.21.15.77:0/317328389 wait complete. 2024-05-15T12:10:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.445+0000 7fab57850640 1 Processor -- start 2024-05-15T12:10:27.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.445+0000 7fab57850640 1 -- start start 2024-05-15T12:10:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab57850640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab500b44f0 0x7fab50153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab57850640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab50150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab57850640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab5015d970 0x7fab5013e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab57850640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab501543f0 con 0x7fab500d10b0 2024-05-15T12:10:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab57850640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fab5006ece0 con 0x7fab500b44f0 2024-05-15T12:10:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab57850640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fab500cf650 con 0x7fab5015d970 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab50150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab50150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35498/0 (socket says 172.21.15.77:35498) 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 -- 172.21.15.77:0/2363875262 learned_addr learned my addr 172.21.15.77:0/2363875262 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab555ec640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab500b44f0 0x7fab50153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 -- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab5015d970 msgr2=0x7fab5013e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab5015d970 0x7fab5013e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 -- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab500b44f0 msgr2=0x7fab50153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab500b44f0 0x7fab50153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 -- 172.21.15.77:0/2363875262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab50153b90 con 0x7fab500d10b0 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.446+0000 7fab54deb640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab50150fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c3a0 tx=0x7fab4000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.447+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab400074e0 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.447+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab400047e0 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.447+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab501f7550 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.447+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40004c10 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.447+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab50153130 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.448+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5006a640 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.448+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fab40011070 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.449+0000 7fab45ffb640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fab340762d0 0x7fab34078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.449+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fab40097130 con 0x7fab500d10b0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.449+0000 7fab555ec640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fab340762d0 0x7fab34078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.449+0000 7fab555ec640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fab340762d0 0x7fab34078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab4c034000 tx=0x7fab4c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:27.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.453+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fab40060b20 con 0x7fab500d10b0 2024-05-15T12:10:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:27.670+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fab50152a50 con 0x7fab500d10b0 2024-05-15T12:10:28.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.333+0000 7fab45ffb640 1 -- 172.21.15.77:0/2363875262 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) ==== 122+0+0 (secure 0 0 0) 0x7fab50152a50 con 0x7fab500d10b0 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fab340762d0 msgr2=0x7fab34078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fab340762d0 0x7fab34078790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab4c034000 tx=0x7fab4c02e000 comp rx=0 tx=0).stop 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 msgr2=0x7fab50150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab50150fa0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab4000c3a0 tx=0x7fab4000c860 comp rx=0 tx=0).stop 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 shutdown_connections 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fab340762d0 0x7fab34078790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fab5015d970 0x7fab5013e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab500d10b0 0x7fab50150fa0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 --2- 172.21.15.77:0/2363875262 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fab500b44f0 0x7fab50153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 >> 172.21.15.77:0/2363875262 conn(0x7fab5006c5d0 msgr2=0x7fab500b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 shutdown_connections 2024-05-15T12:10:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.336+0000 7fab57850640 1 -- 172.21.15.77:0/2363875262 wait complete. 2024-05-15T12:10:28.342 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-15T12:10:28.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:10:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.451+0000 7f437bf24640 1 Processor -- start 2024-05-15T12:10:28.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f437bf24640 1 -- start start 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f437bf24640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4374141e40 0x7f43740cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f437bf24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 0x7f4374072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f437bf24640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43740d0640 con 0x7f437413ee10 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f437bf24640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f43740d0920 con 0x7f4374141e40 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f437bf24640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f43740d0c00 con 0x7f43740cfdc0 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f4379cc0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f437413ee10 0x7f4374141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37350/0 (socket says 172.21.15.77:37350) 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.452+0000 7f4379cc0640 1 -- 172.21.15.77:0/2550958530 learned_addr learned my addr 172.21.15.77:0/2550958530 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f43794bf640 1 --2- 172.21.15.77:0/2550958530 >> v2:172.21.15.83:3300/0 conn(0x7f4374141e40 0x7f43740cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f437a4c1640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 0x7f4374072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838160325 0 0) 0x7f43740d0640 con 0x7f437413ee10 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f435c003520 con 0x7f437413ee10 2024-05-15T12:10:28.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1317259070 0 0) 0x7f435c003520 con 0x7f437413ee10 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 msgr2=0x7f4374072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 0x7f4374072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 >> v2:172.21.15.83:3300/0 conn(0x7f4374141e40 msgr2=0x7f43740cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 --2- 172.21.15.77:0/2550958530 >> v2:172.21.15.83:3300/0 conn(0x7f4374141e40 0x7f43740cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43740722a0 con 0x7f437413ee10 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f4364001a70 con 0x7f437413ee10 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 >> v1:172.21.15.77:6789/0 conn(0x7f437413ee10 legacy=0x7f4374141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435c003a70 0x7f435c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 0x7f435c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43740d0920 con 0x7f435c003a70 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f43740d0c00 con 0x7f435c004800 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f435c00ba70 con 0x7f43740cfdc0 2024-05-15T12:10:28.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f43794bf640 1 --2- 172.21.15.77:0/2550958530 >> v2:172.21.15.83:3300/0 conn(0x7f4374141e40 0x7f43740cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4379cc0640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435c003a70 0x7f435c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f437a4c1640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 0x7f435c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f43794bf640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4379cc0640 1 -- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 msgr2=0x7f435c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4379cc0640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f43740cfdc0 0x7f435c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4379cc0640 1 -- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f435c004800 msgr2=0x7f435c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4379cc0640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f4379cc0640 1 -- 172.21.15.77:0/2550958530 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f435c003520 con 0x7f435c003a70 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.453+0000 7f43794bf640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f435c004800 0x7f435c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.454+0000 7f4379cc0640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435c003a70 0x7f435c003e90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f436400a850 tx=0x7f435c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6227a252a7bfbe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.454+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436400a4a0 con 0x7f435c003a70 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.454+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436402f070 con 0x7f435c003a70 2024-05-15T12:10:28.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.454+0000 7f4378cbe640 1 -- 172.21.15.77:0/2550958530 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436402bc30 con 0x7f435c003a70 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437bf24640 1 -- 172.21.15.77:0/2550958530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435c003a70 msgr2=0x7f435c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437bf24640 1 --2- 172.21.15.77:0/2550958530 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435c003a70 0x7f435c003e90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f436400a850 tx=0x7f435c005830 comp rx=0 tx=0).stop 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437a4c1640 1 -- 172.21.15.77:0/2550958530 reap_dead start 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437bf24640 1 -- 172.21.15.77:0/2550958530 shutdown_connections 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437bf24640 1 -- 172.21.15.77:0/2550958530 >> 172.21.15.77:0/2550958530 conn(0x7f437406c810 msgr2=0x7f437406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437bf24640 1 -- 172.21.15.77:0/2550958530 shutdown_connections 2024-05-15T12:10:28.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.455+0000 7f437bf24640 1 -- 172.21.15.77:0/2550958530 wait complete. 2024-05-15T12:10:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.456+0000 7f437bf24640 1 Processor -- start 2024-05-15T12:10:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.456+0000 7f437bf24640 1 -- start start 2024-05-15T12:10:28.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4374140e00 0x7f43740aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 0x7f43740af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43741411e0 0x7f4374155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f43740d03d0 con 0x7f4374158530 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f43740d0250 con 0x7f43741411e0 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f437413f1f0 con 0x7f4374140e00 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 0x7f43740af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 0x7f43740af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35506/0 (socket says 172.21.15.77:35506) 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 -- 172.21.15.77:0/3554428594 learned_addr learned my addr 172.21.15.77:0/3554428594 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 -- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4374140e00 msgr2=0x7f43740aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4374140e00 0x7f43740aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437a4c1640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43741411e0 0x7f4374155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 -- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43741411e0 msgr2=0x7f4374155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43741411e0 0x7f4374155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 -- 172.21.15.77:0/3554428594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437406f300 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43794bf640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 0x7f43740af5f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4368010c00 tx=0x7f436800e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436800f040 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f436800ee50 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f437406f5e0 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.457+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436801c600 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.458+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f437406fba0 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.458+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f437406a640 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.459+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f436801c7a0 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.459+0000 7f43727fc640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f43600762d0 0x7f4360078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.460+0000 7f4379cc0640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f43600762d0 0x7f4360078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.460+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4368097d50 con 0x7f4374158530 2024-05-15T12:10:28.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.460+0000 7f4379cc0640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f43600762d0 0x7f4360078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4364033000 tx=0x7f436402d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:28.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.464+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f436809b030 con 0x7f4374158530 2024-05-15T12:10:28.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.679+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4374142490 con 0x7f4374158530 2024-05-15T12:10:28.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.680+0000 7f43727fc640 1 -- 172.21.15.77:0/3554428594 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5178 (secure 0 0 0) 0x7f4368018030 con 0x7f4374158530 2024-05-15T12:10:28.674 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:28.674 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:10:25.666896+0000","modified":"2024-05-15T12:10:27.671771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4863},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4863":{"gid":4863,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1303228576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1303228576},{"type":"v1","addr":"172.21.15.77:6837","nonce":1303228576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4863,"qdb_cluster":[4863]},"id":2}]} 2024-05-15T12:10:28.675 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-05-15T12:10:28.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f43600762d0 msgr2=0x7f4360078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f43600762d0 0x7f4360078790 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4364033000 tx=0x7f436402d000 comp rx=0 tx=0).stop 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 msgr2=0x7f43740af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 0x7f43740af5f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4368010c00 tx=0x7f436800e540 comp rx=0 tx=0).stop 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 shutdown_connections 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f43600762d0 0x7f4360078790 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f43741411e0 0x7f4374155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4374158530 0x7f43740af5f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 --2- 172.21.15.77:0/3554428594 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f4374140e00 0x7f43740aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 >> 172.21.15.77:0/3554428594 conn(0x7f437406c810 msgr2=0x7f437415ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 shutdown_connections 2024-05-15T12:10:28.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.682+0000 7f437bf24640 1 -- 172.21.15.77:0/3554428594 wait complete. 2024-05-15T12:10:28.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T12:10:28.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.792+0000 7fc34512b640 1 Processor -- start 2024-05-15T12:10:28.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.792+0000 7fc34512b640 1 -- start start 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc34512b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc340070e00 0x7fc340071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc34512b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc340143150 0x7fc3400d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc34512b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc340072210 con 0x7fc34015d520 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc34512b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc3400724f0 con 0x7fc340143150 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc34512b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc3400727d0 con 0x7fc340070e00 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc33ed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc34015d520 0x7fc3400706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37356/0 (socket says 172.21.15.77:37356) 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc33f59e640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc340143150 0x7fc3400d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc33ed9d640 1 -- 172.21.15.77:0/1947372633 learned_addr learned my addr 172.21.15.77:0/1947372633 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc33f59e640 1 -- 172.21.15.77:0/1947372633 >> v2:172.21.15.83:3300/0 conn(0x7fc340070e00 msgr2=0x7fc340071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.793+0000 7fc33e59c640 1 --2- 172.21.15.77:0/1947372633 >> v2:172.21.15.83:3300/0 conn(0x7fc340070e00 0x7fc340071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33dd9b640 1 -- 172.21.15.77:0/1947372633 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547441983 0 0) 0x7fc340072210 con 0x7fc34015d520 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33f59e640 1 --2- 172.21.15.77:0/1947372633 >> v2:172.21.15.83:3300/0 conn(0x7fc340070e00 0x7fc340071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33f59e640 1 -- 172.21.15.77:0/1947372633 >> v1:172.21.15.77:6789/0 conn(0x7fc34015d520 legacy=0x7fc3400706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33f59e640 1 -- 172.21.15.77:0/1947372633 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc340072ab0 con 0x7fc340143150 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33e59c640 1 --2- 172.21.15.77:0/1947372633 >> v2:172.21.15.83:3300/0 conn(0x7fc340070e00 0x7fc340071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33f59e640 1 --2- 172.21.15.77:0/1947372633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc3400d1ec0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc3400b2b60 tx=0x7fc33802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ab046ebab62a25 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33dd9b640 1 -- 172.21.15.77:0/1947372633 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338007740 con 0x7fc340143150 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33dd9b640 1 -- 172.21.15.77:0/1947372633 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3380078e0 con 0x7fc340143150 2024-05-15T12:10:28.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.794+0000 7fc33dd9b640 1 -- 172.21.15.77:0/1947372633 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338007cb0 con 0x7fc340143150 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 -- 172.21.15.77:0/1947372633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 msgr2=0x7fc3400d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 --2- 172.21.15.77:0/1947372633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc3400d1ec0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc3400b2b60 tx=0x7fc33802a680 comp rx=0 tx=0).stop 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 -- 172.21.15.77:0/1947372633 shutdown_connections 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 --2- 172.21.15.77:0/1947372633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc3400d1ec0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 --2- 172.21.15.77:0/1947372633 >> v2:172.21.15.83:3300/0 conn(0x7fc340070e00 0x7fc340071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 -- 172.21.15.77:0/1947372633 >> 172.21.15.77:0/1947372633 conn(0x7fc3400d2fd0 msgr2=0x7fc3400d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:28.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 -- 172.21.15.77:0/1947372633 shutdown_connections 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.795+0000 7fc34512b640 1 -- 172.21.15.77:0/1947372633 wait complete. 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.796+0000 7fc34512b640 1 Processor -- start 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 -- start start 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc340070e00 0x7fc34015a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc340161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc34015d520 0x7fc3401f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3400d18c0 con 0x7fc340143150 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc340143550 con 0x7fc340070e00 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc34512b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc3400d1a40 con 0x7fc34015d520 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc340161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc33e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc340161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35518/0 (socket says 172.21.15.77:35518) 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.797+0000 7fc33e59c640 1 -- 172.21.15.77:0/3274782067 learned_addr learned my addr 172.21.15.77:0/3274782067 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:28.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33ed9d640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc340070e00 0x7fc34015a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33f59e640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc34015d520 0x7fc3401f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33e59c640 1 -- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc34015d520 msgr2=0x7fc3401f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33e59c640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc34015d520 0x7fc3401f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33e59c640 1 -- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc340070e00 msgr2=0x7fc34015a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33e59c640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc340070e00 0x7fc34015a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33e59c640 1 -- 172.21.15.77:0/3274782067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3401f5210 con 0x7fc340143150 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33ed9d640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc340070e00 0x7fc34015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc33e59c640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc340161470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c7f0 tx=0x7fc33400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334015070 con 0x7fc340143150 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc334007a30 con 0x7fc340143150 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc334007e00 con 0x7fc340143150 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3401f5490 con 0x7fc340143150 2024-05-15T12:10:28.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.798+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3401f5a50 con 0x7fc340143150 2024-05-15T12:10:28.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.799+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34006d500 con 0x7fc340143150 2024-05-15T12:10:28.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.800+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc334018070 con 0x7fc340143150 2024-05-15T12:10:28.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.800+0000 7fc3277fe640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc32c0762d0 0x7fc32c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:28.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.800+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc334097560 con 0x7fc340143150 2024-05-15T12:10:28.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.800+0000 7fc33ed9d640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc32c0762d0 0x7fc32c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:28.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.801+0000 7fc33ed9d640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc32c0762d0 0x7fc32c078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc330000f60 tx=0x7fc330007cc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:28.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.805+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3401f5210 con 0x7fc340143150 2024-05-15T12:10:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.988+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc34006a640 con 0x7fc340143150 2024-05-15T12:10:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.989+0000 7fc3277fe640 1 -- 172.21.15.77:0/3274782067 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16537 (secure 0 0 0) 0x7fc334060ec0 con 0x7fc340143150 2024-05-15T12:10:28.984 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":32,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:10:27.319626+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:10:23.590791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T12:10:24.630314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc32c0762d0 msgr2=0x7fc32c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc32c0762d0 0x7fc32c078790 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc330000f60 tx=0x7fc330007cc0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 msgr2=0x7fc340161470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc340161470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc33400c7f0 tx=0x7fc33400ccb0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 shutdown_connections 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc32c0762d0 0x7fc32c078790 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc34015d520 0x7fc3401f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc340143150 0x7fc340161470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 --2- 172.21.15.77:0/3274782067 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc340070e00 0x7fc34015a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 >> 172.21.15.77:0/3274782067 conn(0x7fc3400d2fd0 msgr2=0x7fc340140ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 shutdown_connections 2024-05-15T12:10:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:28.991+0000 7fc34512b640 1 -- 172.21.15.77:0/3274782067 wait complete. 2024-05-15T12:10:28.997 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T12:10:28.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:10:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.103+0000 7efd7bcd3640 1 Processor -- start 2024-05-15T12:10:29.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.104+0000 7efd7bcd3640 1 -- start start 2024-05-15T12:10:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.104+0000 7efd7bcd3640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd7415e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.104+0000 7efd7bcd3640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd740d0170 0x7efd740d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.104+0000 7efd7bcd3640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd74071570 con 0x7efd740cf190 2024-05-15T12:10:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.104+0000 7efd7bcd3640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efd740d21b0 con 0x7efd740d0170 2024-05-15T12:10:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.104+0000 7efd7bcd3640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efd7415e680 con 0x7efd740b87c0 2024-05-15T12:10:29.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7a270640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efd740d0170 0x7efd740d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd79a6f640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd7415e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7926e640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7efd740cf190 0x7efd740cfa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:56872/0 (socket says 172.21.15.77:56872) 2024-05-15T12:10:29.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7926e640 1 -- 172.21.15.77:0/3872344204 learned_addr learned my addr 172.21.15.77:0/3872344204 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd78a6d640 1 -- 172.21.15.77:0/3872344204 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491622211 0 0) 0x7efd68001490 con 0x7efd740cf190 2024-05-15T12:10:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd78a6d640 1 -- 172.21.15.77:0/3872344204 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd5c003520 con 0x7efd740cf190 2024-05-15T12:10:29.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7a270640 1 -- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 msgr2=0x7efd7415e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7a270640 1 --2- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd7415e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7a270640 1 -- 172.21.15.77:0/3872344204 >> v1:172.21.15.83:6789/0 conn(0x7efd740cf190 legacy=0x7efd740cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd7a270640 1 -- 172.21.15.77:0/3872344204 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd740cf750 con 0x7efd740d0170 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.105+0000 7efd79a6f640 1 --2- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd7415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.106+0000 7efd7a270640 1 --2- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740d0170 0x7efd740d0c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd640097a0 tx=0x7efd6402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f13cf52d6d18f13d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.106+0000 7efd78a6d640 1 -- 172.21.15.77:0/3872344204 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64037070 con 0x7efd740d0170 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.106+0000 7efd78a6d640 1 -- 172.21.15.77:0/3872344204 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6402adb0 con 0x7efd740d0170 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.106+0000 7efd78a6d640 1 -- 172.21.15.77:0/3872344204 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64032640 con 0x7efd740d0170 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740d0170 msgr2=0x7efd740d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740d0170 0x7efd740d0c20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd640097a0 tx=0x7efd6402a060 comp rx=0 tx=0).stop 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3872344204 shutdown_connections 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740d0170 0x7efd740d0c20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3872344204 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd7415e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3872344204 >> 172.21.15.77:0/3872344204 conn(0x7efd740b4c40 msgr2=0x7efd740b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:29.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3872344204 shutdown_connections 2024-05-15T12:10:29.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.107+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3872344204 wait complete. 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.108+0000 7efd7bcd3640 1 Processor -- start 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.108+0000 7efd7bcd3640 1 -- start start 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7bcd3640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd741556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7bcd3640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740cf190 0x7efd741f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7bcd3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 0x7efd740b7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7bcd3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd740b8ba0 con 0x7efd740d0170 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7bcd3640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efd740cd980 con 0x7efd740cf190 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7bcd3640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efd740cdc60 con 0x7efd740b87c0 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 0x7efd740b7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 0x7efd740b7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35532/0 (socket says 172.21.15.77:35532) 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 -- 172.21.15.77:0/3439905732 learned_addr learned my addr 172.21.15.77:0/3439905732 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7926e640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740cf190 0x7efd741f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd79a6f640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd741556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 -- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 msgr2=0x7efd741556f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd741556f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 -- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740cf190 msgr2=0x7efd741f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740cf190 0x7efd741f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.109+0000 7efd7a270640 1 -- 172.21.15.77:0/3439905732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd74155db0 con 0x7efd740d0170 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.110+0000 7efd7a270640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 0x7efd740b7320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd640097a0 tx=0x7efd640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.110+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64041020 con 0x7efd740d0170 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.110+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd640044c0 con 0x7efd740d0170 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.110+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd74156090 con 0x7efd740d0170 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.110+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd64037040 con 0x7efd740d0170 2024-05-15T12:10:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.110+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd741530b0 con 0x7efd740d0170 2024-05-15T12:10:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.111+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd740694d0 con 0x7efd740d0170 2024-05-15T12:10:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.111+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efd64044020 con 0x7efd740d0170 2024-05-15T12:10:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.112+0000 7efd727fc640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd600762d0 0x7efd60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.112+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efd640b77f0 con 0x7efd740d0170 2024-05-15T12:10:29.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.112+0000 7efd79a6f640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd600762d0 0x7efd60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.112+0000 7efd79a6f640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd600762d0 0x7efd60078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009560 tx=0x7efd6c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.116+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efd6404b030 con 0x7efd740d0170 2024-05-15T12:10:29.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.292+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd740755d0 con 0x7efd600762d0 2024-05-15T12:10:29.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.297+0000 7efd727fc640 1 -- 172.21.15.77:0/3439905732 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243431 (secure 0 0 0) 0x7efd740755d0 con 0x7efd600762d0 2024-05-15T12:10:29.295 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:29.296 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:10:29.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd600762d0 msgr2=0x7efd60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd600762d0 0x7efd60078790 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009560 tx=0x7efd6c009190 comp rx=0 tx=0).stop 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 msgr2=0x7efd740b7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 0x7efd740b7320 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd640097a0 tx=0x7efd640046c0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 shutdown_connections 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efd600762d0 0x7efd60078790 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd740d0170 0x7efd740b7320 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efd740cf190 0x7efd741f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 --2- 172.21.15.77:0/3439905732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efd740b87c0 0x7efd741556f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 >> 172.21.15.77:0/3439905732 conn(0x7efd740b4c40 msgr2=0x7efd740b5020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 shutdown_connections 2024-05-15T12:10:29.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.300+0000 7efd7bcd3640 1 -- 172.21.15.77:0/3439905732 wait complete. 2024-05-15T12:10:29.306 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-15T12:10:28.251676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219840,"kb_used_data":3664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754880,"statfs":{"total":773094113280,"available":772868997120,"internally_reserved":0,"allocated":3751936,"data_stored":2135569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000650"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332398+0000","last_change":"2024-05-15T12:10:26.329573+0000","last_active":"2024-05-15T12:10:26.332398+0000","last_peered":"2024-05-15T12:10:26.332398+0000","last_clean":"2024-05-15T12:10:26.332398+0000","last_became_active":"2024-05-15T12:10:26.329332+0000","last_became_peered":"2024-05-15T12:10:26.329332+0000","last_unstale":"2024-05-15T12:10:26.332398+0000","last_undegraded":"2024-05-15T12:10:26.332398+0000","last_fullsized":"2024-05-15T12:10:26.332398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:07.846452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313778+0000","last_change":"2024-05-15T12:10:25.313778+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313778+0000","last_undegraded":"2024-05-15T12:10:25.313778+0000","last_fullsized":"2024-05-15T12:10:25.313778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313869+0000","last_change":"2024-05-15T12:10:25.313869+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313869+0000","last_undegraded":"2024-05-15T12:10:25.313869+0000","last_fullsized":"2024-05-15T12:10:25.313869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334740+0000","last_change":"2024-05-15T12:10:26.331862+0000","last_active":"2024-05-15T12:10:26.334740+0000","last_peered":"2024-05-15T12:10:26.334740+0000","last_clean":"2024-05-15T12:10:26.334740+0000","last_became_active":"2024-05-15T12:10:26.331594+0000","last_became_peered":"2024-05-15T12:10:26.331594+0000","last_unstale":"2024-05-15T12:10:26.334740+0000","last_undegraded":"2024-05-15T12:10:26.334740+0000","last_fullsized":"2024-05-15T12:10:26.334740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:09.360516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.336854+0000","last_change":"2024-05-15T12:10:26.334487+0000","last_active":"2024-05-15T12:10:26.336854+0000","last_peered":"2024-05-15T12:10:26.336854+0000","last_clean":"2024-05-15T12:10:26.336854+0000","last_became_active":"2024-05-15T12:10:26.334107+0000","last_became_peered":"2024-05-15T12:10:26.334107+0000","last_unstale":"2024-05-15T12:10:26.336854+0000","last_undegraded":"2024-05-15T12:10:26.336854+0000","last_fullsized":"2024-05-15T12:10:26.336854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:20:30.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316030+0000","last_change":"2024-05-15T12:10:25.316030+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316030+0000","last_undegraded":"2024-05-15T12:10:25.316030+0000","last_fullsized":"2024-05-15T12:10:25.316030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315396+0000","last_change":"2024-05-15T12:10:25.315396+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315396+0000","last_undegraded":"2024-05-15T12:10:25.315396+0000","last_fullsized":"2024-05-15T12:10:25.315396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340180+0000","last_change":"2024-05-15T12:10:26.338780+0000","last_active":"2024-05-15T12:10:26.340180+0000","last_peered":"2024-05-15T12:10:26.340180+0000","last_clean":"2024-05-15T12:10:26.340180+0000","last_became_active":"2024-05-15T12:10:26.338184+0000","last_became_peered":"2024-05-15T12:10:26.338184+0000","last_unstale":"2024-05-15T12:10:26.340180+0000","last_undegraded":"2024-05-15T12:10:26.340180+0000","last_fullsized":"2024-05-15T12:10:26.340180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:47.781617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313834+0000","last_change":"2024-05-15T12:10:25.313834+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313834+0000","last_undegraded":"2024-05-15T12:10:25.313834+0000","last_fullsized":"2024-05-15T12:10:25.313834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.341197+0000","last_change":"2024-05-15T12:10:26.339432+0000","last_active":"2024-05-15T12:10:26.341197+0000","last_peered":"2024-05-15T12:10:26.341197+0000","last_clean":"2024-05-15T12:10:26.341197+0000","last_became_active":"2024-05-15T12:10:26.339178+0000","last_became_peered":"2024-05-15T12:10:26.339178+0000","last_unstale":"2024-05-15T12:10:26.341197+0000","last_undegraded":"2024-05-15T12:10:26.341197+0000","last_fullsized":"2024-05-15T12:10:26.341197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:30.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.311771+0000","last_change":"2024-05-15T12:10:25.311771+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.311771+0000","last_undegraded":"2024-05-15T12:10:25.311771+0000","last_fullsized":"2024-05-15T12:10:25.311771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334850+0000","last_change":"2024-05-15T12:10:26.333520+0000","last_active":"2024-05-15T12:10:26.334850+0000","last_peered":"2024-05-15T12:10:26.334850+0000","last_clean":"2024-05-15T12:10:26.334850+0000","last_became_active":"2024-05-15T12:10:26.333272+0000","last_became_peered":"2024-05-15T12:10:26.333272+0000","last_unstale":"2024-05-15T12:10:26.334850+0000","last_undegraded":"2024-05-15T12:10:26.334850+0000","last_fullsized":"2024-05-15T12:10:26.334850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:13.980419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334847+0000","last_change":"2024-05-15T12:10:26.333175+0000","last_active":"2024-05-15T12:10:26.334847+0000","last_peered":"2024-05-15T12:10:26.334847+0000","last_clean":"2024-05-15T12:10:26.334847+0000","last_became_active":"2024-05-15T12:10:26.332897+0000","last_became_peered":"2024-05-15T12:10:26.332897+0000","last_unstale":"2024-05-15T12:10:26.334847+0000","last_undegraded":"2024-05-15T12:10:26.334847+0000","last_fullsized":"2024-05-15T12:10:26.334847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:27.674677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315283+0000","last_change":"2024-05-15T12:10:25.315283+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315283+0000","last_undegraded":"2024-05-15T12:10:25.315283+0000","last_fullsized":"2024-05-15T12:10:25.315283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307912+0000","last_change":"2024-05-15T12:10:24.307912+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307912+0000","last_undegraded":"2024-05-15T12:10:24.307912+0000","last_fullsized":"2024-05-15T12:10:24.307912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332193+0000","last_change":"2024-05-15T12:10:26.328020+0000","last_active":"2024-05-15T12:10:26.332193+0000","last_peered":"2024-05-15T12:10:26.332193+0000","last_clean":"2024-05-15T12:10:26.332193+0000","last_became_active":"2024-05-15T12:10:26.326527+0000","last_became_peered":"2024-05-15T12:10:26.326527+0000","last_unstale":"2024-05-15T12:10:26.332193+0000","last_undegraded":"2024-05-15T12:10:26.332193+0000","last_fullsized":"2024-05-15T12:10:26.332193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:35.506570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340319+0000","last_change":"2024-05-15T12:10:26.339019+0000","last_active":"2024-05-15T12:10:26.340319+0000","last_peered":"2024-05-15T12:10:26.340319+0000","last_clean":"2024-05-15T12:10:26.340319+0000","last_became_active":"2024-05-15T12:10:26.338742+0000","last_became_peered":"2024-05-15T12:10:26.338742+0000","last_unstale":"2024-05-15T12:10:26.340319+0000","last_undegraded":"2024-05-15T12:10:26.340319+0000","last_fullsized":"2024-05-15T12:10:26.340319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:56.628690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315398+0000","last_change":"2024-05-15T12:10:24.315398+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315398+0000","last_undegraded":"2024-05-15T12:10:24.315398+0000","last_fullsized":"2024-05-15T12:10:24.315398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.338937+0000","last_change":"2024-05-15T12:10:25.321915+0000","last_active":"2024-05-15T12:10:26.338937+0000","last_peered":"2024-05-15T12:10:26.338937+0000","last_clean":"2024-05-15T12:10:26.338937+0000","last_became_active":"2024-05-15T12:10:25.321660+0000","last_became_peered":"2024-05-15T12:10:25.321660+0000","last_unstale":"2024-05-15T12:10:26.338937+0000","last_undegraded":"2024-05-15T12:10:26.338937+0000","last_fullsized":"2024-05-15T12:10:26.338937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:29.785965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334782+0000","last_change":"2024-05-15T12:10:26.331978+0000","last_active":"2024-05-15T12:10:26.334782+0000","last_peered":"2024-05-15T12:10:26.334782+0000","last_clean":"2024-05-15T12:10:26.334782+0000","last_became_active":"2024-05-15T12:10:26.331123+0000","last_became_peered":"2024-05-15T12:10:26.331123+0000","last_unstale":"2024-05-15T12:10:26.334782+0000","last_undegraded":"2024-05-15T12:10:26.334782+0000","last_fullsized":"2024-05-15T12:10:26.334782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:39.341123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340630+0000","last_change":"2024-05-15T12:10:25.318361+0000","last_active":"2024-05-15T12:10:26.340630+0000","last_peered":"2024-05-15T12:10:26.340630+0000","last_clean":"2024-05-15T12:10:26.340630+0000","last_became_active":"2024-05-15T12:10:25.318086+0000","last_became_peered":"2024-05-15T12:10:25.318086+0000","last_unstale":"2024-05-15T12:10:26.340630+0000","last_undegraded":"2024-05-15T12:10:26.340630+0000","last_fullsized":"2024-05-15T12:10:26.340630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:59.680962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315368+0000","last_change":"2024-05-15T12:10:24.315368+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315368+0000","last_undegraded":"2024-05-15T12:10:24.315368+0000","last_fullsized":"2024-05-15T12:10:24.315368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320866+0000","last_change":"2024-05-15T12:10:25.324046+0000","last_active":"2024-05-15T12:10:26.320866+0000","last_peered":"2024-05-15T12:10:26.320866+0000","last_clean":"2024-05-15T12:10:26.320866+0000","last_became_active":"2024-05-15T12:10:25.323741+0000","last_became_peered":"2024-05-15T12:10:25.323741+0000","last_unstale":"2024-05-15T12:10:26.320866+0000","last_undegraded":"2024-05-15T12:10:26.320866+0000","last_fullsized":"2024-05-15T12:10:26.320866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320860+0000","last_change":"2024-05-15T12:10:25.318998+0000","last_active":"2024-05-15T12:10:25.320860+0000","last_peered":"2024-05-15T12:10:25.320860+0000","last_clean":"2024-05-15T12:10:25.320860+0000","last_became_active":"2024-05-15T12:10:25.318702+0000","last_became_peered":"2024-05-15T12:10:25.318702+0000","last_unstale":"2024-05-15T12:10:25.320860+0000","last_undegraded":"2024-05-15T12:10:25.320860+0000","last_fullsized":"2024-05-15T12:10:25.320860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334099+0000","last_change":"2024-05-15T12:10:25.326922+0000","last_active":"2024-05-15T12:10:25.334099+0000","last_peered":"2024-05-15T12:10:25.334099+0000","last_clean":"2024-05-15T12:10:25.334099+0000","last_became_active":"2024-05-15T12:10:25.326654+0000","last_became_peered":"2024-05-15T12:10:25.326654+0000","last_unstale":"2024-05-15T12:10:25.334099+0000","last_undegraded":"2024-05-15T12:10:25.334099+0000","last_fullsized":"2024-05-15T12:10:25.334099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:06.836661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308403+0000","last_change":"2024-05-15T12:10:24.308403+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308403+0000","last_undegraded":"2024-05-15T12:10:24.308403+0000","last_fullsized":"2024-05-15T12:10:24.308403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333858+0000","last_change":"2024-05-15T12:10:25.326873+0000","last_active":"2024-05-15T12:10:25.333858+0000","last_peered":"2024-05-15T12:10:25.333858+0000","last_clean":"2024-05-15T12:10:25.333858+0000","last_became_active":"2024-05-15T12:10:25.326527+0000","last_became_peered":"2024-05-15T12:10:25.326527+0000","last_unstale":"2024-05-15T12:10:25.333858+0000","last_undegraded":"2024-05-15T12:10:25.333858+0000","last_fullsized":"2024-05-15T12:10:25.333858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316633+0000","last_change":"2024-05-15T12:10:25.316633+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316633+0000","last_undegraded":"2024-05-15T12:10:25.316633+0000","last_fullsized":"2024-05-15T12:10:25.316633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342398+0000","last_change":"2024-05-15T12:10:25.324206+0000","last_active":"2024-05-15T12:10:26.342398+0000","last_peered":"2024-05-15T12:10:26.342398+0000","last_clean":"2024-05-15T12:10:26.342398+0000","last_became_active":"2024-05-15T12:10:25.323870+0000","last_became_peered":"2024-05-15T12:10:25.323870+0000","last_unstale":"2024-05-15T12:10:26.342398+0000","last_undegraded":"2024-05-15T12:10:26.342398+0000","last_fullsized":"2024-05-15T12:10:26.342398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307773+0000","last_change":"2024-05-15T12:10:24.307773+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307773+0000","last_undegraded":"2024-05-15T12:10:24.307773+0000","last_fullsized":"2024-05-15T12:10:24.307773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334677+0000","last_change":"2024-05-15T12:10:26.331819+0000","last_active":"2024-05-15T12:10:26.334677+0000","last_peered":"2024-05-15T12:10:26.334677+0000","last_clean":"2024-05-15T12:10:26.334677+0000","last_became_active":"2024-05-15T12:10:26.331530+0000","last_became_peered":"2024-05-15T12:10:26.331530+0000","last_unstale":"2024-05-15T12:10:26.334677+0000","last_undegraded":"2024-05-15T12:10:26.334677+0000","last_fullsized":"2024-05-15T12:10:26.334677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:35.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307859+0000","last_change":"2024-05-15T12:10:24.307859+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307859+0000","last_undegraded":"2024-05-15T12:10:24.307859+0000","last_fullsized":"2024-05-15T12:10:24.307859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315335+0000","last_change":"2024-05-15T12:10:24.315335+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315335+0000","last_undegraded":"2024-05-15T12:10:24.315335+0000","last_fullsized":"2024-05-15T12:10:24.315335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315411+0000","last_change":"2024-05-15T12:10:24.315411+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315411+0000","last_undegraded":"2024-05-15T12:10:24.315411+0000","last_fullsized":"2024-05-15T12:10:24.315411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342495+0000","last_change":"2024-05-15T12:10:25.324285+0000","last_active":"2024-05-15T12:10:26.342495+0000","last_peered":"2024-05-15T12:10:26.342495+0000","last_clean":"2024-05-15T12:10:26.342495+0000","last_became_active":"2024-05-15T12:10:25.323952+0000","last_became_peered":"2024-05-15T12:10:25.323952+0000","last_unstale":"2024-05-15T12:10:26.342495+0000","last_undegraded":"2024-05-15T12:10:26.342495+0000","last_fullsized":"2024-05-15T12:10:26.342495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:55.449668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312240+0000","last_change":"2024-05-15T12:10:25.312240+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312240+0000","last_undegraded":"2024-05-15T12:10:25.312240+0000","last_fullsized":"2024-05-15T12:10:25.312240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308942+0000","last_change":"2024-05-15T12:10:24.308942+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308942+0000","last_undegraded":"2024-05-15T12:10:24.308942+0000","last_fullsized":"2024-05-15T12:10:24.308942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:24.293030+0000","last_change":"2024-05-15T12:10:24.293030+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.293030+0000","last_undegraded":"2024-05-15T12:10:24.293030+0000","last_fullsized":"2024-05-15T12:10:24.293030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315023+0000","last_change":"2024-05-15T12:10:25.315023+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315023+0000","last_undegraded":"2024-05-15T12:10:25.315023+0000","last_fullsized":"2024-05-15T12:10:25.315023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326674+0000","last_change":"2024-05-15T12:10:25.324499+0000","last_active":"2024-05-15T12:10:25.326674+0000","last_peered":"2024-05-15T12:10:25.326674+0000","last_clean":"2024-05-15T12:10:25.326674+0000","last_became_active":"2024-05-15T12:10:25.324221+0000","last_became_peered":"2024-05-15T12:10:25.324221+0000","last_unstale":"2024-05-15T12:10:25.326674+0000","last_undegraded":"2024-05-15T12:10:25.326674+0000","last_fullsized":"2024-05-15T12:10:25.326674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:34.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312508+0000","last_change":"2024-05-15T12:10:25.312508+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312508+0000","last_undegraded":"2024-05-15T12:10:25.312508+0000","last_fullsized":"2024-05-15T12:10:25.312508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.323806+0000","last_change":"2024-05-15T12:10:25.324364+0000","last_active":"2024-05-15T12:10:26.323806+0000","last_peered":"2024-05-15T12:10:26.323806+0000","last_clean":"2024-05-15T12:10:26.323806+0000","last_became_active":"2024-05-15T12:10:25.324098+0000","last_became_peered":"2024-05-15T12:10:25.324098+0000","last_unstale":"2024-05-15T12:10:26.323806+0000","last_undegraded":"2024-05-15T12:10:26.323806+0000","last_fullsized":"2024-05-15T12:10:26.323806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:41.292334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313779+0000","last_change":"2024-05-15T12:10:25.313779+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313779+0000","last_undegraded":"2024-05-15T12:10:25.313779+0000","last_fullsized":"2024-05-15T12:10:25.313779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308561+0000","last_change":"2024-05-15T12:10:24.308561+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308561+0000","last_undegraded":"2024-05-15T12:10:24.308561+0000","last_fullsized":"2024-05-15T12:10:24.308561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307884+0000","last_change":"2024-05-15T12:10:24.307884+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307884+0000","last_undegraded":"2024-05-15T12:10:24.307884+0000","last_fullsized":"2024-05-15T12:10:24.307884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.325565+0000","last_change":"2024-05-15T12:10:25.323229+0000","last_active":"2024-05-15T12:10:25.325565+0000","last_peered":"2024-05-15T12:10:25.325565+0000","last_clean":"2024-05-15T12:10:25.325565+0000","last_became_active":"2024-05-15T12:10:25.322944+0000","last_became_peered":"2024-05-15T12:10:25.322944+0000","last_unstale":"2024-05-15T12:10:25.325565+0000","last_undegraded":"2024-05-15T12:10:25.325565+0000","last_fullsized":"2024-05-15T12:10:25.325565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:34.310936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334124+0000","last_change":"2024-05-15T12:10:25.327726+0000","last_active":"2024-05-15T12:10:25.334124+0000","last_peered":"2024-05-15T12:10:25.334124+0000","last_clean":"2024-05-15T12:10:25.334124+0000","last_became_active":"2024-05-15T12:10:25.327459+0000","last_became_peered":"2024-05-15T12:10:25.327459+0000","last_unstale":"2024-05-15T12:10:25.334124+0000","last_undegraded":"2024-05-15T12:10:25.334124+0000","last_fullsized":"2024-05-15T12:10:25.334124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:34.862252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333880+0000","last_change":"2024-05-15T12:10:25.327309+0000","last_active":"2024-05-15T12:10:25.333880+0000","last_peered":"2024-05-15T12:10:25.333880+0000","last_clean":"2024-05-15T12:10:25.333880+0000","last_became_active":"2024-05-15T12:10:25.326869+0000","last_became_peered":"2024-05-15T12:10:25.326869+0000","last_unstale":"2024-05-15T12:10:25.333880+0000","last_undegraded":"2024-05-15T12:10:25.333880+0000","last_fullsized":"2024-05-15T12:10:25.333880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320386+0000","last_change":"2024-05-15T12:10:25.318831+0000","last_active":"2024-05-15T12:10:25.320386+0000","last_peered":"2024-05-15T12:10:25.320386+0000","last_clean":"2024-05-15T12:10:25.320386+0000","last_became_active":"2024-05-15T12:10:25.318544+0000","last_became_peered":"2024-05-15T12:10:25.318544+0000","last_unstale":"2024-05-15T12:10:25.320386+0000","last_undegraded":"2024-05-15T12:10:25.320386+0000","last_fullsized":"2024-05-15T12:10:25.320386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:58.938296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326925+0000","last_change":"2024-05-15T12:10:25.324125+0000","last_active":"2024-05-15T12:10:25.326925+0000","last_peered":"2024-05-15T12:10:25.326925+0000","last_clean":"2024-05-15T12:10:25.326925+0000","last_became_active":"2024-05-15T12:10:25.323807+0000","last_became_peered":"2024-05-15T12:10:25.323807+0000","last_unstale":"2024-05-15T12:10:25.326925+0000","last_undegraded":"2024-05-15T12:10:25.326925+0000","last_fullsized":"2024-05-15T12:10:25.326925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:55.968122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320323+0000","last_change":"2024-05-15T12:10:25.324301+0000","last_active":"2024-05-15T12:10:26.320323+0000","last_peered":"2024-05-15T12:10:26.320323+0000","last_clean":"2024-05-15T12:10:26.320323+0000","last_became_active":"2024-05-15T12:10:25.323891+0000","last_became_peered":"2024-05-15T12:10:25.323891+0000","last_unstale":"2024-05-15T12:10:26.320323+0000","last_undegraded":"2024-05-15T12:10:26.320323+0000","last_fullsized":"2024-05-15T12:10:26.320323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307762+0000","last_change":"2024-05-15T12:10:24.307762+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307762+0000","last_undegraded":"2024-05-15T12:10:24.307762+0000","last_fullsized":"2024-05-15T12:10:24.307762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307892+0000","last_change":"2024-05-15T12:10:24.307892+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307892+0000","last_undegraded":"2024-05-15T12:10:24.307892+0000","last_fullsized":"2024-05-15T12:10:24.307892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T12:10:24.306876+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:10:24.306876+0000","last_peered":"2024-05-15T12:10:24.306876+0000","last_clean":"2024-05-15T12:10:24.306876+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:10:24.306876+0000","last_undegraded":"2024-05-15T12:10:24.306876+0000","last_fullsized":"2024-05-15T12:10:24.306876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":62,"acting":62,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":123152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":707245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":111060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:10:29.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:10:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.452+0000 7efc05b33640 1 Processor -- start 2024-05-15T12:10:29.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.453+0000 7efc05b33640 1 -- start start 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.453+0000 7efc05b33640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7efc0013ee10 0x7efc00141730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.453+0000 7efc05b33640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc00141c70 0x7efc000cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.453+0000 7efc05b33640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc000d0640 con 0x7efc000cfdc0 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.453+0000 7efc05b33640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7efc000d0920 con 0x7efc00141c70 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.453+0000 7efc05b33640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7efc000d0c00 con 0x7efc0013ee10 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc00141c70 0x7efc000cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc00141c70 0x7efc000cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35538/0 (socket says 172.21.15.77:35538) 2024-05-15T12:10:29.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 -- 172.21.15.77:0/48233209 learned_addr learned my addr 172.21.15.77:0/48233209 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbff7fe640 1 --2- 172.21.15.77:0/48233209 >> v2:172.21.15.83:3300/0 conn(0x7efc0013ee10 0x7efc00141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 -- 172.21.15.77:0/48233209 >> v2:172.21.15.83:3300/0 conn(0x7efc0013ee10 msgr2=0x7efc00141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 --2- 172.21.15.77:0/48233209 >> v2:172.21.15.83:3300/0 conn(0x7efc0013ee10 0x7efc00141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 -- 172.21.15.77:0/48233209 >> v1:172.21.15.83:6789/0 conn(0x7efc000cfdc0 legacy=0x7efc0015fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.454+0000 7efbfeffd640 1 -- 172.21.15.77:0/48233209 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc000722a0 con 0x7efc00141c70 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efbfeffd640 1 --2- 172.21.15.77:0/48233209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc000cf880 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc00070230 tx=0x7efbe802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2debe421fbee0a3b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efbfe7fc640 1 -- 172.21.15.77:0/48233209 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8032790 con 0x7efc00141c70 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efbfe7fc640 1 -- 172.21.15.77:0/48233209 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbe8038070 con 0x7efc00141c70 2024-05-15T12:10:29.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efbfe7fc640 1 -- 172.21.15.77:0/48233209 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbe8032b50 con 0x7efc00141c70 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 -- 172.21.15.77:0/48233209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 msgr2=0x7efc000cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 --2- 172.21.15.77:0/48233209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc000cf880 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc00070230 tx=0x7efbe802c890 comp rx=0 tx=0).stop 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 -- 172.21.15.77:0/48233209 shutdown_connections 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 --2- 172.21.15.77:0/48233209 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc000cf880 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 --2- 172.21.15.77:0/48233209 >> v2:172.21.15.83:3300/0 conn(0x7efc0013ee10 0x7efc00141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 -- 172.21.15.77:0/48233209 >> 172.21.15.77:0/48233209 conn(0x7efc0006c810 msgr2=0x7efc0006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 -- 172.21.15.77:0/48233209 shutdown_connections 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.455+0000 7efc05b33640 1 -- 172.21.15.77:0/48233209 wait complete. 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.456+0000 7efc05b33640 1 Processor -- start 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 -- start start 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc000cfdc0 0x7efc000b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc0013ee10 0x7efc00155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc001560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efc000d03d0 con 0x7efc00141c70 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7efc000d0250 con 0x7efc0013ee10 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.457+0000 7efc05b33640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7efc0013f1f0 con 0x7efc000cfdc0 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc001560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc001560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35550/0 (socket says 172.21.15.77:35550) 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 -- 172.21.15.77:0/1441691798 learned_addr learned my addr 172.21.15.77:0/1441691798 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfeffd640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc0013ee10 0x7efc00155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbff7fe640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc000cfdc0 0x7efc000b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 -- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc000cfdc0 msgr2=0x7efc000b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc000cfdc0 0x7efc000b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 -- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc0013ee10 msgr2=0x7efc00155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc0013ee10 0x7efc00155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 -- 172.21.15.77:0/1441691798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc001f4650 con 0x7efc00141c70 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbfffff640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc001560e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efbf800b970 tx=0x7efbf800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8019070 con 0x7efc00141c70 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf800cb40 con 0x7efc00141c70 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc001f4930 con 0x7efc00141c70 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf8014440 con 0x7efc00141c70 2024-05-15T12:10:29.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.458+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc00157b20 con 0x7efc00141c70 2024-05-15T12:10:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.459+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0006a640 con 0x7efc00141c70 2024-05-15T12:10:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.460+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efbf801c070 con 0x7efc00141c70 2024-05-15T12:10:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.460+0000 7efbf7fff640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efbe00762d0 0x7efbe0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.460+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efbf8097250 con 0x7efc00141c70 2024-05-15T12:10:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.460+0000 7efbff7fe640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efbe00762d0 0x7efbe0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.461+0000 7efbff7fe640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efbe00762d0 0x7efbe0078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efbf0006fd0 tx=0x7efbf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.465+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efbf8060bb0 con 0x7efc00141c70 2024-05-15T12:10:29.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.642+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efc00142490 con 0x7efbe00762d0 2024-05-15T12:10:29.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.647+0000 7efbf7fff640 1 -- 172.21.15.77:0/1441691798 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243431 (secure 0 0 0) 0x7efc00142490 con 0x7efbe00762d0 2024-05-15T12:10:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:29.645 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:10:29.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efbe00762d0 msgr2=0x7efbe0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efbe00762d0 0x7efbe0078790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efbf0006fd0 tx=0x7efbf0008040 comp rx=0 tx=0).stop 2024-05-15T12:10:29.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 msgr2=0x7efc001560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc001560e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7efbf800b970 tx=0x7efbf800be30 comp rx=0 tx=0).stop 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 shutdown_connections 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7efbe00762d0 0x7efbe0078790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc00141c70 0x7efc001560e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7efc0013ee10 0x7efc00155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 --2- 172.21.15.77:0/1441691798 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7efc000cfdc0 0x7efc000b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 >> 172.21.15.77:0/1441691798 conn(0x7efc0006c810 msgr2=0x7efc0015b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 shutdown_connections 2024-05-15T12:10:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.651+0000 7efc05b33640 1 -- 172.21.15.77:0/1441691798 wait complete. 2024-05-15T12:10:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-15T12:10:28.251676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219840,"kb_used_data":3664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754880,"statfs":{"total":773094113280,"available":772868997120,"internally_reserved":0,"allocated":3751936,"data_stored":2135569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000650"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332398+0000","last_change":"2024-05-15T12:10:26.329573+0000","last_active":"2024-05-15T12:10:26.332398+0000","last_peered":"2024-05-15T12:10:26.332398+0000","last_clean":"2024-05-15T12:10:26.332398+0000","last_became_active":"2024-05-15T12:10:26.329332+0000","last_became_peered":"2024-05-15T12:10:26.329332+0000","last_unstale":"2024-05-15T12:10:26.332398+0000","last_undegraded":"2024-05-15T12:10:26.332398+0000","last_fullsized":"2024-05-15T12:10:26.332398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:07.846452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313778+0000","last_change":"2024-05-15T12:10:25.313778+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313778+0000","last_undegraded":"2024-05-15T12:10:25.313778+0000","last_fullsized":"2024-05-15T12:10:25.313778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313869+0000","last_change":"2024-05-15T12:10:25.313869+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313869+0000","last_undegraded":"2024-05-15T12:10:25.313869+0000","last_fullsized":"2024-05-15T12:10:25.313869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334740+0000","last_change":"2024-05-15T12:10:26.331862+0000","last_active":"2024-05-15T12:10:26.334740+0000","last_peered":"2024-05-15T12:10:26.334740+0000","last_clean":"2024-05-15T12:10:26.334740+0000","last_became_active":"2024-05-15T12:10:26.331594+0000","last_became_peered":"2024-05-15T12:10:26.331594+0000","last_unstale":"2024-05-15T12:10:26.334740+0000","last_undegraded":"2024-05-15T12:10:26.334740+0000","last_fullsized":"2024-05-15T12:10:26.334740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:09.360516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.336854+0000","last_change":"2024-05-15T12:10:26.334487+0000","last_active":"2024-05-15T12:10:26.336854+0000","last_peered":"2024-05-15T12:10:26.336854+0000","last_clean":"2024-05-15T12:10:26.336854+0000","last_became_active":"2024-05-15T12:10:26.334107+0000","last_became_peered":"2024-05-15T12:10:26.334107+0000","last_unstale":"2024-05-15T12:10:26.336854+0000","last_undegraded":"2024-05-15T12:10:26.336854+0000","last_fullsized":"2024-05-15T12:10:26.336854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:20:30.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316030+0000","last_change":"2024-05-15T12:10:25.316030+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316030+0000","last_undegraded":"2024-05-15T12:10:25.316030+0000","last_fullsized":"2024-05-15T12:10:25.316030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315396+0000","last_change":"2024-05-15T12:10:25.315396+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315396+0000","last_undegraded":"2024-05-15T12:10:25.315396+0000","last_fullsized":"2024-05-15T12:10:25.315396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340180+0000","last_change":"2024-05-15T12:10:26.338780+0000","last_active":"2024-05-15T12:10:26.340180+0000","last_peered":"2024-05-15T12:10:26.340180+0000","last_clean":"2024-05-15T12:10:26.340180+0000","last_became_active":"2024-05-15T12:10:26.338184+0000","last_became_peered":"2024-05-15T12:10:26.338184+0000","last_unstale":"2024-05-15T12:10:26.340180+0000","last_undegraded":"2024-05-15T12:10:26.340180+0000","last_fullsized":"2024-05-15T12:10:26.340180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:47.781617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313834+0000","last_change":"2024-05-15T12:10:25.313834+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313834+0000","last_undegraded":"2024-05-15T12:10:25.313834+0000","last_fullsized":"2024-05-15T12:10:25.313834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.341197+0000","last_change":"2024-05-15T12:10:26.339432+0000","last_active":"2024-05-15T12:10:26.341197+0000","last_peered":"2024-05-15T12:10:26.341197+0000","last_clean":"2024-05-15T12:10:26.341197+0000","last_became_active":"2024-05-15T12:10:26.339178+0000","last_became_peered":"2024-05-15T12:10:26.339178+0000","last_unstale":"2024-05-15T12:10:26.341197+0000","last_undegraded":"2024-05-15T12:10:26.341197+0000","last_fullsized":"2024-05-15T12:10:26.341197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:30.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.311771+0000","last_change":"2024-05-15T12:10:25.311771+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.311771+0000","last_undegraded":"2024-05-15T12:10:25.311771+0000","last_fullsized":"2024-05-15T12:10:25.311771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334850+0000","last_change":"2024-05-15T12:10:26.333520+0000","last_active":"2024-05-15T12:10:26.334850+0000","last_peered":"2024-05-15T12:10:26.334850+0000","last_clean":"2024-05-15T12:10:26.334850+0000","last_became_active":"2024-05-15T12:10:26.333272+0000","last_became_peered":"2024-05-15T12:10:26.333272+0000","last_unstale":"2024-05-15T12:10:26.334850+0000","last_undegraded":"2024-05-15T12:10:26.334850+0000","last_fullsized":"2024-05-15T12:10:26.334850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:13.980419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334847+0000","last_change":"2024-05-15T12:10:26.333175+0000","last_active":"2024-05-15T12:10:26.334847+0000","last_peered":"2024-05-15T12:10:26.334847+0000","last_clean":"2024-05-15T12:10:26.334847+0000","last_became_active":"2024-05-15T12:10:26.332897+0000","last_became_peered":"2024-05-15T12:10:26.332897+0000","last_unstale":"2024-05-15T12:10:26.334847+0000","last_undegraded":"2024-05-15T12:10:26.334847+0000","last_fullsized":"2024-05-15T12:10:26.334847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:27.674677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315283+0000","last_change":"2024-05-15T12:10:25.315283+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315283+0000","last_undegraded":"2024-05-15T12:10:25.315283+0000","last_fullsized":"2024-05-15T12:10:25.315283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307912+0000","last_change":"2024-05-15T12:10:24.307912+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307912+0000","last_undegraded":"2024-05-15T12:10:24.307912+0000","last_fullsized":"2024-05-15T12:10:24.307912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332193+0000","last_change":"2024-05-15T12:10:26.328020+0000","last_active":"2024-05-15T12:10:26.332193+0000","last_peered":"2024-05-15T12:10:26.332193+0000","last_clean":"2024-05-15T12:10:26.332193+0000","last_became_active":"2024-05-15T12:10:26.326527+0000","last_became_peered":"2024-05-15T12:10:26.326527+0000","last_unstale":"2024-05-15T12:10:26.332193+0000","last_undegraded":"2024-05-15T12:10:26.332193+0000","last_fullsized":"2024-05-15T12:10:26.332193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:35.506570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340319+0000","last_change":"2024-05-15T12:10:26.339019+0000","last_active":"2024-05-15T12:10:26.340319+0000","last_peered":"2024-05-15T12:10:26.340319+0000","last_clean":"2024-05-15T12:10:26.340319+0000","last_became_active":"2024-05-15T12:10:26.338742+0000","last_became_peered":"2024-05-15T12:10:26.338742+0000","last_unstale":"2024-05-15T12:10:26.340319+0000","last_undegraded":"2024-05-15T12:10:26.340319+0000","last_fullsized":"2024-05-15T12:10:26.340319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:56.628690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315398+0000","last_change":"2024-05-15T12:10:24.315398+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315398+0000","last_undegraded":"2024-05-15T12:10:24.315398+0000","last_fullsized":"2024-05-15T12:10:24.315398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.338937+0000","last_change":"2024-05-15T12:10:25.321915+0000","last_active":"2024-05-15T12:10:26.338937+0000","last_peered":"2024-05-15T12:10:26.338937+0000","last_clean":"2024-05-15T12:10:26.338937+0000","last_became_active":"2024-05-15T12:10:25.321660+0000","last_became_peered":"2024-05-15T12:10:25.321660+0000","last_unstale":"2024-05-15T12:10:26.338937+0000","last_undegraded":"2024-05-15T12:10:26.338937+0000","last_fullsized":"2024-05-15T12:10:26.338937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:29.785965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334782+0000","last_change":"2024-05-15T12:10:26.331978+0000","last_active":"2024-05-15T12:10:26.334782+0000","last_peered":"2024-05-15T12:10:26.334782+0000","last_clean":"2024-05-15T12:10:26.334782+0000","last_became_active":"2024-05-15T12:10:26.331123+0000","last_became_peered":"2024-05-15T12:10:26.331123+0000","last_unstale":"2024-05-15T12:10:26.334782+0000","last_undegraded":"2024-05-15T12:10:26.334782+0000","last_fullsized":"2024-05-15T12:10:26.334782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:39.341123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340630+0000","last_change":"2024-05-15T12:10:25.318361+0000","last_active":"2024-05-15T12:10:26.340630+0000","last_peered":"2024-05-15T12:10:26.340630+0000","last_clean":"2024-05-15T12:10:26.340630+0000","last_became_active":"2024-05-15T12:10:25.318086+0000","last_became_peered":"2024-05-15T12:10:25.318086+0000","last_unstale":"2024-05-15T12:10:26.340630+0000","last_undegraded":"2024-05-15T12:10:26.340630+0000","last_fullsized":"2024-05-15T12:10:26.340630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:59.680962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315368+0000","last_change":"2024-05-15T12:10:24.315368+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315368+0000","last_undegraded":"2024-05-15T12:10:24.315368+0000","last_fullsized":"2024-05-15T12:10:24.315368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320866+0000","last_change":"2024-05-15T12:10:25.324046+0000","last_active":"2024-05-15T12:10:26.320866+0000","last_peered":"2024-05-15T12:10:26.320866+0000","last_clean":"2024-05-15T12:10:26.320866+0000","last_became_active":"2024-05-15T12:10:25.323741+0000","last_became_peered":"2024-05-15T12:10:25.323741+0000","last_unstale":"2024-05-15T12:10:26.320866+0000","last_undegraded":"2024-05-15T12:10:26.320866+0000","last_fullsized":"2024-05-15T12:10:26.320866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320860+0000","last_change":"2024-05-15T12:10:25.318998+0000","last_active":"2024-05-15T12:10:25.320860+0000","last_peered":"2024-05-15T12:10:25.320860+0000","last_clean":"2024-05-15T12:10:25.320860+0000","last_became_active":"2024-05-15T12:10:25.318702+0000","last_became_peered":"2024-05-15T12:10:25.318702+0000","last_unstale":"2024-05-15T12:10:25.320860+0000","last_undegraded":"2024-05-15T12:10:25.320860+0000","last_fullsized":"2024-05-15T12:10:25.320860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334099+0000","last_change":"2024-05-15T12:10:25.326922+0000","last_active":"2024-05-15T12:10:25.334099+0000","last_peered":"2024-05-15T12:10:25.334099+0000","last_clean":"2024-05-15T12:10:25.334099+0000","last_became_active":"2024-05-15T12:10:25.326654+0000","last_became_peered":"2024-05-15T12:10:25.326654+0000","last_unstale":"2024-05-15T12:10:25.334099+0000","last_undegraded":"2024-05-15T12:10:25.334099+0000","last_fullsized":"2024-05-15T12:10:25.334099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:06.836661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308403+0000","last_change":"2024-05-15T12:10:24.308403+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308403+0000","last_undegraded":"2024-05-15T12:10:24.308403+0000","last_fullsized":"2024-05-15T12:10:24.308403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333858+0000","last_change":"2024-05-15T12:10:25.326873+0000","last_active":"2024-05-15T12:10:25.333858+0000","last_peered":"2024-05-15T12:10:25.333858+0000","last_clean":"2024-05-15T12:10:25.333858+0000","last_became_active":"2024-05-15T12:10:25.326527+0000","last_became_peered":"2024-05-15T12:10:25.326527+0000","last_unstale":"2024-05-15T12:10:25.333858+0000","last_undegraded":"2024-05-15T12:10:25.333858+0000","last_fullsized":"2024-05-15T12:10:25.333858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316633+0000","last_change":"2024-05-15T12:10:25.316633+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316633+0000","last_undegraded":"2024-05-15T12:10:25.316633+0000","last_fullsized":"2024-05-15T12:10:25.316633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342398+0000","last_change":"2024-05-15T12:10:25.324206+0000","last_active":"2024-05-15T12:10:26.342398+0000","last_peered":"2024-05-15T12:10:26.342398+0000","last_clean":"2024-05-15T12:10:26.342398+0000","last_became_active":"2024-05-15T12:10:25.323870+0000","last_became_peered":"2024-05-15T12:10:25.323870+0000","last_unstale":"2024-05-15T12:10:26.342398+0000","last_undegraded":"2024-05-15T12:10:26.342398+0000","last_fullsized":"2024-05-15T12:10:26.342398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307773+0000","last_change":"2024-05-15T12:10:24.307773+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307773+0000","last_undegraded":"2024-05-15T12:10:24.307773+0000","last_fullsized":"2024-05-15T12:10:24.307773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334677+0000","last_change":"2024-05-15T12:10:26.331819+0000","last_active":"2024-05-15T12:10:26.334677+0000","last_peered":"2024-05-15T12:10:26.334677+0000","last_clean":"2024-05-15T12:10:26.334677+0000","last_became_active":"2024-05-15T12:10:26.331530+0000","last_became_peered":"2024-05-15T12:10:26.331530+0000","last_unstale":"2024-05-15T12:10:26.334677+0000","last_undegraded":"2024-05-15T12:10:26.334677+0000","last_fullsized":"2024-05-15T12:10:26.334677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:35.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307859+0000","last_change":"2024-05-15T12:10:24.307859+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307859+0000","last_undegraded":"2024-05-15T12:10:24.307859+0000","last_fullsized":"2024-05-15T12:10:24.307859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315335+0000","last_change":"2024-05-15T12:10:24.315335+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315335+0000","last_undegraded":"2024-05-15T12:10:24.315335+0000","last_fullsized":"2024-05-15T12:10:24.315335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315411+0000","last_change":"2024-05-15T12:10:24.315411+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315411+0000","last_undegraded":"2024-05-15T12:10:24.315411+0000","last_fullsized":"2024-05-15T12:10:24.315411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342495+0000","last_change":"2024-05-15T12:10:25.324285+0000","last_active":"2024-05-15T12:10:26.342495+0000","last_peered":"2024-05-15T12:10:26.342495+0000","last_clean":"2024-05-15T12:10:26.342495+0000","last_became_active":"2024-05-15T12:10:25.323952+0000","last_became_peered":"2024-05-15T12:10:25.323952+0000","last_unstale":"2024-05-15T12:10:26.342495+0000","last_undegraded":"2024-05-15T12:10:26.342495+0000","last_fullsized":"2024-05-15T12:10:26.342495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:55.449668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312240+0000","last_change":"2024-05-15T12:10:25.312240+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312240+0000","last_undegraded":"2024-05-15T12:10:25.312240+0000","last_fullsized":"2024-05-15T12:10:25.312240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308942+0000","last_change":"2024-05-15T12:10:24.308942+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308942+0000","last_undegraded":"2024-05-15T12:10:24.308942+0000","last_fullsized":"2024-05-15T12:10:24.308942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:24.293030+0000","last_change":"2024-05-15T12:10:24.293030+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.293030+0000","last_undegraded":"2024-05-15T12:10:24.293030+0000","last_fullsized":"2024-05-15T12:10:24.293030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315023+0000","last_change":"2024-05-15T12:10:25.315023+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315023+0000","last_undegraded":"2024-05-15T12:10:25.315023+0000","last_fullsized":"2024-05-15T12:10:25.315023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326674+0000","last_change":"2024-05-15T12:10:25.324499+0000","last_active":"2024-05-15T12:10:25.326674+0000","last_peered":"2024-05-15T12:10:25.326674+0000","last_clean":"2024-05-15T12:10:25.326674+0000","last_became_active":"2024-05-15T12:10:25.324221+0000","last_became_peered":"2024-05-15T12:10:25.324221+0000","last_unstale":"2024-05-15T12:10:25.326674+0000","last_undegraded":"2024-05-15T12:10:25.326674+0000","last_fullsized":"2024-05-15T12:10:25.326674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:34.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312508+0000","last_change":"2024-05-15T12:10:25.312508+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312508+0000","last_undegraded":"2024-05-15T12:10:25.312508+0000","last_fullsized":"2024-05-15T12:10:25.312508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.323806+0000","last_change":"2024-05-15T12:10:25.324364+0000","last_active":"2024-05-15T12:10:26.323806+0000","last_peered":"2024-05-15T12:10:26.323806+0000","last_clean":"2024-05-15T12:10:26.323806+0000","last_became_active":"2024-05-15T12:10:25.324098+0000","last_became_peered":"2024-05-15T12:10:25.324098+0000","last_unstale":"2024-05-15T12:10:26.323806+0000","last_undegraded":"2024-05-15T12:10:26.323806+0000","last_fullsized":"2024-05-15T12:10:26.323806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:41.292334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313779+0000","last_change":"2024-05-15T12:10:25.313779+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313779+0000","last_undegraded":"2024-05-15T12:10:25.313779+0000","last_fullsized":"2024-05-15T12:10:25.313779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308561+0000","last_change":"2024-05-15T12:10:24.308561+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308561+0000","last_undegraded":"2024-05-15T12:10:24.308561+0000","last_fullsized":"2024-05-15T12:10:24.308561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307884+0000","last_change":"2024-05-15T12:10:24.307884+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307884+0000","last_undegraded":"2024-05-15T12:10:24.307884+0000","last_fullsized":"2024-05-15T12:10:24.307884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.325565+0000","last_change":"2024-05-15T12:10:25.323229+0000","last_active":"2024-05-15T12:10:25.325565+0000","last_peered":"2024-05-15T12:10:25.325565+0000","last_clean":"2024-05-15T12:10:25.325565+0000","last_became_active":"2024-05-15T12:10:25.322944+0000","last_became_peered":"2024-05-15T12:10:25.322944+0000","last_unstale":"2024-05-15T12:10:25.325565+0000","last_undegraded":"2024-05-15T12:10:25.325565+0000","last_fullsized":"2024-05-15T12:10:25.325565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:34.310936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334124+0000","last_change":"2024-05-15T12:10:25.327726+0000","last_active":"2024-05-15T12:10:25.334124+0000","last_peered":"2024-05-15T12:10:25.334124+0000","last_clean":"2024-05-15T12:10:25.334124+0000","last_became_active":"2024-05-15T12:10:25.327459+0000","last_became_peered":"2024-05-15T12:10:25.327459+0000","last_unstale":"2024-05-15T12:10:25.334124+0000","last_undegraded":"2024-05-15T12:10:25.334124+0000","last_fullsized":"2024-05-15T12:10:25.334124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:34.862252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333880+0000","last_change":"2024-05-15T12:10:25.327309+0000","last_active":"2024-05-15T12:10:25.333880+0000","last_peered":"2024-05-15T12:10:25.333880+0000","last_clean":"2024-05-15T12:10:25.333880+0000","last_became_active":"2024-05-15T12:10:25.326869+0000","last_became_peered":"2024-05-15T12:10:25.326869+0000","last_unstale":"2024-05-15T12:10:25.333880+0000","last_undegraded":"2024-05-15T12:10:25.333880+0000","last_fullsized":"2024-05-15T12:10:25.333880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320386+0000","last_change":"2024-05-15T12:10:25.318831+0000","last_active":"2024-05-15T12:10:25.320386+0000","last_peered":"2024-05-15T12:10:25.320386+0000","last_clean":"2024-05-15T12:10:25.320386+0000","last_became_active":"2024-05-15T12:10:25.318544+0000","last_became_peered":"2024-05-15T12:10:25.318544+0000","last_unstale":"2024-05-15T12:10:25.320386+0000","last_undegraded":"2024-05-15T12:10:25.320386+0000","last_fullsized":"2024-05-15T12:10:25.320386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:58.938296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326925+0000","last_change":"2024-05-15T12:10:25.324125+0000","last_active":"2024-05-15T12:10:25.326925+0000","last_peered":"2024-05-15T12:10:25.326925+0000","last_clean":"2024-05-15T12:10:25.326925+0000","last_became_active":"2024-05-15T12:10:25.323807+0000","last_became_peered":"2024-05-15T12:10:25.323807+0000","last_unstale":"2024-05-15T12:10:25.326925+0000","last_undegraded":"2024-05-15T12:10:25.326925+0000","last_fullsized":"2024-05-15T12:10:25.326925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:55.968122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320323+0000","last_change":"2024-05-15T12:10:25.324301+0000","last_active":"2024-05-15T12:10:26.320323+0000","last_peered":"2024-05-15T12:10:26.320323+0000","last_clean":"2024-05-15T12:10:26.320323+0000","last_became_active":"2024-05-15T12:10:25.323891+0000","last_became_peered":"2024-05-15T12:10:25.323891+0000","last_unstale":"2024-05-15T12:10:26.320323+0000","last_undegraded":"2024-05-15T12:10:26.320323+0000","last_fullsized":"2024-05-15T12:10:26.320323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307762+0000","last_change":"2024-05-15T12:10:24.307762+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307762+0000","last_undegraded":"2024-05-15T12:10:24.307762+0000","last_fullsized":"2024-05-15T12:10:24.307762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307892+0000","last_change":"2024-05-15T12:10:24.307892+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307892+0000","last_undegraded":"2024-05-15T12:10:24.307892+0000","last_fullsized":"2024-05-15T12:10:24.307892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T12:10:24.306876+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:10:24.306876+0000","last_peered":"2024-05-15T12:10:24.306876+0000","last_clean":"2024-05-15T12:10:24.306876+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:10:24.306876+0000","last_undegraded":"2024-05-15T12:10:24.306876+0000","last_fullsized":"2024-05-15T12:10:24.306876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":62,"acting":62,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":123152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":707245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":111060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:10:29.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:10:29.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.802+0000 7f4321874640 1 Processor -- start 2024-05-15T12:10:29.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.803+0000 7f4321874640 1 -- start start 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.803+0000 7f4321874640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 0x7f431c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.803+0000 7f4321874640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c0d1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.803+0000 7f4321874640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f431c1435a0 con 0x7f431c15d520 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.803+0000 7f4321874640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f431c072210 con 0x7f431c070e00 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.803+0000 7f4321874640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f431c0724f0 con 0x7f431c143150 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431b7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c0d1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f4313fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 0x7f431c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f4313fff640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 0x7f431c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:57206/0 (socket says 172.21.15.77:57206) 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431b7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c0d1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:48372/0 (socket says 172.21.15.77:48372) 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431affd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f431c15d520 0x7f431c0706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:56896/0 (socket says 172.21.15.77:56896) 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f4313fff640 1 -- 172.21.15.77:0/3532018545 learned_addr learned my addr 172.21.15.77:0/3532018545 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431b7fe640 1 -- 172.21.15.77:0/3532018545 >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 msgr2=0x7f431c071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431b7fe640 1 --2- 172.21.15.77:0/3532018545 >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 0x7f431c071c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431b7fe640 1 -- 172.21.15.77:0/3532018545 >> v1:172.21.15.83:6789/0 conn(0x7f431c15d520 legacy=0x7f431c0706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431a7fc640 1 -- 172.21.15.77:0/3532018545 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810578721 0 0) 0x7f431c1435a0 con 0x7f431c15d520 2024-05-15T12:10:29.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f431b7fe640 1 -- 172.21.15.77:0/3532018545 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c0727d0 con 0x7f431c143150 2024-05-15T12:10:29.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.804+0000 7f4313fff640 1 --2- 172.21.15.77:0/3532018545 >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 0x7f431c071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.805+0000 7f431b7fe640 1 --2- 172.21.15.77:0/3532018545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c0d1ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4314009d90 tx=0x7f431402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0fbf45816f90a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.805+0000 7f431a7fc640 1 -- 172.21.15.77:0/3532018545 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314007740 con 0x7f431c143150 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.805+0000 7f431a7fc640 1 -- 172.21.15.77:0/3532018545 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43140078e0 con 0x7f431c143150 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.805+0000 7f431a7fc640 1 -- 172.21.15.77:0/3532018545 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314007cb0 con 0x7f431c143150 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 -- 172.21.15.77:0/3532018545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 msgr2=0x7f431c0d1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 --2- 172.21.15.77:0/3532018545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c0d1ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4314009d90 tx=0x7f431402a660 comp rx=0 tx=0).stop 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 -- 172.21.15.77:0/3532018545 shutdown_connections 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 --2- 172.21.15.77:0/3532018545 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c0d1ec0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 --2- 172.21.15.77:0/3532018545 >> v2:172.21.15.83:3300/0 conn(0x7f431c070e00 0x7f431c071c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 -- 172.21.15.77:0/3532018545 >> 172.21.15.77:0/3532018545 conn(0x7f431c0d2fd0 msgr2=0x7f431c0d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:29.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 -- 172.21.15.77:0/3532018545 shutdown_connections 2024-05-15T12:10:29.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.806+0000 7f4321874640 1 -- 172.21.15.77:0/3532018545 wait complete. 2024-05-15T12:10:29.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.807+0000 7f4321874640 1 Processor -- start 2024-05-15T12:10:29.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.807+0000 7f4321874640 1 -- start start 2024-05-15T12:10:29.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4321874640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 0x7f431c13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4321874640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c13cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4321874640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f431c15d520 0x7f431c154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4321874640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f431c0d18c0 con 0x7f431c070e00 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4321874640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f431c15d900 con 0x7f431c15d520 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4321874640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f431c0d1a40 con 0x7f431c143150 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 0x7f431c13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 0x7f431c13fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35560/0 (socket says 172.21.15.77:35560) 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 -- 172.21.15.77:0/236003702 learned_addr learned my addr 172.21.15.77:0/236003702 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f4313fff640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c13cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431b7fe640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f431c15d520 0x7f431c154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 -- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 msgr2=0x7f431c13cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c13cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 -- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f431c15d520 msgr2=0x7f431c154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f431c15d520 0x7f431c154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 -- 172.21.15.77:0/236003702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f431c154d70 con 0x7f431c070e00 2024-05-15T12:10:29.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.808+0000 7f431affd640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 0x7f431c13fba0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f430c00c3c0 tx=0x7f430c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.809+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c0074e0 con 0x7f431c070e00 2024-05-15T12:10:29.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.809+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f430c0047e0 con 0x7f431c070e00 2024-05-15T12:10:29.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.809+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f431c155050 con 0x7f431c070e00 2024-05-15T12:10:29.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.809+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f430c004c10 con 0x7f431c070e00 2024-05-15T12:10:29.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.809+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f431c155610 con 0x7f431c070e00 2024-05-15T12:10:29.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.810+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f431c06a640 con 0x7f431c070e00 2024-05-15T12:10:29.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.810+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f430c01a020 con 0x7f431c070e00 2024-05-15T12:10:29.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.811+0000 7f4318ff9640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42fc0762d0 0x7f42fc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:29.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.811+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f430c096c00 con 0x7f431c070e00 2024-05-15T12:10:29.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.811+0000 7f4313fff640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42fc0762d0 0x7f42fc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:29.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.811+0000 7f4313fff640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42fc0762d0 0x7f42fc078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f431c1f64e0 tx=0x7f4304009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:29.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.815+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f430c09d080 con 0x7f431c070e00 2024-05-15T12:10:29.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.993+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f431c15a830 con 0x7f42fc0762d0 2024-05-15T12:10:29.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:29.998+0000 7f4318ff9640 1 -- 172.21.15.77:0/236003702 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+243431 (secure 0 0 0) 0x7f431c15a830 con 0x7f42fc0762d0 2024-05-15T12:10:29.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:29.997 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:10:29.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42fc0762d0 msgr2=0x7f42fc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42fc0762d0 0x7f42fc078790 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f431c1f64e0 tx=0x7f4304009240 comp rx=0 tx=0).stop 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 msgr2=0x7f431c13fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 0x7f431c13fba0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f430c00c3c0 tx=0x7f430c00c880 comp rx=0 tx=0).stop 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 shutdown_connections 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f42fc0762d0 0x7f42fc078790 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f431c143150 0x7f431c13cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f431c15d520 0x7f431c154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 --2- 172.21.15.77:0/236003702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f431c070e00 0x7f431c13fba0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 >> 172.21.15.77:0/236003702 conn(0x7f431c0d2fd0 msgr2=0x7f431c0706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 shutdown_connections 2024-05-15T12:10:29.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.002+0000 7f4321874640 1 -- 172.21.15.77:0/236003702 wait complete. 2024-05-15T12:10:30.007 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-05-15T12:10:28.251676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":110,"acting":110,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219840,"kb_used_data":3664,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754880,"statfs":{"total":773094113280,"available":772868997120,"internally_reserved":0,"allocated":3751936,"data_stored":2135569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000650"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332398+0000","last_change":"2024-05-15T12:10:26.329573+0000","last_active":"2024-05-15T12:10:26.332398+0000","last_peered":"2024-05-15T12:10:26.332398+0000","last_clean":"2024-05-15T12:10:26.332398+0000","last_became_active":"2024-05-15T12:10:26.329332+0000","last_became_peered":"2024-05-15T12:10:26.329332+0000","last_unstale":"2024-05-15T12:10:26.332398+0000","last_undegraded":"2024-05-15T12:10:26.332398+0000","last_fullsized":"2024-05-15T12:10:26.332398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:07.846452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313778+0000","last_change":"2024-05-15T12:10:25.313778+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313778+0000","last_undegraded":"2024-05-15T12:10:25.313778+0000","last_fullsized":"2024-05-15T12:10:25.313778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313869+0000","last_change":"2024-05-15T12:10:25.313869+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313869+0000","last_undegraded":"2024-05-15T12:10:25.313869+0000","last_fullsized":"2024-05-15T12:10:25.313869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334740+0000","last_change":"2024-05-15T12:10:26.331862+0000","last_active":"2024-05-15T12:10:26.334740+0000","last_peered":"2024-05-15T12:10:26.334740+0000","last_clean":"2024-05-15T12:10:26.334740+0000","last_became_active":"2024-05-15T12:10:26.331594+0000","last_became_peered":"2024-05-15T12:10:26.331594+0000","last_unstale":"2024-05-15T12:10:26.334740+0000","last_undegraded":"2024-05-15T12:10:26.334740+0000","last_fullsized":"2024-05-15T12:10:26.334740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:09.360516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.336854+0000","last_change":"2024-05-15T12:10:26.334487+0000","last_active":"2024-05-15T12:10:26.336854+0000","last_peered":"2024-05-15T12:10:26.336854+0000","last_clean":"2024-05-15T12:10:26.336854+0000","last_became_active":"2024-05-15T12:10:26.334107+0000","last_became_peered":"2024-05-15T12:10:26.334107+0000","last_unstale":"2024-05-15T12:10:26.336854+0000","last_undegraded":"2024-05-15T12:10:26.336854+0000","last_fullsized":"2024-05-15T12:10:26.336854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:20:30.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316030+0000","last_change":"2024-05-15T12:10:25.316030+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316030+0000","last_undegraded":"2024-05-15T12:10:25.316030+0000","last_fullsized":"2024-05-15T12:10:25.316030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315396+0000","last_change":"2024-05-15T12:10:25.315396+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315396+0000","last_undegraded":"2024-05-15T12:10:25.315396+0000","last_fullsized":"2024-05-15T12:10:25.315396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340180+0000","last_change":"2024-05-15T12:10:26.338780+0000","last_active":"2024-05-15T12:10:26.340180+0000","last_peered":"2024-05-15T12:10:26.340180+0000","last_clean":"2024-05-15T12:10:26.340180+0000","last_became_active":"2024-05-15T12:10:26.338184+0000","last_became_peered":"2024-05-15T12:10:26.338184+0000","last_unstale":"2024-05-15T12:10:26.340180+0000","last_undegraded":"2024-05-15T12:10:26.340180+0000","last_fullsized":"2024-05-15T12:10:26.340180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:47.781617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313834+0000","last_change":"2024-05-15T12:10:25.313834+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313834+0000","last_undegraded":"2024-05-15T12:10:25.313834+0000","last_fullsized":"2024-05-15T12:10:25.313834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.341197+0000","last_change":"2024-05-15T12:10:26.339432+0000","last_active":"2024-05-15T12:10:26.341197+0000","last_peered":"2024-05-15T12:10:26.341197+0000","last_clean":"2024-05-15T12:10:26.341197+0000","last_became_active":"2024-05-15T12:10:26.339178+0000","last_became_peered":"2024-05-15T12:10:26.339178+0000","last_unstale":"2024-05-15T12:10:26.341197+0000","last_undegraded":"2024-05-15T12:10:26.341197+0000","last_fullsized":"2024-05-15T12:10:26.341197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:30.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.311771+0000","last_change":"2024-05-15T12:10:25.311771+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.311771+0000","last_undegraded":"2024-05-15T12:10:25.311771+0000","last_fullsized":"2024-05-15T12:10:25.311771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334850+0000","last_change":"2024-05-15T12:10:26.333520+0000","last_active":"2024-05-15T12:10:26.334850+0000","last_peered":"2024-05-15T12:10:26.334850+0000","last_clean":"2024-05-15T12:10:26.334850+0000","last_became_active":"2024-05-15T12:10:26.333272+0000","last_became_peered":"2024-05-15T12:10:26.333272+0000","last_unstale":"2024-05-15T12:10:26.334850+0000","last_undegraded":"2024-05-15T12:10:26.334850+0000","last_fullsized":"2024-05-15T12:10:26.334850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:13.980419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334847+0000","last_change":"2024-05-15T12:10:26.333175+0000","last_active":"2024-05-15T12:10:26.334847+0000","last_peered":"2024-05-15T12:10:26.334847+0000","last_clean":"2024-05-15T12:10:26.334847+0000","last_became_active":"2024-05-15T12:10:26.332897+0000","last_became_peered":"2024-05-15T12:10:26.332897+0000","last_unstale":"2024-05-15T12:10:26.334847+0000","last_undegraded":"2024-05-15T12:10:26.334847+0000","last_fullsized":"2024-05-15T12:10:26.334847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:27.674677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315283+0000","last_change":"2024-05-15T12:10:25.315283+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315283+0000","last_undegraded":"2024-05-15T12:10:25.315283+0000","last_fullsized":"2024-05-15T12:10:25.315283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307912+0000","last_change":"2024-05-15T12:10:24.307912+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307912+0000","last_undegraded":"2024-05-15T12:10:24.307912+0000","last_fullsized":"2024-05-15T12:10:24.307912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332193+0000","last_change":"2024-05-15T12:10:26.328020+0000","last_active":"2024-05-15T12:10:26.332193+0000","last_peered":"2024-05-15T12:10:26.332193+0000","last_clean":"2024-05-15T12:10:26.332193+0000","last_became_active":"2024-05-15T12:10:26.326527+0000","last_became_peered":"2024-05-15T12:10:26.326527+0000","last_unstale":"2024-05-15T12:10:26.332193+0000","last_undegraded":"2024-05-15T12:10:26.332193+0000","last_fullsized":"2024-05-15T12:10:26.332193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:35.506570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340319+0000","last_change":"2024-05-15T12:10:26.339019+0000","last_active":"2024-05-15T12:10:26.340319+0000","last_peered":"2024-05-15T12:10:26.340319+0000","last_clean":"2024-05-15T12:10:26.340319+0000","last_became_active":"2024-05-15T12:10:26.338742+0000","last_became_peered":"2024-05-15T12:10:26.338742+0000","last_unstale":"2024-05-15T12:10:26.340319+0000","last_undegraded":"2024-05-15T12:10:26.340319+0000","last_fullsized":"2024-05-15T12:10:26.340319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:56.628690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315398+0000","last_change":"2024-05-15T12:10:24.315398+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315398+0000","last_undegraded":"2024-05-15T12:10:24.315398+0000","last_fullsized":"2024-05-15T12:10:24.315398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.338937+0000","last_change":"2024-05-15T12:10:25.321915+0000","last_active":"2024-05-15T12:10:26.338937+0000","last_peered":"2024-05-15T12:10:26.338937+0000","last_clean":"2024-05-15T12:10:26.338937+0000","last_became_active":"2024-05-15T12:10:25.321660+0000","last_became_peered":"2024-05-15T12:10:25.321660+0000","last_unstale":"2024-05-15T12:10:26.338937+0000","last_undegraded":"2024-05-15T12:10:26.338937+0000","last_fullsized":"2024-05-15T12:10:26.338937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:29.785965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334782+0000","last_change":"2024-05-15T12:10:26.331978+0000","last_active":"2024-05-15T12:10:26.334782+0000","last_peered":"2024-05-15T12:10:26.334782+0000","last_clean":"2024-05-15T12:10:26.334782+0000","last_became_active":"2024-05-15T12:10:26.331123+0000","last_became_peered":"2024-05-15T12:10:26.331123+0000","last_unstale":"2024-05-15T12:10:26.334782+0000","last_undegraded":"2024-05-15T12:10:26.334782+0000","last_fullsized":"2024-05-15T12:10:26.334782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:39.341123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340630+0000","last_change":"2024-05-15T12:10:25.318361+0000","last_active":"2024-05-15T12:10:26.340630+0000","last_peered":"2024-05-15T12:10:26.340630+0000","last_clean":"2024-05-15T12:10:26.340630+0000","last_became_active":"2024-05-15T12:10:25.318086+0000","last_became_peered":"2024-05-15T12:10:25.318086+0000","last_unstale":"2024-05-15T12:10:26.340630+0000","last_undegraded":"2024-05-15T12:10:26.340630+0000","last_fullsized":"2024-05-15T12:10:26.340630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:59.680962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315368+0000","last_change":"2024-05-15T12:10:24.315368+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315368+0000","last_undegraded":"2024-05-15T12:10:24.315368+0000","last_fullsized":"2024-05-15T12:10:24.315368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320866+0000","last_change":"2024-05-15T12:10:25.324046+0000","last_active":"2024-05-15T12:10:26.320866+0000","last_peered":"2024-05-15T12:10:26.320866+0000","last_clean":"2024-05-15T12:10:26.320866+0000","last_became_active":"2024-05-15T12:10:25.323741+0000","last_became_peered":"2024-05-15T12:10:25.323741+0000","last_unstale":"2024-05-15T12:10:26.320866+0000","last_undegraded":"2024-05-15T12:10:26.320866+0000","last_fullsized":"2024-05-15T12:10:26.320866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320860+0000","last_change":"2024-05-15T12:10:25.318998+0000","last_active":"2024-05-15T12:10:25.320860+0000","last_peered":"2024-05-15T12:10:25.320860+0000","last_clean":"2024-05-15T12:10:25.320860+0000","last_became_active":"2024-05-15T12:10:25.318702+0000","last_became_peered":"2024-05-15T12:10:25.318702+0000","last_unstale":"2024-05-15T12:10:25.320860+0000","last_undegraded":"2024-05-15T12:10:25.320860+0000","last_fullsized":"2024-05-15T12:10:25.320860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334099+0000","last_change":"2024-05-15T12:10:25.326922+0000","last_active":"2024-05-15T12:10:25.334099+0000","last_peered":"2024-05-15T12:10:25.334099+0000","last_clean":"2024-05-15T12:10:25.334099+0000","last_became_active":"2024-05-15T12:10:25.326654+0000","last_became_peered":"2024-05-15T12:10:25.326654+0000","last_unstale":"2024-05-15T12:10:25.334099+0000","last_undegraded":"2024-05-15T12:10:25.334099+0000","last_fullsized":"2024-05-15T12:10:25.334099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:06.836661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308403+0000","last_change":"2024-05-15T12:10:24.308403+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308403+0000","last_undegraded":"2024-05-15T12:10:24.308403+0000","last_fullsized":"2024-05-15T12:10:24.308403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333858+0000","last_change":"2024-05-15T12:10:25.326873+0000","last_active":"2024-05-15T12:10:25.333858+0000","last_peered":"2024-05-15T12:10:25.333858+0000","last_clean":"2024-05-15T12:10:25.333858+0000","last_became_active":"2024-05-15T12:10:25.326527+0000","last_became_peered":"2024-05-15T12:10:25.326527+0000","last_unstale":"2024-05-15T12:10:25.333858+0000","last_undegraded":"2024-05-15T12:10:25.333858+0000","last_fullsized":"2024-05-15T12:10:25.333858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316633+0000","last_change":"2024-05-15T12:10:25.316633+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316633+0000","last_undegraded":"2024-05-15T12:10:25.316633+0000","last_fullsized":"2024-05-15T12:10:25.316633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342398+0000","last_change":"2024-05-15T12:10:25.324206+0000","last_active":"2024-05-15T12:10:26.342398+0000","last_peered":"2024-05-15T12:10:26.342398+0000","last_clean":"2024-05-15T12:10:26.342398+0000","last_became_active":"2024-05-15T12:10:25.323870+0000","last_became_peered":"2024-05-15T12:10:25.323870+0000","last_unstale":"2024-05-15T12:10:26.342398+0000","last_undegraded":"2024-05-15T12:10:26.342398+0000","last_fullsized":"2024-05-15T12:10:26.342398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307773+0000","last_change":"2024-05-15T12:10:24.307773+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307773+0000","last_undegraded":"2024-05-15T12:10:24.307773+0000","last_fullsized":"2024-05-15T12:10:24.307773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334677+0000","last_change":"2024-05-15T12:10:26.331819+0000","last_active":"2024-05-15T12:10:26.334677+0000","last_peered":"2024-05-15T12:10:26.334677+0000","last_clean":"2024-05-15T12:10:26.334677+0000","last_became_active":"2024-05-15T12:10:26.331530+0000","last_became_peered":"2024-05-15T12:10:26.331530+0000","last_unstale":"2024-05-15T12:10:26.334677+0000","last_undegraded":"2024-05-15T12:10:26.334677+0000","last_fullsized":"2024-05-15T12:10:26.334677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:35.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307859+0000","last_change":"2024-05-15T12:10:24.307859+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307859+0000","last_undegraded":"2024-05-15T12:10:24.307859+0000","last_fullsized":"2024-05-15T12:10:24.307859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315335+0000","last_change":"2024-05-15T12:10:24.315335+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315335+0000","last_undegraded":"2024-05-15T12:10:24.315335+0000","last_fullsized":"2024-05-15T12:10:24.315335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315411+0000","last_change":"2024-05-15T12:10:24.315411+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315411+0000","last_undegraded":"2024-05-15T12:10:24.315411+0000","last_fullsized":"2024-05-15T12:10:24.315411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342495+0000","last_change":"2024-05-15T12:10:25.324285+0000","last_active":"2024-05-15T12:10:26.342495+0000","last_peered":"2024-05-15T12:10:26.342495+0000","last_clean":"2024-05-15T12:10:26.342495+0000","last_became_active":"2024-05-15T12:10:25.323952+0000","last_became_peered":"2024-05-15T12:10:25.323952+0000","last_unstale":"2024-05-15T12:10:26.342495+0000","last_undegraded":"2024-05-15T12:10:26.342495+0000","last_fullsized":"2024-05-15T12:10:26.342495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:55.449668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312240+0000","last_change":"2024-05-15T12:10:25.312240+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312240+0000","last_undegraded":"2024-05-15T12:10:25.312240+0000","last_fullsized":"2024-05-15T12:10:25.312240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308942+0000","last_change":"2024-05-15T12:10:24.308942+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308942+0000","last_undegraded":"2024-05-15T12:10:24.308942+0000","last_fullsized":"2024-05-15T12:10:24.308942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:24.293030+0000","last_change":"2024-05-15T12:10:24.293030+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.293030+0000","last_undegraded":"2024-05-15T12:10:24.293030+0000","last_fullsized":"2024-05-15T12:10:24.293030+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315023+0000","last_change":"2024-05-15T12:10:25.315023+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315023+0000","last_undegraded":"2024-05-15T12:10:25.315023+0000","last_fullsized":"2024-05-15T12:10:25.315023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326674+0000","last_change":"2024-05-15T12:10:25.324499+0000","last_active":"2024-05-15T12:10:25.326674+0000","last_peered":"2024-05-15T12:10:25.326674+0000","last_clean":"2024-05-15T12:10:25.326674+0000","last_became_active":"2024-05-15T12:10:25.324221+0000","last_became_peered":"2024-05-15T12:10:25.324221+0000","last_unstale":"2024-05-15T12:10:25.326674+0000","last_undegraded":"2024-05-15T12:10:25.326674+0000","last_fullsized":"2024-05-15T12:10:25.326674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:34.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312508+0000","last_change":"2024-05-15T12:10:25.312508+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312508+0000","last_undegraded":"2024-05-15T12:10:25.312508+0000","last_fullsized":"2024-05-15T12:10:25.312508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.323806+0000","last_change":"2024-05-15T12:10:25.324364+0000","last_active":"2024-05-15T12:10:26.323806+0000","last_peered":"2024-05-15T12:10:26.323806+0000","last_clean":"2024-05-15T12:10:26.323806+0000","last_became_active":"2024-05-15T12:10:25.324098+0000","last_became_peered":"2024-05-15T12:10:25.324098+0000","last_unstale":"2024-05-15T12:10:26.323806+0000","last_undegraded":"2024-05-15T12:10:26.323806+0000","last_fullsized":"2024-05-15T12:10:26.323806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:41.292334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313779+0000","last_change":"2024-05-15T12:10:25.313779+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313779+0000","last_undegraded":"2024-05-15T12:10:25.313779+0000","last_fullsized":"2024-05-15T12:10:25.313779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308561+0000","last_change":"2024-05-15T12:10:24.308561+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308561+0000","last_undegraded":"2024-05-15T12:10:24.308561+0000","last_fullsized":"2024-05-15T12:10:24.308561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307884+0000","last_change":"2024-05-15T12:10:24.307884+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307884+0000","last_undegraded":"2024-05-15T12:10:24.307884+0000","last_fullsized":"2024-05-15T12:10:24.307884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.325565+0000","last_change":"2024-05-15T12:10:25.323229+0000","last_active":"2024-05-15T12:10:25.325565+0000","last_peered":"2024-05-15T12:10:25.325565+0000","last_clean":"2024-05-15T12:10:25.325565+0000","last_became_active":"2024-05-15T12:10:25.322944+0000","last_became_peered":"2024-05-15T12:10:25.322944+0000","last_unstale":"2024-05-15T12:10:25.325565+0000","last_undegraded":"2024-05-15T12:10:25.325565+0000","last_fullsized":"2024-05-15T12:10:25.325565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:34.310936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334124+0000","last_change":"2024-05-15T12:10:25.327726+0000","last_active":"2024-05-15T12:10:25.334124+0000","last_peered":"2024-05-15T12:10:25.334124+0000","last_clean":"2024-05-15T12:10:25.334124+0000","last_became_active":"2024-05-15T12:10:25.327459+0000","last_became_peered":"2024-05-15T12:10:25.327459+0000","last_unstale":"2024-05-15T12:10:25.334124+0000","last_undegraded":"2024-05-15T12:10:25.334124+0000","last_fullsized":"2024-05-15T12:10:25.334124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:34.862252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333880+0000","last_change":"2024-05-15T12:10:25.327309+0000","last_active":"2024-05-15T12:10:25.333880+0000","last_peered":"2024-05-15T12:10:25.333880+0000","last_clean":"2024-05-15T12:10:25.333880+0000","last_became_active":"2024-05-15T12:10:25.326869+0000","last_became_peered":"2024-05-15T12:10:25.326869+0000","last_unstale":"2024-05-15T12:10:25.333880+0000","last_undegraded":"2024-05-15T12:10:25.333880+0000","last_fullsized":"2024-05-15T12:10:25.333880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320386+0000","last_change":"2024-05-15T12:10:25.318831+0000","last_active":"2024-05-15T12:10:25.320386+0000","last_peered":"2024-05-15T12:10:25.320386+0000","last_clean":"2024-05-15T12:10:25.320386+0000","last_became_active":"2024-05-15T12:10:25.318544+0000","last_became_peered":"2024-05-15T12:10:25.318544+0000","last_unstale":"2024-05-15T12:10:25.320386+0000","last_undegraded":"2024-05-15T12:10:25.320386+0000","last_fullsized":"2024-05-15T12:10:25.320386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:58.938296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326925+0000","last_change":"2024-05-15T12:10:25.324125+0000","last_active":"2024-05-15T12:10:25.326925+0000","last_peered":"2024-05-15T12:10:25.326925+0000","last_clean":"2024-05-15T12:10:25.326925+0000","last_became_active":"2024-05-15T12:10:25.323807+0000","last_became_peered":"2024-05-15T12:10:25.323807+0000","last_unstale":"2024-05-15T12:10:25.326925+0000","last_undegraded":"2024-05-15T12:10:25.326925+0000","last_fullsized":"2024-05-15T12:10:25.326925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:55.968122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320323+0000","last_change":"2024-05-15T12:10:25.324301+0000","last_active":"2024-05-15T12:10:26.320323+0000","last_peered":"2024-05-15T12:10:26.320323+0000","last_clean":"2024-05-15T12:10:26.320323+0000","last_became_active":"2024-05-15T12:10:25.323891+0000","last_became_peered":"2024-05-15T12:10:25.323891+0000","last_unstale":"2024-05-15T12:10:26.320323+0000","last_undegraded":"2024-05-15T12:10:26.320323+0000","last_fullsized":"2024-05-15T12:10:26.320323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307762+0000","last_change":"2024-05-15T12:10:24.307762+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307762+0000","last_undegraded":"2024-05-15T12:10:24.307762+0000","last_fullsized":"2024-05-15T12:10:24.307762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307892+0000","last_change":"2024-05-15T12:10:24.307892+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307892+0000","last_undegraded":"2024-05-15T12:10:24.307892+0000","last_fullsized":"2024-05-15T12:10:24.307892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T12:10:24.306876+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:10:24.306876+0000","last_peered":"2024-05-15T12:10:24.306876+0000","last_clean":"2024-05-15T12:10:24.306876+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:10:24.306876+0000","last_undegraded":"2024-05-15T12:10:24.306876+0000","last_fullsized":"2024-05-15T12:10:24.306876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":3},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":62,"acting":62,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":123152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":707245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27320,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":303104,"data_stored":111060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:10:30.011 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-05-15T12:10:30.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.313778+0000', 'last_change': '2024-05-15T12:10:25.313778+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.313778+0000', 'last_undegraded': '2024-05-15T12:10:25.313778+0000', 'last_fullsized': '2024-05-15T12:10:25.313778+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-15T12:10:30.011 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-05-15T12:10:30.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.011 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-05-15T12:10:30.011 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.313869+0000', 'last_change': '2024-05-15T12:10:25.313869+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.313869+0000', 'last_undegraded': '2024-05-15T12:10:25.313869+0000', 'last_fullsized': '2024-05-15T12:10:25.313869+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.012 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.316030+0000', 'last_change': '2024-05-15T12:10:25.316030+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.316030+0000', 'last_undegraded': '2024-05-15T12:10:25.316030+0000', 'last_fullsized': '2024-05-15T12:10:25.316030+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-05-15T12:10:30.013 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-05-15T12:10:30.014 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.315396+0000', 'last_change': '2024-05-15T12:10:25.315396+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.315396+0000', 'last_undegraded': '2024-05-15T12:10:25.315396+0000', 'last_fullsized': '2024-05-15T12:10:25.315396+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.313834+0000', 'last_change': '2024-05-15T12:10:25.313834+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.313834+0000', 'last_undegraded': '2024-05-15T12:10:25.313834+0000', 'last_fullsized': '2024-05-15T12:10:25.313834+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-05-15T12:10:30.015 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.311771+0000', 'last_change': '2024-05-15T12:10:25.311771+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.311771+0000', 'last_undegraded': '2024-05-15T12:10:25.311771+0000', 'last_fullsized': '2024-05-15T12:10:25.311771+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.315283+0000', 'last_change': '2024-05-15T12:10:25.315283+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.315283+0000', 'last_undegraded': '2024-05-15T12:10:25.315283+0000', 'last_fullsized': '2024-05-15T12:10:25.315283+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307912+0000', 'last_change': '2024-05-15T12:10:24.307912+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307912+0000', 'last_undegraded': '2024-05-15T12:10:24.307912+0000', 'last_fullsized': '2024-05-15T12:10:24.307912+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-15T12:10:30.016 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307780+0000', 'last_change': '2024-05-15T12:10:24.307780+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307780+0000', 'last_undegraded': '2024-05-15T12:10:24.307780+0000', 'last_fullsized': '2024-05-15T12:10:24.307780+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.315398+0000', 'last_change': '2024-05-15T12:10:24.315398+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.315398+0000', 'last_undegraded': '2024-05-15T12:10:24.315398+0000', 'last_fullsized': '2024-05-15T12:10:24.315398+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307780+0000', 'last_change': '2024-05-15T12:10:24.307780+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307780+0000', 'last_undegraded': '2024-05-15T12:10:24.307780+0000', 'last_fullsized': '2024-05-15T12:10:24.307780+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-05-15T12:10:30.017 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.315368+0000', 'last_change': '2024-05-15T12:10:24.315368+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.315368+0000', 'last_undegraded': '2024-05-15T12:10:24.315368+0000', 'last_fullsized': '2024-05-15T12:10:24.315368+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-05-15T12:10:30.018 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.308403+0000', 'last_change': '2024-05-15T12:10:24.308403+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.308403+0000', 'last_undegraded': '2024-05-15T12:10:24.308403+0000', 'last_fullsized': '2024-05-15T12:10:24.308403+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.316633+0000', 'last_change': '2024-05-15T12:10:25.316633+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.316633+0000', 'last_undegraded': '2024-05-15T12:10:25.316633+0000', 'last_fullsized': '2024-05-15T12:10:25.316633+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307773+0000', 'last_change': '2024-05-15T12:10:24.307773+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307773+0000', 'last_undegraded': '2024-05-15T12:10:24.307773+0000', 'last_fullsized': '2024-05-15T12:10:24.307773+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307859+0000', 'last_change': '2024-05-15T12:10:24.307859+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307859+0000', 'last_undegraded': '2024-05-15T12:10:24.307859+0000', 'last_fullsized': '2024-05-15T12:10:24.307859+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T12:10:30.019 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.315335+0000', 'last_change': '2024-05-15T12:10:24.315335+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.315335+0000', 'last_undegraded': '2024-05-15T12:10:24.315335+0000', 'last_fullsized': '2024-05-15T12:10:24.315335+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.315411+0000', 'last_change': '2024-05-15T12:10:24.315411+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.315411+0000', 'last_undegraded': '2024-05-15T12:10:24.315411+0000', 'last_fullsized': '2024-05-15T12:10:24.315411+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.312240+0000', 'last_change': '2024-05-15T12:10:25.312240+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.312240+0000', 'last_undegraded': '2024-05-15T12:10:25.312240+0000', 'last_fullsized': '2024-05-15T12:10:25.312240+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-15T12:10:30.020 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.308942+0000', 'last_change': '2024-05-15T12:10:24.308942+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.308942+0000', 'last_undegraded': '2024-05-15T12:10:24.308942+0000', 'last_fullsized': '2024-05-15T12:10:24.308942+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:24.293030+0000', 'last_change': '2024-05-15T12:10:24.293030+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.293030+0000', 'last_undegraded': '2024-05-15T12:10:24.293030+0000', 'last_fullsized': '2024-05-15T12:10:24.293030+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.315023+0000', 'last_change': '2024-05-15T12:10:25.315023+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.315023+0000', 'last_undegraded': '2024-05-15T12:10:25.315023+0000', 'last_fullsized': '2024-05-15T12:10:25.315023+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.312508+0000', 'last_change': '2024-05-15T12:10:25.312508+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.312508+0000', 'last_undegraded': '2024-05-15T12:10:25.312508+0000', 'last_fullsized': '2024-05-15T12:10:25.312508+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-05-15T12:10:30.021 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:25.313779+0000', 'last_change': '2024-05-15T12:10:25.313779+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.313779+0000', 'last_undegraded': '2024-05-15T12:10:25.313779+0000', 'last_fullsized': '2024-05-15T12:10:25.313779+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.308561+0000', 'last_change': '2024-05-15T12:10:24.308561+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.308561+0000', 'last_undegraded': '2024-05-15T12:10:24.308561+0000', 'last_fullsized': '2024-05-15T12:10:24.308561+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307884+0000', 'last_change': '2024-05-15T12:10:24.307884+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307884+0000', 'last_undegraded': '2024-05-15T12:10:24.307884+0000', 'last_fullsized': '2024-05-15T12:10:24.307884+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-05-15T12:10:30.022 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.023 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-05-15T12:10:30.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307762+0000', 'last_change': '2024-05-15T12:10:24.307762+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307762+0000', 'last_undegraded': '2024-05-15T12:10:24.307762+0000', 'last_fullsized': '2024-05-15T12:10:24.307762+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-15T12:10:30.024 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-05-15T12:10:30.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-05-15T12:10:25.302821+0000', 'last_change': '2024-05-15T12:10:25.302821+0000', 'last_active': '2024-05-15T12:10:25.302821+0000', 'last_peered': '2024-05-15T12:10:25.302821+0000', 'last_clean': '2024-05-15T12:10:25.302821+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:25.302821+0000', 'last_undegraded': '2024-05-15T12:10:25.302821+0000', 'last_fullsized': '2024-05-15T12:10:25.302821+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:25.302821+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-05-15T12:10:30.024 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-05-15T12:10:30.024 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-05-15T12:10:24.307892+0000', 'last_change': '2024-05-15T12:10:24.307892+0000', 'last_active': '2024-05-15T12:10:24.293030+0000', 'last_peered': '2024-05-15T12:10:24.293030+0000', 'last_clean': '2024-05-15T12:10:24.293030+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-15T12:10:24.307892+0000', 'last_undegraded': '2024-05-15T12:10:24.307892+0000', 'last_fullsized': '2024-05-15T12:10:24.307892+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'last_clean_scrub_stamp': '2024-05-15T12:10:24.293030+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-15T12:10:30.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-15T12:10:30.146 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.152+0000 7ffb6dc59640 1 Processor -- start 2024-05-15T12:10:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.152+0000 7ffb6dc59640 1 -- start start 2024-05-15T12:10:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb6dc59640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb680cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb6dc59640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ffb680cfdc0 0x7ffb68072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb6dc59640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb680d0640 con 0x7ffb6813ee10 2024-05-15T12:10:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb6dc59640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ffb680d0920 con 0x7ffb680cfdc0 2024-05-15T12:10:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb6dc59640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ffb680d0c00 con 0x7ffb68141e40 2024-05-15T12:10:30.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb677fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffb6813ee10 0x7ffb68141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37364/0 (socket says 172.21.15.77:37364) 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb677fe640 1 -- 172.21.15.77:0/492631995 learned_addr learned my addr 172.21.15.77:0/492631995 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb67fff640 1 --2- 172.21.15.77:0/492631995 >> v2:172.21.15.83:3300/0 conn(0x7ffb680cfdc0 0x7ffb68072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb66ffd640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb680cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744312474 0 0) 0x7ffb680d0640 con 0x7ffb6813ee10 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb50003520 con 0x7ffb6813ee10 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 508244575 0 0) 0x7ffb50003520 con 0x7ffb6813ee10 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 msgr2=0x7ffb680cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb680cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 >> v2:172.21.15.83:3300/0 conn(0x7ffb680cfdc0 msgr2=0x7ffb68072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 --2- 172.21.15.77:0/492631995 >> v2:172.21.15.83:3300/0 conn(0x7ffb680cfdc0 0x7ffb68072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb680722a0 con 0x7ffb6813ee10 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7ffb580016f0 con 0x7ffb6813ee10 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb66ffd640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb680cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:30.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 >> v1:172.21.15.77:6789/0 conn(0x7ffb6813ee10 legacy=0x7ffb68141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb50003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb50004800 0x7ffb50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680d0920 con 0x7ffb50003a70 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680d0c00 con 0x7ffb50004800 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.153+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5000dc00 con 0x7ffb68141e40 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb677fe640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb50003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb66ffd640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb50004800 0x7ffb50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb67fff640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb677fe640 1 -- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 msgr2=0x7ffb500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb677fe640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68141e40 0x7ffb500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb677fe640 1 -- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb50004800 msgr2=0x7ffb50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb677fe640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb50004800 0x7ffb50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.154+0000 7ffb677fe640 1 -- 172.21.15.77:0/492631995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb50003520 con 0x7ffb50003a70 2024-05-15T12:10:30.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb677fe640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb50003e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c210 tx=0x7ffb50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c80083f413d4cee server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58007d30 con 0x7ffb50003a70 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5802e070 con 0x7ffb50003a70 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb667fc640 1 -- 172.21.15.77:0/492631995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58005d30 con 0x7ffb50003a70 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb6dc59640 1 -- 172.21.15.77:0/492631995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 msgr2=0x7ffb50003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/492631995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb50003e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c210 tx=0x7ffb50005830 comp rx=0 tx=0).stop 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb67fff640 1 -- 172.21.15.77:0/492631995 reap_dead start 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb6dc59640 1 -- 172.21.15.77:0/492631995 shutdown_connections 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb6dc59640 1 -- 172.21.15.77:0/492631995 >> 172.21.15.77:0/492631995 conn(0x7ffb6806c810 msgr2=0x7ffb6806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb6dc59640 1 -- 172.21.15.77:0/492631995 shutdown_connections 2024-05-15T12:10:30.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.155+0000 7ffb6dc59640 1 -- 172.21.15.77:0/492631995 wait complete. 2024-05-15T12:10:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 Processor -- start 2024-05-15T12:10:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 -- start start 2024-05-15T12:10:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb6813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68152460 0x7ffb681557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb68155cf0 0x7ffb68156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680d03d0 con 0x7ffb50003a70 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680d0250 con 0x7ffb68155cf0 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb6dc59640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6813f1f0 con 0x7ffb68152460 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.157+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb6813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb6813f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35570/0 (socket says 172.21.15.77:35570) 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 -- 172.21.15.77:0/1132862881 learned_addr learned my addr 172.21.15.77:0/1132862881 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb67fff640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb68155cf0 0x7ffb68156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 -- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68152460 msgr2=0x7ffb681557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb66ffd640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68152460 0x7ffb681557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68152460 0x7ffb681557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 -- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb68155cf0 msgr2=0x7ffb68156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb68155cf0 0x7ffb68156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 -- 172.21.15.77:0/1132862881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6813fe90 con 0x7ffb50003a70 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb67fff640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb68155cf0 0x7ffb68156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb677fe640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb6813f520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c300 tx=0x7ffb680d0810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:30.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58007270 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb58007410 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb68140170 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb58007d10 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.158+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb68140730 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.159+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb680cf880 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.160+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ffb58047020 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.160+0000 7ffb4ffff640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ffb54076300 0x7ffb540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.160+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ffb580b76d0 con 0x7ffb50003a70 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.160+0000 7ffb66ffd640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ffb54076300 0x7ffb540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.161+0000 7ffb66ffd640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ffb54076300 0x7ffb540787c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009560 tx=0x7ffb5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:30.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.165+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ffb680cf880 con 0x7ffb50003a70 2024-05-15T12:10:30.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.419+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ffb680b1dc0 con 0x7ffb50003a70 2024-05-15T12:10:30.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.419+0000 7ffb4ffff640 1 -- 172.21.15.77:0/1132862881 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2398 (secure 0 0 0) 0x7ffb5803c040 con 0x7ffb50003a70 2024-05-15T12:10:30.414 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:{"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":70,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1715774971,"num_in_osds":8,"osd_in_since":1715774962,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":36},{"state_name":"unknown","count":34},{"state_name":"creating+peering","count":27}],"num_pgs":97,"num_pools":3,"num_objects":5,"data_bytes":590402,"bytes_used":225169408,"bytes_avail":772868943872,"bytes_total":773094113280,"unknown_pgs_ratio":0.3505154550075531,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":1205,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4863}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-05-15T12:10:30.252023+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ffb54076300 msgr2=0x7ffb540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ffb54076300 0x7ffb540787c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009560 tx=0x7ffb5c008040 comp rx=0 tx=0).stop 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 msgr2=0x7ffb6813f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb6813f520 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c300 tx=0x7ffb680d0810 comp rx=0 tx=0).stop 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 shutdown_connections 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ffb54076300 0x7ffb540787c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ffb68152460 0x7ffb681557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ffb68155cf0 0x7ffb68156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 --2- 172.21.15.77:0/1132862881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb50003a70 0x7ffb6813f520 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 >> 172.21.15.77:0/1132862881 conn(0x7ffb6806c810 msgr2=0x7ffb6815f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:30.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.421+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 shutdown_connections 2024-05-15T12:10:30.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.422+0000 7ffb6dc59640 1 -- 172.21.15.77:0/1132862881 wait complete. 2024-05-15T12:10:30.427 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-15T12:10:30.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:10:30.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.532+0000 7f01af89b640 1 Processor -- start 2024-05-15T12:10:30.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.532+0000 7f01af89b640 1 -- start start 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01af89b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80b4a40 0x7f01a80ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01af89b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01a80ceaa0 0x7f01a806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01af89b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a80ceec0 con 0x7f01a81469b0 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01af89b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f01a80b6430 con 0x7f01a80ceaa0 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01af89b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f01a80b4f00 con 0x7f01a80b4a40 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01ade38640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01a80ceaa0 0x7f01a806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01ade38640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01a80ceaa0 0x7f01a806e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35576/0 (socket says 172.21.15.77:35576) 2024-05-15T12:10:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01ade38640 1 -- 172.21.15.77:0/2467781909 learned_addr learned my addr 172.21.15.77:0/2467781909 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.533+0000 7f01ace36640 1 --2- 172.21.15.77:0/2467781909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80b4a40 0x7f01a80ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f01ade38640 1 -- 172.21.15.77:0/2467781909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80b4a40 msgr2=0x7f01a80ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f01ade38640 1 --2- 172.21.15.77:0/2467781909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80b4a40 0x7f01a80ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f01ade38640 1 -- 172.21.15.77:0/2467781909 >> v1:172.21.15.83:6789/0 conn(0x7f01a81469b0 legacy=0x7f01a815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f01ade38640 1 -- 172.21.15.77:0/2467781909 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a80b51e0 con 0x7f01a80ceaa0 2024-05-15T12:10:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f01ade38640 1 --2- 172.21.15.77:0/2467781909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80ceaa0 0x7f01a806e960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009870 tx=0x7f01a002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=983e864700cb8d3b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f019ffff640 1 -- 172.21.15.77:0/2467781909 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0037070 con 0x7f01a80ceaa0 2024-05-15T12:10:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f019ffff640 1 -- 172.21.15.77:0/2467781909 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a0032440 con 0x7f01a80ceaa0 2024-05-15T12:10:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.534+0000 7f019ffff640 1 -- 172.21.15.77:0/2467781909 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a0032810 con 0x7f01a80ceaa0 2024-05-15T12:10:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 -- 172.21.15.77:0/2467781909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80ceaa0 msgr2=0x7f01a806e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 --2- 172.21.15.77:0/2467781909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80ceaa0 0x7f01a806e960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f01a0009870 tx=0x7f01a002a1c0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 -- 172.21.15.77:0/2467781909 shutdown_connections 2024-05-15T12:10:30.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 --2- 172.21.15.77:0/2467781909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80ceaa0 0x7f01a806e960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 --2- 172.21.15.77:0/2467781909 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80b4a40 0x7f01a80ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 -- 172.21.15.77:0/2467781909 >> 172.21.15.77:0/2467781909 conn(0x7f01a806c810 msgr2=0x7f01a806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:30.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 -- 172.21.15.77:0/2467781909 shutdown_connections 2024-05-15T12:10:30.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.535+0000 7f01af89b640 1 -- 172.21.15.77:0/2467781909 wait complete. 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.536+0000 7f01af89b640 1 Processor -- start 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.536+0000 7f01af89b640 1 -- start start 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01af89b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 0x7f01a8072b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01af89b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80ceaa0 0x7f01a81f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01af89b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01a81469b0 0x7f01a8159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01af89b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01a80b5a80 con 0x7f01a80b4a40 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01af89b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f01a80b57a0 con 0x7f01a81469b0 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01af89b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f01a806eea0 con 0x7f01a80ceaa0 2024-05-15T12:10:30.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 0x7f01a8072b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 0x7f01a8072b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35582/0 (socket says 172.21.15.77:35582) 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 -- 172.21.15.77:0/2581598803 learned_addr learned my addr 172.21.15.77:0/2581598803 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ade38640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01a81469b0 0x7f01a8159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ace36640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80ceaa0 0x7f01a81f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 -- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80ceaa0 msgr2=0x7f01a81f8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80ceaa0 0x7f01a81f8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 -- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01a81469b0 msgr2=0x7f01a8159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.537+0000 7f01ad637640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01a81469b0 0x7f01a8159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f01ad637640 1 -- 172.21.15.77:0/2581598803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a80741c0 con 0x7f01a80b4a40 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f01ad637640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 0x7f01a8072b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c730 tx=0x7f01a400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a4003b70 con 0x7f01a80b4a40 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a4003d30 con 0x7f01a80b4a40 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01a400aa90 con 0x7f01a80b4a40 2024-05-15T12:10:30.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a8073120 con 0x7f01a80b4a40 2024-05-15T12:10:30.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.538+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a80736e0 con 0x7f01a80b4a40 2024-05-15T12:10:30.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.539+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a806a640 con 0x7f01a80b4a40 2024-05-15T12:10:30.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.539+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f01a400ac30 con 0x7f01a80b4a40 2024-05-15T12:10:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.540+0000 7f019dffb640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f018c0762d0 0x7f018c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.540+0000 7f01ace36640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f018c0762d0 0x7f018c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.540+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f01a40974c0 con 0x7f01a80b4a40 2024-05-15T12:10:30.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.541+0000 7f01ace36640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f018c0762d0 0x7f018c078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01a815d380 tx=0x7f0198008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:30.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.545+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f01a4060e20 con 0x7f01a80b4a40 2024-05-15T12:10:30.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.720+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f01a8160830 con 0x7f018c0762d0 2024-05-15T12:10:30.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.726+0000 7f019dffb640 1 -- 172.21.15.77:0/2581598803 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244802 (secure 0 0 0) 0x7f01a8160830 con 0x7f018c0762d0 2024-05-15T12:10:30.723 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f018c0762d0 msgr2=0x7f018c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f018c0762d0 0x7f018c078790 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f01a815d380 tx=0x7f0198008040 comp rx=0 tx=0).stop 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 msgr2=0x7f01a8072b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 0x7f01a8072b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01a400c730 tx=0x7f01a400cbf0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 shutdown_connections 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f018c0762d0 0x7f018c078790 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f01a80ceaa0 0x7f01a81f8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f01a81469b0 0x7f01a8159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 --2- 172.21.15.77:0/2581598803 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01a80b4a40 0x7f01a8072b40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 >> 172.21.15.77:0/2581598803 conn(0x7f01a806c810 msgr2=0x7f01a815fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 shutdown_connections 2024-05-15T12:10:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:30.729+0000 7f01af89b640 1 -- 172.21.15.77:0/2581598803 wait complete. 2024-05-15T12:10:30.734 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-05-15T12:10:30.251967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":107,"num_write_kb":1635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":126,"acting":126,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219892,"kb_used_data":3716,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754828,"statfs":{"total":773094113280,"available":772868943872,"internally_reserved":0,"allocated":3805184,"data_stored":2160826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.946665"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332398+0000","last_change":"2024-05-15T12:10:26.329573+0000","last_active":"2024-05-15T12:10:26.332398+0000","last_peered":"2024-05-15T12:10:26.332398+0000","last_clean":"2024-05-15T12:10:26.332398+0000","last_became_active":"2024-05-15T12:10:26.329332+0000","last_became_peered":"2024-05-15T12:10:26.329332+0000","last_unstale":"2024-05-15T12:10:26.332398+0000","last_undegraded":"2024-05-15T12:10:26.332398+0000","last_fullsized":"2024-05-15T12:10:26.332398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:07.846452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313778+0000","last_change":"2024-05-15T12:10:25.313778+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313778+0000","last_undegraded":"2024-05-15T12:10:25.313778+0000","last_fullsized":"2024-05-15T12:10:25.313778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313869+0000","last_change":"2024-05-15T12:10:25.313869+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313869+0000","last_undegraded":"2024-05-15T12:10:25.313869+0000","last_fullsized":"2024-05-15T12:10:25.313869+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334740+0000","last_change":"2024-05-15T12:10:26.331862+0000","last_active":"2024-05-15T12:10:26.334740+0000","last_peered":"2024-05-15T12:10:26.334740+0000","last_clean":"2024-05-15T12:10:26.334740+0000","last_became_active":"2024-05-15T12:10:26.331594+0000","last_became_peered":"2024-05-15T12:10:26.331594+0000","last_unstale":"2024-05-15T12:10:26.334740+0000","last_undegraded":"2024-05-15T12:10:26.334740+0000","last_fullsized":"2024-05-15T12:10:26.334740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:09.360516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.336854+0000","last_change":"2024-05-15T12:10:26.334487+0000","last_active":"2024-05-15T12:10:26.336854+0000","last_peered":"2024-05-15T12:10:26.336854+0000","last_clean":"2024-05-15T12:10:26.336854+0000","last_became_active":"2024-05-15T12:10:26.334107+0000","last_became_peered":"2024-05-15T12:10:26.334107+0000","last_unstale":"2024-05-15T12:10:26.336854+0000","last_undegraded":"2024-05-15T12:10:26.336854+0000","last_fullsized":"2024-05-15T12:10:26.336854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:20:30.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316030+0000","last_change":"2024-05-15T12:10:25.316030+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316030+0000","last_undegraded":"2024-05-15T12:10:25.316030+0000","last_fullsized":"2024-05-15T12:10:25.316030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390237+0000","last_change":"2024-05-15T12:10:26.326538+0000","last_active":"2024-05-15T12:10:27.390237+0000","last_peered":"2024-05-15T12:10:27.390237+0000","last_clean":"2024-05-15T12:10:27.390237+0000","last_became_active":"2024-05-15T12:10:26.326255+0000","last_became_peered":"2024-05-15T12:10:26.326255+0000","last_unstale":"2024-05-15T12:10:27.390237+0000","last_undegraded":"2024-05-15T12:10:27.390237+0000","last_fullsized":"2024-05-15T12:10:27.390237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:54:05.621651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390413+0000","last_change":"2024-05-15T12:10:26.327608+0000","last_active":"2024-05-15T12:10:27.390413+0000","last_peered":"2024-05-15T12:10:27.390413+0000","last_clean":"2024-05-15T12:10:27.390413+0000","last_became_active":"2024-05-15T12:10:26.327074+0000","last_became_peered":"2024-05-15T12:10:26.327074+0000","last_unstale":"2024-05-15T12:10:27.390413+0000","last_undegraded":"2024-05-15T12:10:27.390413+0000","last_fullsized":"2024-05-15T12:10:27.390413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:11:10.212218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315396+0000","last_change":"2024-05-15T12:10:25.315396+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315396+0000","last_undegraded":"2024-05-15T12:10:25.315396+0000","last_fullsized":"2024-05-15T12:10:25.315396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390500+0000","last_change":"2024-05-15T12:10:26.324662+0000","last_active":"2024-05-15T12:10:27.390500+0000","last_peered":"2024-05-15T12:10:27.390500+0000","last_clean":"2024-05-15T12:10:27.390500+0000","last_became_active":"2024-05-15T12:10:26.324350+0000","last_became_peered":"2024-05-15T12:10:26.324350+0000","last_unstale":"2024-05-15T12:10:27.390500+0000","last_undegraded":"2024-05-15T12:10:27.390500+0000","last_fullsized":"2024-05-15T12:10:27.390500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:51:42.858156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340180+0000","last_change":"2024-05-15T12:10:26.338780+0000","last_active":"2024-05-15T12:10:26.340180+0000","last_peered":"2024-05-15T12:10:26.340180+0000","last_clean":"2024-05-15T12:10:26.340180+0000","last_became_active":"2024-05-15T12:10:26.338184+0000","last_became_peered":"2024-05-15T12:10:26.338184+0000","last_unstale":"2024-05-15T12:10:26.340180+0000","last_undegraded":"2024-05-15T12:10:26.340180+0000","last_fullsized":"2024-05-15T12:10:26.340180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:47.781617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313834+0000","last_change":"2024-05-15T12:10:25.313834+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313834+0000","last_undegraded":"2024-05-15T12:10:25.313834+0000","last_fullsized":"2024-05-15T12:10:25.313834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.341197+0000","last_change":"2024-05-15T12:10:26.339432+0000","last_active":"2024-05-15T12:10:26.341197+0000","last_peered":"2024-05-15T12:10:26.341197+0000","last_clean":"2024-05-15T12:10:26.341197+0000","last_became_active":"2024-05-15T12:10:26.339178+0000","last_became_peered":"2024-05-15T12:10:26.339178+0000","last_unstale":"2024-05-15T12:10:26.341197+0000","last_undegraded":"2024-05-15T12:10:26.341197+0000","last_fullsized":"2024-05-15T12:10:26.341197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:30.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.311771+0000","last_change":"2024-05-15T12:10:25.311771+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.311771+0000","last_undegraded":"2024-05-15T12:10:25.311771+0000","last_fullsized":"2024-05-15T12:10:25.311771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334850+0000","last_change":"2024-05-15T12:10:26.333520+0000","last_active":"2024-05-15T12:10:26.334850+0000","last_peered":"2024-05-15T12:10:26.334850+0000","last_clean":"2024-05-15T12:10:26.334850+0000","last_became_active":"2024-05-15T12:10:26.333272+0000","last_became_peered":"2024-05-15T12:10:26.333272+0000","last_unstale":"2024-05-15T12:10:26.334850+0000","last_undegraded":"2024-05-15T12:10:26.334850+0000","last_fullsized":"2024-05-15T12:10:26.334850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:13.980419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390318+0000","last_change":"2024-05-15T12:10:26.321083+0000","last_active":"2024-05-15T12:10:27.390318+0000","last_peered":"2024-05-15T12:10:27.390318+0000","last_clean":"2024-05-15T12:10:27.390318+0000","last_became_active":"2024-05-15T12:10:26.320796+0000","last_became_peered":"2024-05-15T12:10:26.320796+0000","last_unstale":"2024-05-15T12:10:27.390318+0000","last_undegraded":"2024-05-15T12:10:27.390318+0000","last_fullsized":"2024-05-15T12:10:27.390318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:45.805779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390356+0000","last_change":"2024-05-15T12:10:26.331221+0000","last_active":"2024-05-15T12:10:27.390356+0000","last_peered":"2024-05-15T12:10:27.390356+0000","last_clean":"2024-05-15T12:10:27.390356+0000","last_became_active":"2024-05-15T12:10:26.330937+0000","last_became_peered":"2024-05-15T12:10:26.330937+0000","last_unstale":"2024-05-15T12:10:27.390356+0000","last_undegraded":"2024-05-15T12:10:27.390356+0000","last_fullsized":"2024-05-15T12:10:27.390356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:32.621036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334847+0000","last_change":"2024-05-15T12:10:26.333175+0000","last_active":"2024-05-15T12:10:26.334847+0000","last_peered":"2024-05-15T12:10:26.334847+0000","last_clean":"2024-05-15T12:10:26.334847+0000","last_became_active":"2024-05-15T12:10:26.332897+0000","last_became_peered":"2024-05-15T12:10:26.332897+0000","last_unstale":"2024-05-15T12:10:26.334847+0000","last_undegraded":"2024-05-15T12:10:26.334847+0000","last_fullsized":"2024-05-15T12:10:26.334847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:27.674677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315283+0000","last_change":"2024-05-15T12:10:25.315283+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315283+0000","last_undegraded":"2024-05-15T12:10:25.315283+0000","last_fullsized":"2024-05-15T12:10:25.315283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307912+0000","last_change":"2024-05-15T12:10:24.307912+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307912+0000","last_undegraded":"2024-05-15T12:10:24.307912+0000","last_fullsized":"2024-05-15T12:10:24.307912+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332193+0000","last_change":"2024-05-15T12:10:26.328020+0000","last_active":"2024-05-15T12:10:26.332193+0000","last_peered":"2024-05-15T12:10:26.332193+0000","last_clean":"2024-05-15T12:10:26.332193+0000","last_became_active":"2024-05-15T12:10:26.326527+0000","last_became_peered":"2024-05-15T12:10:26.326527+0000","last_unstale":"2024-05-15T12:10:26.332193+0000","last_undegraded":"2024-05-15T12:10:26.332193+0000","last_fullsized":"2024-05-15T12:10:26.332193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:35.506570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340319+0000","last_change":"2024-05-15T12:10:26.339019+0000","last_active":"2024-05-15T12:10:26.340319+0000","last_peered":"2024-05-15T12:10:26.340319+0000","last_clean":"2024-05-15T12:10:26.340319+0000","last_became_active":"2024-05-15T12:10:26.338742+0000","last_became_peered":"2024-05-15T12:10:26.338742+0000","last_unstale":"2024-05-15T12:10:26.340319+0000","last_undegraded":"2024-05-15T12:10:26.340319+0000","last_fullsized":"2024-05-15T12:10:26.340319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:56.628690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315398+0000","last_change":"2024-05-15T12:10:24.315398+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315398+0000","last_undegraded":"2024-05-15T12:10:24.315398+0000","last_fullsized":"2024-05-15T12:10:24.315398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307780+0000","last_change":"2024-05-15T12:10:24.307780+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307780+0000","last_undegraded":"2024-05-15T12:10:24.307780+0000","last_fullsized":"2024-05-15T12:10:24.307780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.338937+0000","last_change":"2024-05-15T12:10:25.321915+0000","last_active":"2024-05-15T12:10:26.338937+0000","last_peered":"2024-05-15T12:10:26.338937+0000","last_clean":"2024-05-15T12:10:26.338937+0000","last_became_active":"2024-05-15T12:10:25.321660+0000","last_became_peered":"2024-05-15T12:10:25.321660+0000","last_unstale":"2024-05-15T12:10:26.338937+0000","last_undegraded":"2024-05-15T12:10:26.338937+0000","last_fullsized":"2024-05-15T12:10:26.338937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:29.785965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334782+0000","last_change":"2024-05-15T12:10:26.331978+0000","last_active":"2024-05-15T12:10:26.334782+0000","last_peered":"2024-05-15T12:10:26.334782+0000","last_clean":"2024-05-15T12:10:26.334782+0000","last_became_active":"2024-05-15T12:10:26.331123+0000","last_became_peered":"2024-05-15T12:10:26.331123+0000","last_unstale":"2024-05-15T12:10:26.334782+0000","last_undegraded":"2024-05-15T12:10:26.334782+0000","last_fullsized":"2024-05-15T12:10:26.334782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:39.341123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340630+0000","last_change":"2024-05-15T12:10:25.318361+0000","last_active":"2024-05-15T12:10:26.340630+0000","last_peered":"2024-05-15T12:10:26.340630+0000","last_clean":"2024-05-15T12:10:26.340630+0000","last_became_active":"2024-05-15T12:10:25.318086+0000","last_became_peered":"2024-05-15T12:10:25.318086+0000","last_unstale":"2024-05-15T12:10:26.340630+0000","last_undegraded":"2024-05-15T12:10:26.340630+0000","last_fullsized":"2024-05-15T12:10:26.340630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:59.680962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315368+0000","last_change":"2024-05-15T12:10:24.315368+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315368+0000","last_undegraded":"2024-05-15T12:10:24.315368+0000","last_fullsized":"2024-05-15T12:10:24.315368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320866+0000","last_change":"2024-05-15T12:10:25.324046+0000","last_active":"2024-05-15T12:10:26.320866+0000","last_peered":"2024-05-15T12:10:26.320866+0000","last_clean":"2024-05-15T12:10:26.320866+0000","last_became_active":"2024-05-15T12:10:25.323741+0000","last_became_peered":"2024-05-15T12:10:25.323741+0000","last_unstale":"2024-05-15T12:10:26.320866+0000","last_undegraded":"2024-05-15T12:10:26.320866+0000","last_fullsized":"2024-05-15T12:10:26.320866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320860+0000","last_change":"2024-05-15T12:10:25.318998+0000","last_active":"2024-05-15T12:10:25.320860+0000","last_peered":"2024-05-15T12:10:25.320860+0000","last_clean":"2024-05-15T12:10:25.320860+0000","last_became_active":"2024-05-15T12:10:25.318702+0000","last_became_peered":"2024-05-15T12:10:25.318702+0000","last_unstale":"2024-05-15T12:10:25.320860+0000","last_undegraded":"2024-05-15T12:10:25.320860+0000","last_fullsized":"2024-05-15T12:10:25.320860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334099+0000","last_change":"2024-05-15T12:10:25.326922+0000","last_active":"2024-05-15T12:10:25.334099+0000","last_peered":"2024-05-15T12:10:25.334099+0000","last_clean":"2024-05-15T12:10:25.334099+0000","last_became_active":"2024-05-15T12:10:25.326654+0000","last_became_peered":"2024-05-15T12:10:25.326654+0000","last_unstale":"2024-05-15T12:10:25.334099+0000","last_undegraded":"2024-05-15T12:10:25.334099+0000","last_fullsized":"2024-05-15T12:10:25.334099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:06.836661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308403+0000","last_change":"2024-05-15T12:10:24.308403+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308403+0000","last_undegraded":"2024-05-15T12:10:24.308403+0000","last_fullsized":"2024-05-15T12:10:24.308403+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333858+0000","last_change":"2024-05-15T12:10:25.326873+0000","last_active":"2024-05-15T12:10:25.333858+0000","last_peered":"2024-05-15T12:10:25.333858+0000","last_clean":"2024-05-15T12:10:25.333858+0000","last_became_active":"2024-05-15T12:10:25.326527+0000","last_became_peered":"2024-05-15T12:10:25.326527+0000","last_unstale":"2024-05-15T12:10:25.333858+0000","last_undegraded":"2024-05-15T12:10:25.333858+0000","last_fullsized":"2024-05-15T12:10:25.333858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.316633+0000","last_change":"2024-05-15T12:10:25.316633+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.316633+0000","last_undegraded":"2024-05-15T12:10:25.316633+0000","last_fullsized":"2024-05-15T12:10:25.316633+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342398+0000","last_change":"2024-05-15T12:10:25.324206+0000","last_active":"2024-05-15T12:10:26.342398+0000","last_peered":"2024-05-15T12:10:26.342398+0000","last_clean":"2024-05-15T12:10:26.342398+0000","last_became_active":"2024-05-15T12:10:25.323870+0000","last_became_peered":"2024-05-15T12:10:25.323870+0000","last_unstale":"2024-05-15T12:10:26.342398+0000","last_undegraded":"2024-05-15T12:10:26.342398+0000","last_fullsized":"2024-05-15T12:10:26.342398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307773+0000","last_change":"2024-05-15T12:10:24.307773+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307773+0000","last_undegraded":"2024-05-15T12:10:24.307773+0000","last_fullsized":"2024-05-15T12:10:24.307773+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334677+0000","last_change":"2024-05-15T12:10:26.331819+0000","last_active":"2024-05-15T12:10:26.334677+0000","last_peered":"2024-05-15T12:10:26.334677+0000","last_clean":"2024-05-15T12:10:26.334677+0000","last_became_active":"2024-05-15T12:10:26.331530+0000","last_became_peered":"2024-05-15T12:10:26.331530+0000","last_unstale":"2024-05-15T12:10:26.334677+0000","last_undegraded":"2024-05-15T12:10:26.334677+0000","last_fullsized":"2024-05-15T12:10:26.334677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:35.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307859+0000","last_change":"2024-05-15T12:10:24.307859+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307859+0000","last_undegraded":"2024-05-15T12:10:24.307859+0000","last_fullsized":"2024-05-15T12:10:24.307859+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315335+0000","last_change":"2024-05-15T12:10:24.315335+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315335+0000","last_undegraded":"2024-05-15T12:10:24.315335+0000","last_fullsized":"2024-05-15T12:10:24.315335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.315411+0000","last_change":"2024-05-15T12:10:24.315411+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.315411+0000","last_undegraded":"2024-05-15T12:10:24.315411+0000","last_fullsized":"2024-05-15T12:10:24.315411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342495+0000","last_change":"2024-05-15T12:10:25.324285+0000","last_active":"2024-05-15T12:10:26.342495+0000","last_peered":"2024-05-15T12:10:26.342495+0000","last_clean":"2024-05-15T12:10:26.342495+0000","last_became_active":"2024-05-15T12:10:25.323952+0000","last_became_peered":"2024-05-15T12:10:25.323952+0000","last_unstale":"2024-05-15T12:10:26.342495+0000","last_undegraded":"2024-05-15T12:10:26.342495+0000","last_fullsized":"2024-05-15T12:10:26.342495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:55.449668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312240+0000","last_change":"2024-05-15T12:10:25.312240+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312240+0000","last_undegraded":"2024-05-15T12:10:25.312240+0000","last_fullsized":"2024-05-15T12:10:25.312240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308942+0000","last_change":"2024-05-15T12:10:24.308942+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308942+0000","last_undegraded":"2024-05-15T12:10:24.308942+0000","last_fullsized":"2024-05-15T12:10:24.308942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390487+0000","last_change":"2024-05-15T12:10:25.325393+0000","last_active":"2024-05-15T12:10:27.390487+0000","last_peered":"2024-05-15T12:10:27.390487+0000","last_clean":"2024-05-15T12:10:27.390487+0000","last_became_active":"2024-05-15T12:10:25.325157+0000","last_became_peered":"2024-05-15T12:10:25.325157+0000","last_unstale":"2024-05-15T12:10:27.390487+0000","last_undegraded":"2024-05-15T12:10:27.390487+0000","last_fullsized":"2024-05-15T12:10:27.390487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:59:44.019689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.315023+0000","last_change":"2024-05-15T12:10:25.315023+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.315023+0000","last_undegraded":"2024-05-15T12:10:25.315023+0000","last_fullsized":"2024-05-15T12:10:25.315023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326674+0000","last_change":"2024-05-15T12:10:25.324499+0000","last_active":"2024-05-15T12:10:25.326674+0000","last_peered":"2024-05-15T12:10:25.326674+0000","last_clean":"2024-05-15T12:10:25.326674+0000","last_became_active":"2024-05-15T12:10:25.324221+0000","last_became_peered":"2024-05-15T12:10:25.324221+0000","last_unstale":"2024-05-15T12:10:25.326674+0000","last_undegraded":"2024-05-15T12:10:25.326674+0000","last_fullsized":"2024-05-15T12:10:25.326674+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:34.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.312508+0000","last_change":"2024-05-15T12:10:25.312508+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.312508+0000","last_undegraded":"2024-05-15T12:10:25.312508+0000","last_fullsized":"2024-05-15T12:10:25.312508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.323806+0000","last_change":"2024-05-15T12:10:25.324364+0000","last_active":"2024-05-15T12:10:26.323806+0000","last_peered":"2024-05-15T12:10:26.323806+0000","last_clean":"2024-05-15T12:10:26.323806+0000","last_became_active":"2024-05-15T12:10:25.324098+0000","last_became_peered":"2024-05-15T12:10:25.324098+0000","last_unstale":"2024-05-15T12:10:26.323806+0000","last_undegraded":"2024-05-15T12:10:26.323806+0000","last_fullsized":"2024-05-15T12:10:26.323806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:41.292334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2024-05-15T12:10:25.313779+0000","last_change":"2024-05-15T12:10:25.313779+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.313779+0000","last_undegraded":"2024-05-15T12:10:25.313779+0000","last_fullsized":"2024-05-15T12:10:25.313779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.308561+0000","last_change":"2024-05-15T12:10:24.308561+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.308561+0000","last_undegraded":"2024-05-15T12:10:24.308561+0000","last_fullsized":"2024-05-15T12:10:24.308561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307884+0000","last_change":"2024-05-15T12:10:24.307884+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307884+0000","last_undegraded":"2024-05-15T12:10:24.307884+0000","last_fullsized":"2024-05-15T12:10:24.307884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.325565+0000","last_change":"2024-05-15T12:10:25.323229+0000","last_active":"2024-05-15T12:10:25.325565+0000","last_peered":"2024-05-15T12:10:25.325565+0000","last_clean":"2024-05-15T12:10:25.325565+0000","last_became_active":"2024-05-15T12:10:25.322944+0000","last_became_peered":"2024-05-15T12:10:25.322944+0000","last_unstale":"2024-05-15T12:10:25.325565+0000","last_undegraded":"2024-05-15T12:10:25.325565+0000","last_fullsized":"2024-05-15T12:10:25.325565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:55:34.310936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.334124+0000","last_change":"2024-05-15T12:10:25.327726+0000","last_active":"2024-05-15T12:10:25.334124+0000","last_peered":"2024-05-15T12:10:25.334124+0000","last_clean":"2024-05-15T12:10:25.334124+0000","last_became_active":"2024-05-15T12:10:25.327459+0000","last_became_peered":"2024-05-15T12:10:25.327459+0000","last_unstale":"2024-05-15T12:10:25.334124+0000","last_undegraded":"2024-05-15T12:10:25.334124+0000","last_fullsized":"2024-05-15T12:10:25.334124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:34.862252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.333880+0000","last_change":"2024-05-15T12:10:25.327309+0000","last_active":"2024-05-15T12:10:25.333880+0000","last_peered":"2024-05-15T12:10:25.333880+0000","last_clean":"2024-05-15T12:10:25.333880+0000","last_became_active":"2024-05-15T12:10:25.326869+0000","last_became_peered":"2024-05-15T12:10:25.326869+0000","last_unstale":"2024-05-15T12:10:25.333880+0000","last_undegraded":"2024-05-15T12:10:25.333880+0000","last_fullsized":"2024-05-15T12:10:25.333880+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390388+0000","last_change":"2024-05-15T12:10:26.327320+0000","last_active":"2024-05-15T12:10:27.390388+0000","last_peered":"2024-05-15T12:10:27.390388+0000","last_clean":"2024-05-15T12:10:27.390388+0000","last_became_active":"2024-05-15T12:10:26.327060+0000","last_became_peered":"2024-05-15T12:10:26.327060+0000","last_unstale":"2024-05-15T12:10:27.390388+0000","last_undegraded":"2024-05-15T12:10:27.390388+0000","last_fullsized":"2024-05-15T12:10:27.390388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:26:17.098269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.320386+0000","last_change":"2024-05-15T12:10:25.318831+0000","last_active":"2024-05-15T12:10:25.320386+0000","last_peered":"2024-05-15T12:10:25.320386+0000","last_clean":"2024-05-15T12:10:25.320386+0000","last_became_active":"2024-05-15T12:10:25.318544+0000","last_became_peered":"2024-05-15T12:10:25.318544+0000","last_unstale":"2024-05-15T12:10:25.320386+0000","last_undegraded":"2024-05-15T12:10:25.320386+0000","last_fullsized":"2024-05-15T12:10:25.320386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:51:58.938296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-05-15T12:10:25.326925+0000","last_change":"2024-05-15T12:10:25.324125+0000","last_active":"2024-05-15T12:10:25.326925+0000","last_peered":"2024-05-15T12:10:25.326925+0000","last_clean":"2024-05-15T12:10:25.326925+0000","last_became_active":"2024-05-15T12:10:25.323807+0000","last_became_peered":"2024-05-15T12:10:25.323807+0000","last_unstale":"2024-05-15T12:10:25.326925+0000","last_undegraded":"2024-05-15T12:10:25.326925+0000","last_fullsized":"2024-05-15T12:10:25.326925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:24:55.968122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320323+0000","last_change":"2024-05-15T12:10:25.324301+0000","last_active":"2024-05-15T12:10:26.320323+0000","last_peered":"2024-05-15T12:10:26.320323+0000","last_clean":"2024-05-15T12:10:26.320323+0000","last_became_active":"2024-05-15T12:10:25.323891+0000","last_became_peered":"2024-05-15T12:10:25.323891+0000","last_unstale":"2024-05-15T12:10:26.320323+0000","last_undegraded":"2024-05-15T12:10:26.320323+0000","last_fullsized":"2024-05-15T12:10:26.320323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-05-15T12:10:25.302821+0000","last_change":"2024-05-15T12:10:25.302821+0000","last_active":"2024-05-15T12:10:25.302821+0000","last_peered":"2024-05-15T12:10:25.302821+0000","last_clean":"2024-05-15T12:10:25.302821+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:25.302821+0000","last_undegraded":"2024-05-15T12:10:25.302821+0000","last_fullsized":"2024-05-15T12:10:25.302821+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307762+0000","last_change":"2024-05-15T12:10:24.307762+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307762+0000","last_undegraded":"2024-05-15T12:10:24.307762+0000","last_fullsized":"2024-05-15T12:10:24.307762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390450+0000","last_change":"2024-05-15T12:10:26.328610+0000","last_active":"2024-05-15T12:10:27.390450+0000","last_peered":"2024-05-15T12:10:27.390450+0000","last_clean":"2024-05-15T12:10:27.390450+0000","last_became_active":"2024-05-15T12:10:26.328358+0000","last_became_peered":"2024-05-15T12:10:26.328358+0000","last_unstale":"2024-05-15T12:10:27.390450+0000","last_undegraded":"2024-05-15T12:10:27.390450+0000","last_fullsized":"2024-05-15T12:10:27.390450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:51:30.820789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-05-15T12:10:24.307892+0000","last_change":"2024-05-15T12:10:24.307892+0000","last_active":"2024-05-15T12:10:24.293030+0000","last_peered":"2024-05-15T12:10:24.293030+0000","last_clean":"2024-05-15T12:10:24.293030+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-15T12:10:24.307892+0000","last_undegraded":"2024-05-15T12:10:24.307892+0000","last_fullsized":"2024-05-15T12:10:24.307892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":125,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-15T12:10:24.306876+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:10:24.306876+0000","last_peered":"2024-05-15T12:10:24.306876+0000","last_clean":"2024-05-15T12:10:24.306876+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:10:24.306876+0000","last_undegraded":"2024-05-15T12:10:24.306876+0000","last_fullsized":"2024-05-15T12:10:24.306876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":123152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509455,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":921600,"data_stored":713520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542159,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542159,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":315392,"data_stored":116877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542157,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":909312,"data_stored":707245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":136317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:10:31.288 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T12:10:31.294+0000 7fbecdbf2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-15T12:10:33.738 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T12:10:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.856+0000 7f009749b640 1 Processor -- start 2024-05-15T12:10:33.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.857+0000 7f009749b640 1 -- start start 2024-05-15T12:10:33.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.857+0000 7f009749b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f009015f460 0x7f00900d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f009749b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f00900d0770 0x7f00900d3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f009749b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00900d0dd0 con 0x7f009015f840 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f009749b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f00900d19e0 con 0x7f009015f460 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f009749b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f00900d10b0 con 0x7f00900d0770 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f009015f460 0x7f00900d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f009015f460 0x7f00900d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56498/0 (socket says 172.21.15.77:56498) 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 -- 172.21.15.77:0/2399764674 learned_addr learned my addr 172.21.15.77:0/2399764674 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095a38640 1 --2- 172.21.15.77:0/2399764674 >> v2:172.21.15.83:3300/0 conn(0x7f00900d0770 0x7f00900d3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 -- 172.21.15.77:0/2399764674 >> v2:172.21.15.83:3300/0 conn(0x7f00900d0770 msgr2=0x7f00900d3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 --2- 172.21.15.77:0/2399764674 >> v2:172.21.15.83:3300/0 conn(0x7f00900d0770 0x7f00900d3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 -- 172.21.15.77:0/2399764674 >> v1:172.21.15.83:6789/0 conn(0x7f009015f840 legacy=0x7f00900d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:33.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.858+0000 7f0095237640 1 -- 172.21.15.77:0/2399764674 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900d1390 con 0x7f009015f460 2024-05-15T12:10:33.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f0095237640 1 --2- 172.21.15.77:0/2399764674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f460 0x7f00900d38c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f00900d5fa0 tx=0x7f008c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76856f240a734e39 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f0087fff640 1 -- 172.21.15.77:0/2399764674 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c037070 con 0x7f009015f460 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f0087fff640 1 -- 172.21.15.77:0/2399764674 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008c032440 con 0x7f009015f460 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f0087fff640 1 -- 172.21.15.77:0/2399764674 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008c032810 con 0x7f009015f460 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f009749b640 1 -- 172.21.15.77:0/2399764674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f460 msgr2=0x7f00900d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f009749b640 1 --2- 172.21.15.77:0/2399764674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f460 0x7f00900d38c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f00900d5fa0 tx=0x7f008c02a140 comp rx=0 tx=0).stop 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f009749b640 1 -- 172.21.15.77:0/2399764674 shutdown_connections 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.859+0000 7f009749b640 1 --2- 172.21.15.77:0/2399764674 >> v2:172.21.15.83:3300/0 conn(0x7f00900d0770 0x7f00900d3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.860+0000 7f009749b640 1 --2- 172.21.15.77:0/2399764674 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f460 0x7f00900d38c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.860+0000 7f009749b640 1 -- 172.21.15.77:0/2399764674 >> 172.21.15.77:0/2399764674 conn(0x7f009008ec10 msgr2=0x7f009009e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.860+0000 7f009749b640 1 -- 172.21.15.77:0/2399764674 shutdown_connections 2024-05-15T12:10:33.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.860+0000 7f009749b640 1 -- 172.21.15.77:0/2399764674 wait complete. 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.861+0000 7f009749b640 1 Processor -- start 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.861+0000 7f009749b640 1 -- start start 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f00900d0770 0x7f00900cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009015f460 0x7f00900b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 0x7f00900d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00900b4b80 con 0x7f009015f840 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f00900b4a00 con 0x7f009015f460 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f00900b4d00 con 0x7f00900d0770 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 0x7f00900d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 0x7f00900d2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56514/0 (socket says 172.21.15.77:56514) 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 -- 172.21.15.77:0/1337377689 learned_addr learned my addr 172.21.15.77:0/1337377689 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:33.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0094a36640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009015f460 0x7f00900b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095237640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f00900d0770 0x7f00900cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 -- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f00900d0770 msgr2=0x7f00900cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f00900d0770 0x7f00900cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 -- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009015f460 msgr2=0x7f00900b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009015f460 0x7f00900b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 -- 172.21.15.77:0/1337377689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900b92c0 con 0x7f009015f840 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0094a36640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009015f460 0x7f00900b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0095a38640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 0x7f00900d2e90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0088007e70 tx=0x7f008800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088014620 con 0x7f009015f840 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0088019070 con 0x7f009015f840 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00900b9560 con 0x7f009015f840 2024-05-15T12:10:33.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.862+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088014a20 con 0x7f009015f840 2024-05-15T12:10:33.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.863+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00900b9b20 con 0x7f009015f840 2024-05-15T12:10:33.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.863+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f009006a640 con 0x7f009015f840 2024-05-15T12:10:33.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.864+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0088014bc0 con 0x7f009015f840 2024-05-15T12:10:33.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.865+0000 7f0085ffb640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0074076300 0x7f00740787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:33.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.865+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0088097e30 con 0x7f009015f840 2024-05-15T12:10:33.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.865+0000 7f0095237640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0074076300 0x7f00740787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:33.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.865+0000 7f0095237640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0074076300 0x7f00740787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f008c034000 tx=0x7f008c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:33.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:33.869+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0088061820 con 0x7f009015f840 2024-05-15T12:10:34.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.045+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0090154d00 con 0x7f0074076300 2024-05-15T12:10:34.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.051+0000 7f0085ffb640 1 -- 172.21.15.77:0/1337377689 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7f008c07f830 con 0x7f0074076300 2024-05-15T12:10:34.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:34.049 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0074076300 msgr2=0x7f00740787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0074076300 0x7f00740787c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f008c034000 tx=0x7f008c02e000 comp rx=0 tx=0).stop 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 msgr2=0x7f00900d2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 0x7f00900d2e90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0088007e70 tx=0x7f008800e4b0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 shutdown_connections 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0074076300 0x7f00740787c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f009015f840 0x7f00900d2e90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f009015f460 0x7f00900b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 --2- 172.21.15.77:0/1337377689 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f00900d0770 0x7f00900cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 >> 172.21.15.77:0/1337377689 conn(0x7f009008ec10 msgr2=0x7f009015e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 shutdown_connections 2024-05-15T12:10:34.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.054+0000 7f009749b640 1 -- 172.21.15.77:0/1337377689 wait complete. 2024-05-15T12:10:34.059 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-05-15T12:10:32.252356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220156,"kb_used_data":3964,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754564,"statfs":{"total":773094113280,"available":772868673536,"internally_reserved":0,"allocated":4059136,"data_stored":2269072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.943984"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332398+0000","last_change":"2024-05-15T12:10:26.329573+0000","last_active":"2024-05-15T12:10:26.332398+0000","last_peered":"2024-05-15T12:10:26.332398+0000","last_clean":"2024-05-15T12:10:26.332398+0000","last_became_active":"2024-05-15T12:10:26.329332+0000","last_became_peered":"2024-05-15T12:10:26.329332+0000","last_unstale":"2024-05-15T12:10:26.332398+0000","last_undegraded":"2024-05-15T12:10:26.332398+0000","last_fullsized":"2024-05-15T12:10:26.332398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:07.846452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391407+0000","last_change":"2024-05-15T12:10:26.326221+0000","last_active":"2024-05-15T12:10:27.391407+0000","last_peered":"2024-05-15T12:10:27.391407+0000","last_clean":"2024-05-15T12:10:27.391407+0000","last_became_active":"2024-05-15T12:10:26.325949+0000","last_became_peered":"2024-05-15T12:10:26.325949+0000","last_unstale":"2024-05-15T12:10:27.391407+0000","last_undegraded":"2024-05-15T12:10:27.391407+0000","last_fullsized":"2024-05-15T12:10:27.391407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:04:03.484090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391170+0000","last_change":"2024-05-15T12:10:26.323130+0000","last_active":"2024-05-15T12:10:27.391170+0000","last_peered":"2024-05-15T12:10:27.391170+0000","last_clean":"2024-05-15T12:10:27.391170+0000","last_became_active":"2024-05-15T12:10:26.322851+0000","last_became_peered":"2024-05-15T12:10:26.322851+0000","last_unstale":"2024-05-15T12:10:27.391170+0000","last_undegraded":"2024-05-15T12:10:27.391170+0000","last_fullsized":"2024-05-15T12:10:27.391170+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:42.302125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327185+0000","last_change":"2024-05-15T12:10:26.333523+0000","last_active":"2024-05-15T12:10:27.327185+0000","last_peered":"2024-05-15T12:10:27.327185+0000","last_clean":"2024-05-15T12:10:27.327185+0000","last_became_active":"2024-05-15T12:10:26.330947+0000","last_became_peered":"2024-05-15T12:10:26.330947+0000","last_unstale":"2024-05-15T12:10:27.327185+0000","last_undegraded":"2024-05-15T12:10:27.327185+0000","last_fullsized":"2024-05-15T12:10:27.327185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:40:00.763302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391043+0000","last_change":"2024-05-15T12:10:26.331037+0000","last_active":"2024-05-15T12:10:27.391043+0000","last_peered":"2024-05-15T12:10:27.391043+0000","last_clean":"2024-05-15T12:10:27.391043+0000","last_became_active":"2024-05-15T12:10:26.330772+0000","last_became_peered":"2024-05-15T12:10:26.330772+0000","last_unstale":"2024-05-15T12:10:27.391043+0000","last_undegraded":"2024-05-15T12:10:27.391043+0000","last_fullsized":"2024-05-15T12:10:27.391043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:21.298756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390945+0000","last_change":"2024-05-15T12:10:26.333843+0000","last_active":"2024-05-15T12:10:27.390945+0000","last_peered":"2024-05-15T12:10:27.390945+0000","last_clean":"2024-05-15T12:10:27.390945+0000","last_became_active":"2024-05-15T12:10:26.333579+0000","last_became_peered":"2024-05-15T12:10:26.333579+0000","last_unstale":"2024-05-15T12:10:27.390945+0000","last_undegraded":"2024-05-15T12:10:27.390945+0000","last_fullsized":"2024-05-15T12:10:27.390945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:34:00.690752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334740+0000","last_change":"2024-05-15T12:10:26.331862+0000","last_active":"2024-05-15T12:10:26.334740+0000","last_peered":"2024-05-15T12:10:26.334740+0000","last_clean":"2024-05-15T12:10:26.334740+0000","last_became_active":"2024-05-15T12:10:26.331594+0000","last_became_peered":"2024-05-15T12:10:26.331594+0000","last_unstale":"2024-05-15T12:10:26.334740+0000","last_undegraded":"2024-05-15T12:10:26.334740+0000","last_fullsized":"2024-05-15T12:10:26.334740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:09.360516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.336854+0000","last_change":"2024-05-15T12:10:26.334487+0000","last_active":"2024-05-15T12:10:26.336854+0000","last_peered":"2024-05-15T12:10:26.336854+0000","last_clean":"2024-05-15T12:10:26.336854+0000","last_became_active":"2024-05-15T12:10:26.334107+0000","last_became_peered":"2024-05-15T12:10:26.334107+0000","last_unstale":"2024-05-15T12:10:26.336854+0000","last_undegraded":"2024-05-15T12:10:26.336854+0000","last_fullsized":"2024-05-15T12:10:26.336854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:20:30.544244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391200+0000","last_change":"2024-05-15T12:10:26.326419+0000","last_active":"2024-05-15T12:10:27.391200+0000","last_peered":"2024-05-15T12:10:27.391200+0000","last_clean":"2024-05-15T12:10:27.391200+0000","last_became_active":"2024-05-15T12:10:26.325659+0000","last_became_peered":"2024-05-15T12:10:26.325659+0000","last_unstale":"2024-05-15T12:10:27.391200+0000","last_undegraded":"2024-05-15T12:10:27.391200+0000","last_fullsized":"2024-05-15T12:10:27.391200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:30.795756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327395+0000","last_change":"2024-05-15T12:10:26.321177+0000","last_active":"2024-05-15T12:10:27.327395+0000","last_peered":"2024-05-15T12:10:27.327395+0000","last_clean":"2024-05-15T12:10:27.327395+0000","last_became_active":"2024-05-15T12:10:26.320905+0000","last_became_peered":"2024-05-15T12:10:26.320905+0000","last_unstale":"2024-05-15T12:10:27.327395+0000","last_undegraded":"2024-05-15T12:10:27.327395+0000","last_fullsized":"2024-05-15T12:10:27.327395+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:24:43.047098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326785+0000","last_change":"2024-05-15T12:10:26.330107+0000","last_active":"2024-05-15T12:10:27.326785+0000","last_peered":"2024-05-15T12:10:27.326785+0000","last_clean":"2024-05-15T12:10:27.326785+0000","last_became_active":"2024-05-15T12:10:26.329494+0000","last_became_peered":"2024-05-15T12:10:26.329494+0000","last_unstale":"2024-05-15T12:10:27.326785+0000","last_undegraded":"2024-05-15T12:10:27.326785+0000","last_fullsized":"2024-05-15T12:10:27.326785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:42:53.131159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390991+0000","last_change":"2024-05-15T12:10:26.326246+0000","last_active":"2024-05-15T12:10:27.390991+0000","last_peered":"2024-05-15T12:10:27.390991+0000","last_clean":"2024-05-15T12:10:27.390991+0000","last_became_active":"2024-05-15T12:10:26.325986+0000","last_became_peered":"2024-05-15T12:10:26.325986+0000","last_unstale":"2024-05-15T12:10:27.390991+0000","last_undegraded":"2024-05-15T12:10:27.390991+0000","last_fullsized":"2024-05-15T12:10:27.390991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:34:00.690752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391974+0000","last_change":"2024-05-15T12:10:26.336741+0000","last_active":"2024-05-15T12:10:27.391974+0000","last_peered":"2024-05-15T12:10:27.391974+0000","last_clean":"2024-05-15T12:10:27.391974+0000","last_became_active":"2024-05-15T12:10:26.335691+0000","last_became_peered":"2024-05-15T12:10:26.335691+0000","last_unstale":"2024-05-15T12:10:27.391974+0000","last_undegraded":"2024-05-15T12:10:27.391974+0000","last_fullsized":"2024-05-15T12:10:27.391974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:01:21.298756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327150+0000","last_change":"2024-05-15T12:10:26.321238+0000","last_active":"2024-05-15T12:10:27.327150+0000","last_peered":"2024-05-15T12:10:27.327150+0000","last_clean":"2024-05-15T12:10:27.327150+0000","last_became_active":"2024-05-15T12:10:26.320955+0000","last_became_peered":"2024-05-15T12:10:26.320955+0000","last_unstale":"2024-05-15T12:10:27.327150+0000","last_undegraded":"2024-05-15T12:10:27.327150+0000","last_fullsized":"2024-05-15T12:10:27.327150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:10:08.087259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390237+0000","last_change":"2024-05-15T12:10:26.326538+0000","last_active":"2024-05-15T12:10:27.390237+0000","last_peered":"2024-05-15T12:10:27.390237+0000","last_clean":"2024-05-15T12:10:27.390237+0000","last_became_active":"2024-05-15T12:10:26.326255+0000","last_became_peered":"2024-05-15T12:10:26.326255+0000","last_unstale":"2024-05-15T12:10:27.390237+0000","last_undegraded":"2024-05-15T12:10:27.390237+0000","last_fullsized":"2024-05-15T12:10:27.390237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:54:05.621651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390413+0000","last_change":"2024-05-15T12:10:26.327608+0000","last_active":"2024-05-15T12:10:27.390413+0000","last_peered":"2024-05-15T12:10:27.390413+0000","last_clean":"2024-05-15T12:10:27.390413+0000","last_became_active":"2024-05-15T12:10:26.327074+0000","last_became_peered":"2024-05-15T12:10:26.327074+0000","last_unstale":"2024-05-15T12:10:27.390413+0000","last_undegraded":"2024-05-15T12:10:27.390413+0000","last_fullsized":"2024-05-15T12:10:27.390413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:11:10.212218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327273+0000","last_change":"2024-05-15T12:10:26.335688+0000","last_active":"2024-05-15T12:10:27.327273+0000","last_peered":"2024-05-15T12:10:27.327273+0000","last_clean":"2024-05-15T12:10:27.327273+0000","last_became_active":"2024-05-15T12:10:26.335406+0000","last_became_peered":"2024-05-15T12:10:26.335406+0000","last_unstale":"2024-05-15T12:10:27.327273+0000","last_undegraded":"2024-05-15T12:10:27.327273+0000","last_fullsized":"2024-05-15T12:10:27.327273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:56:55.503015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391478+0000","last_change":"2024-05-15T12:10:26.334811+0000","last_active":"2024-05-15T12:10:27.391478+0000","last_peered":"2024-05-15T12:10:27.391478+0000","last_clean":"2024-05-15T12:10:27.391478+0000","last_became_active":"2024-05-15T12:10:26.334249+0000","last_became_peered":"2024-05-15T12:10:26.334249+0000","last_unstale":"2024-05-15T12:10:27.391478+0000","last_undegraded":"2024-05-15T12:10:27.391478+0000","last_fullsized":"2024-05-15T12:10:27.391478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:42.302125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391500+0000","last_change":"2024-05-15T12:10:26.331260+0000","last_active":"2024-05-15T12:10:27.391500+0000","last_peered":"2024-05-15T12:10:27.391500+0000","last_clean":"2024-05-15T12:10:27.391500+0000","last_became_active":"2024-05-15T12:10:26.330991+0000","last_became_peered":"2024-05-15T12:10:26.330991+0000","last_unstale":"2024-05-15T12:10:27.391500+0000","last_undegraded":"2024-05-15T12:10:27.391500+0000","last_fullsized":"2024-05-15T12:10:27.391500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:30.795756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.392020+0000","last_change":"2024-05-15T12:10:26.327443+0000","last_active":"2024-05-15T12:10:27.392020+0000","last_peered":"2024-05-15T12:10:27.392020+0000","last_clean":"2024-05-15T12:10:27.392020+0000","last_became_active":"2024-05-15T12:10:26.327145+0000","last_became_peered":"2024-05-15T12:10:26.327145+0000","last_unstale":"2024-05-15T12:10:27.392020+0000","last_undegraded":"2024-05-15T12:10:27.392020+0000","last_fullsized":"2024-05-15T12:10:27.392020+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:48.692167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390500+0000","last_change":"2024-05-15T12:10:26.324662+0000","last_active":"2024-05-15T12:10:27.390500+0000","last_peered":"2024-05-15T12:10:27.390500+0000","last_clean":"2024-05-15T12:10:27.390500+0000","last_became_active":"2024-05-15T12:10:26.324350+0000","last_became_peered":"2024-05-15T12:10:26.324350+0000","last_unstale":"2024-05-15T12:10:27.390500+0000","last_undegraded":"2024-05-15T12:10:27.390500+0000","last_fullsized":"2024-05-15T12:10:27.390500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:51:42.858156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340180+0000","last_change":"2024-05-15T12:10:26.338780+0000","last_active":"2024-05-15T12:10:26.340180+0000","last_peered":"2024-05-15T12:10:26.340180+0000","last_clean":"2024-05-15T12:10:26.340180+0000","last_became_active":"2024-05-15T12:10:26.338184+0000","last_became_peered":"2024-05-15T12:10:26.338184+0000","last_unstale":"2024-05-15T12:10:26.340180+0000","last_undegraded":"2024-05-15T12:10:26.340180+0000","last_fullsized":"2024-05-15T12:10:26.340180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:47.781617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390944+0000","last_change":"2024-05-15T12:10:26.330889+0000","last_active":"2024-05-15T12:10:27.390944+0000","last_peered":"2024-05-15T12:10:27.390944+0000","last_clean":"2024-05-15T12:10:27.390944+0000","last_became_active":"2024-05-15T12:10:26.330588+0000","last_became_peered":"2024-05-15T12:10:26.330588+0000","last_unstale":"2024-05-15T12:10:27.390944+0000","last_undegraded":"2024-05-15T12:10:27.390944+0000","last_fullsized":"2024-05-15T12:10:27.390944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:56.628690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.341197+0000","last_change":"2024-05-15T12:10:26.339432+0000","last_active":"2024-05-15T12:10:26.341197+0000","last_peered":"2024-05-15T12:10:26.341197+0000","last_clean":"2024-05-15T12:10:26.341197+0000","last_became_active":"2024-05-15T12:10:26.339178+0000","last_became_peered":"2024-05-15T12:10:26.339178+0000","last_unstale":"2024-05-15T12:10:26.341197+0000","last_undegraded":"2024-05-15T12:10:26.341197+0000","last_fullsized":"2024-05-15T12:10:26.341197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:30.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327384+0000","last_change":"2024-05-15T12:10:26.337285+0000","last_active":"2024-05-15T12:10:27.327384+0000","last_peered":"2024-05-15T12:10:27.327384+0000","last_clean":"2024-05-15T12:10:27.327384+0000","last_became_active":"2024-05-15T12:10:26.337028+0000","last_became_peered":"2024-05-15T12:10:26.337028+0000","last_unstale":"2024-05-15T12:10:27.327384+0000","last_undegraded":"2024-05-15T12:10:27.327384+0000","last_fullsized":"2024-05-15T12:10:27.327384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:49:56.796581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327454+0000","last_change":"2024-05-15T12:10:26.320565+0000","last_active":"2024-05-15T12:10:27.327454+0000","last_peered":"2024-05-15T12:10:27.327454+0000","last_clean":"2024-05-15T12:10:27.327454+0000","last_became_active":"2024-05-15T12:10:26.320130+0000","last_became_peered":"2024-05-15T12:10:26.320130+0000","last_unstale":"2024-05-15T12:10:27.327454+0000","last_undegraded":"2024-05-15T12:10:27.327454+0000","last_fullsized":"2024-05-15T12:10:27.327454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:25:09.785765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391025+0000","last_change":"2024-05-15T12:10:26.324016+0000","last_active":"2024-05-15T12:10:27.391025+0000","last_peered":"2024-05-15T12:10:27.391025+0000","last_clean":"2024-05-15T12:10:27.391025+0000","last_became_active":"2024-05-15T12:10:26.323729+0000","last_became_peered":"2024-05-15T12:10:26.323729+0000","last_unstale":"2024-05-15T12:10:27.391025+0000","last_undegraded":"2024-05-15T12:10:27.391025+0000","last_fullsized":"2024-05-15T12:10:27.391025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:40:32.533928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334850+0000","last_change":"2024-05-15T12:10:26.333520+0000","last_active":"2024-05-15T12:10:26.334850+0000","last_peered":"2024-05-15T12:10:26.334850+0000","last_clean":"2024-05-15T12:10:26.334850+0000","last_became_active":"2024-05-15T12:10:26.333272+0000","last_became_peered":"2024-05-15T12:10:26.333272+0000","last_unstale":"2024-05-15T12:10:26.334850+0000","last_undegraded":"2024-05-15T12:10:26.334850+0000","last_fullsized":"2024-05-15T12:10:26.334850+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:13.980419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390318+0000","last_change":"2024-05-15T12:10:26.321083+0000","last_active":"2024-05-15T12:10:27.390318+0000","last_peered":"2024-05-15T12:10:27.390318+0000","last_clean":"2024-05-15T12:10:27.390318+0000","last_became_active":"2024-05-15T12:10:26.320796+0000","last_became_peered":"2024-05-15T12:10:26.320796+0000","last_unstale":"2024-05-15T12:10:27.390318+0000","last_undegraded":"2024-05-15T12:10:27.390318+0000","last_fullsized":"2024-05-15T12:10:27.390318+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:19:45.805779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390356+0000","last_change":"2024-05-15T12:10:26.331221+0000","last_active":"2024-05-15T12:10:27.390356+0000","last_peered":"2024-05-15T12:10:27.390356+0000","last_clean":"2024-05-15T12:10:27.390356+0000","last_became_active":"2024-05-15T12:10:26.330937+0000","last_became_peered":"2024-05-15T12:10:26.330937+0000","last_unstale":"2024-05-15T12:10:27.390356+0000","last_undegraded":"2024-05-15T12:10:27.390356+0000","last_fullsized":"2024-05-15T12:10:27.390356+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:32.621036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334847+0000","last_change":"2024-05-15T12:10:26.333175+0000","last_active":"2024-05-15T12:10:26.334847+0000","last_peered":"2024-05-15T12:10:26.334847+0000","last_clean":"2024-05-15T12:10:26.334847+0000","last_became_active":"2024-05-15T12:10:26.332897+0000","last_became_peered":"2024-05-15T12:10:26.332897+0000","last_unstale":"2024-05-15T12:10:26.334847+0000","last_undegraded":"2024-05-15T12:10:26.334847+0000","last_fullsized":"2024-05-15T12:10:26.334847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:27.674677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327098+0000","last_change":"2024-05-15T12:10:26.335577+0000","last_active":"2024-05-15T12:10:27.327098+0000","last_peered":"2024-05-15T12:10:27.327098+0000","last_clean":"2024-05-15T12:10:27.327098+0000","last_became_active":"2024-05-15T12:10:26.335284+0000","last_became_peered":"2024-05-15T12:10:26.335284+0000","last_unstale":"2024-05-15T12:10:27.327098+0000","last_undegraded":"2024-05-15T12:10:27.327098+0000","last_fullsized":"2024-05-15T12:10:27.327098+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:59:53.008681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391383+0000","last_change":"2024-05-15T12:10:26.335074+0000","last_active":"2024-05-15T12:10:27.391383+0000","last_peered":"2024-05-15T12:10:27.391383+0000","last_clean":"2024-05-15T12:10:27.391383+0000","last_became_active":"2024-05-15T12:10:26.334483+0000","last_became_peered":"2024-05-15T12:10:26.334483+0000","last_unstale":"2024-05-15T12:10:27.391383+0000","last_undegraded":"2024-05-15T12:10:27.391383+0000","last_fullsized":"2024-05-15T12:10:27.391383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:30.123529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327352+0000","last_change":"2024-05-15T12:10:25.327957+0000","last_active":"2024-05-15T12:10:27.327352+0000","last_peered":"2024-05-15T12:10:27.327352+0000","last_clean":"2024-05-15T12:10:27.327352+0000","last_became_active":"2024-05-15T12:10:25.327651+0000","last_became_peered":"2024-05-15T12:10:25.327651+0000","last_unstale":"2024-05-15T12:10:27.327352+0000","last_undegraded":"2024-05-15T12:10:27.327352+0000","last_fullsized":"2024-05-15T12:10:27.327352+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:34:20.511694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.332193+0000","last_change":"2024-05-15T12:10:26.328020+0000","last_active":"2024-05-15T12:10:26.332193+0000","last_peered":"2024-05-15T12:10:26.332193+0000","last_clean":"2024-05-15T12:10:26.332193+0000","last_became_active":"2024-05-15T12:10:26.326527+0000","last_became_peered":"2024-05-15T12:10:26.326527+0000","last_unstale":"2024-05-15T12:10:26.332193+0000","last_undegraded":"2024-05-15T12:10:26.332193+0000","last_fullsized":"2024-05-15T12:10:26.332193+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:35.506570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327456+0000","last_change":"2024-05-15T12:10:25.322017+0000","last_active":"2024-05-15T12:10:27.327456+0000","last_peered":"2024-05-15T12:10:27.327456+0000","last_clean":"2024-05-15T12:10:27.327456+0000","last_became_active":"2024-05-15T12:10:25.321727+0000","last_became_peered":"2024-05-15T12:10:25.321727+0000","last_unstale":"2024-05-15T12:10:27.327456+0000","last_undegraded":"2024-05-15T12:10:27.327456+0000","last_fullsized":"2024-05-15T12:10:27.327456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:41:48.110470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340319+0000","last_change":"2024-05-15T12:10:26.339019+0000","last_active":"2024-05-15T12:10:26.340319+0000","last_peered":"2024-05-15T12:10:26.340319+0000","last_clean":"2024-05-15T12:10:26.340319+0000","last_became_active":"2024-05-15T12:10:26.338742+0000","last_became_peered":"2024-05-15T12:10:26.338742+0000","last_unstale":"2024-05-15T12:10:26.340319+0000","last_undegraded":"2024-05-15T12:10:26.340319+0000","last_fullsized":"2024-05-15T12:10:26.340319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:04:56.628690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391709+0000","last_change":"2024-05-15T12:10:25.328813+0000","last_active":"2024-05-15T12:10:27.391709+0000","last_peered":"2024-05-15T12:10:27.391709+0000","last_clean":"2024-05-15T12:10:27.391709+0000","last_became_active":"2024-05-15T12:10:25.328530+0000","last_became_peered":"2024-05-15T12:10:25.328530+0000","last_unstale":"2024-05-15T12:10:27.391709+0000","last_undegraded":"2024-05-15T12:10:27.391709+0000","last_fullsized":"2024-05-15T12:10:27.391709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:58:33.467287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327142+0000","last_change":"2024-05-15T12:10:26.328290+0000","last_active":"2024-05-15T12:10:27.327142+0000","last_peered":"2024-05-15T12:10:27.327142+0000","last_clean":"2024-05-15T12:10:27.327142+0000","last_became_active":"2024-05-15T12:10:26.327649+0000","last_became_peered":"2024-05-15T12:10:26.327649+0000","last_unstale":"2024-05-15T12:10:27.327142+0000","last_undegraded":"2024-05-15T12:10:27.327142+0000","last_fullsized":"2024-05-15T12:10:27.327142+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:29:15.517913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327235+0000","last_change":"2024-05-15T12:10:25.325204+0000","last_active":"2024-05-15T12:10:27.327235+0000","last_peered":"2024-05-15T12:10:27.327235+0000","last_clean":"2024-05-15T12:10:27.327235+0000","last_became_active":"2024-05-15T12:10:25.324866+0000","last_became_peered":"2024-05-15T12:10:25.324866+0000","last_unstale":"2024-05-15T12:10:27.327235+0000","last_undegraded":"2024-05-15T12:10:27.327235+0000","last_fullsized":"2024-05-15T12:10:27.327235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:19:15.904026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390959+0000","last_change":"2024-05-15T12:10:26.323874+0000","last_active":"2024-05-15T12:10:27.390959+0000","last_peered":"2024-05-15T12:10:27.390959+0000","last_clean":"2024-05-15T12:10:27.390959+0000","last_became_active":"2024-05-15T12:10:26.323632+0000","last_became_peered":"2024-05-15T12:10:26.323632+0000","last_unstale":"2024-05-15T12:10:27.390959+0000","last_undegraded":"2024-05-15T12:10:27.390959+0000","last_fullsized":"2024-05-15T12:10:27.390959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:56.459459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.338937+0000","last_change":"2024-05-15T12:10:25.321915+0000","last_active":"2024-05-15T12:10:26.338937+0000","last_peered":"2024-05-15T12:10:26.338937+0000","last_clean":"2024-05-15T12:10:26.338937+0000","last_became_active":"2024-05-15T12:10:25.321660+0000","last_became_peered":"2024-05-15T12:10:25.321660+0000","last_unstale":"2024-05-15T12:10:26.338937+0000","last_undegraded":"2024-05-15T12:10:26.338937+0000","last_fullsized":"2024-05-15T12:10:26.338937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:29.785965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334782+0000","last_change":"2024-05-15T12:10:26.331978+0000","last_active":"2024-05-15T12:10:26.334782+0000","last_peered":"2024-05-15T12:10:26.334782+0000","last_clean":"2024-05-15T12:10:26.334782+0000","last_became_active":"2024-05-15T12:10:26.331123+0000","last_became_peered":"2024-05-15T12:10:26.331123+0000","last_unstale":"2024-05-15T12:10:26.334782+0000","last_undegraded":"2024-05-15T12:10:26.334782+0000","last_fullsized":"2024-05-15T12:10:26.334782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:39.341123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.340630+0000","last_change":"2024-05-15T12:10:25.318361+0000","last_active":"2024-05-15T12:10:26.340630+0000","last_peered":"2024-05-15T12:10:26.340630+0000","last_clean":"2024-05-15T12:10:26.340630+0000","last_became_active":"2024-05-15T12:10:25.318086+0000","last_became_peered":"2024-05-15T12:10:25.318086+0000","last_unstale":"2024-05-15T12:10:26.340630+0000","last_undegraded":"2024-05-15T12:10:26.340630+0000","last_fullsized":"2024-05-15T12:10:26.340630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:59.680962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390803+0000","last_change":"2024-05-15T12:10:26.321824+0000","last_active":"2024-05-15T12:10:27.390803+0000","last_peered":"2024-05-15T12:10:27.390803+0000","last_clean":"2024-05-15T12:10:27.390803+0000","last_became_active":"2024-05-15T12:10:26.321355+0000","last_became_peered":"2024-05-15T12:10:26.321355+0000","last_unstale":"2024-05-15T12:10:27.390803+0000","last_undegraded":"2024-05-15T12:10:27.390803+0000","last_fullsized":"2024-05-15T12:10:27.390803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:12.507261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390982+0000","last_change":"2024-05-15T12:10:25.325276+0000","last_active":"2024-05-15T12:10:27.390982+0000","last_peered":"2024-05-15T12:10:27.390982+0000","last_clean":"2024-05-15T12:10:27.390982+0000","last_became_active":"2024-05-15T12:10:25.324956+0000","last_became_peered":"2024-05-15T12:10:25.324956+0000","last_unstale":"2024-05-15T12:10:27.390982+0000","last_undegraded":"2024-05-15T12:10:27.390982+0000","last_fullsized":"2024-05-15T12:10:27.390982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:29.901050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326681+0000","last_change":"2024-05-15T12:10:26.335450+0000","last_active":"2024-05-15T12:10:27.326681+0000","last_peered":"2024-05-15T12:10:27.326681+0000","last_clean":"2024-05-15T12:10:27.326681+0000","last_became_active":"2024-05-15T12:10:26.335166+0000","last_became_peered":"2024-05-15T12:10:26.335166+0000","last_unstale":"2024-05-15T12:10:27.326681+0000","last_undegraded":"2024-05-15T12:10:27.326681+0000","last_fullsized":"2024-05-15T12:10:27.326681+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:03:49.924455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320866+0000","last_change":"2024-05-15T12:10:25.324046+0000","last_active":"2024-05-15T12:10:26.320866+0000","last_peered":"2024-05-15T12:10:26.320866+0000","last_clean":"2024-05-15T12:10:26.320866+0000","last_became_active":"2024-05-15T12:10:25.323741+0000","last_became_peered":"2024-05-15T12:10:25.323741+0000","last_unstale":"2024-05-15T12:10:26.320866+0000","last_undegraded":"2024-05-15T12:10:26.320866+0000","last_fullsized":"2024-05-15T12:10:26.320866+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:07:11.497471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326437+0000","last_change":"2024-05-15T12:10:26.330202+0000","last_active":"2024-05-15T12:10:27.326437+0000","last_peered":"2024-05-15T12:10:27.326437+0000","last_clean":"2024-05-15T12:10:27.326437+0000","last_became_active":"2024-05-15T12:10:26.329776+0000","last_became_peered":"2024-05-15T12:10:26.329776+0000","last_unstale":"2024-05-15T12:10:27.326437+0000","last_undegraded":"2024-05-15T12:10:27.326437+0000","last_fullsized":"2024-05-15T12:10:27.326437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:52:42.561958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391136+0000","last_change":"2024-05-15T12:10:25.318998+0000","last_active":"2024-05-15T12:10:27.391136+0000","last_peered":"2024-05-15T12:10:27.391136+0000","last_clean":"2024-05-15T12:10:27.391136+0000","last_became_active":"2024-05-15T12:10:25.318702+0000","last_became_peered":"2024-05-15T12:10:25.318702+0000","last_unstale":"2024-05-15T12:10:27.391136+0000","last_undegraded":"2024-05-15T12:10:27.391136+0000","last_fullsized":"2024-05-15T12:10:27.391136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:46:12.970628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327475+0000","last_change":"2024-05-15T12:10:26.324686+0000","last_active":"2024-05-15T12:10:27.327475+0000","last_peered":"2024-05-15T12:10:27.327475+0000","last_clean":"2024-05-15T12:10:27.327475+0000","last_became_active":"2024-05-15T12:10:26.324425+0000","last_became_peered":"2024-05-15T12:10:26.324425+0000","last_unstale":"2024-05-15T12:10:27.327475+0000","last_undegraded":"2024-05-15T12:10:27.327475+0000","last_fullsized":"2024-05-15T12:10:27.327475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:49:37.023772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391303+0000","last_change":"2024-05-15T12:10:25.326922+0000","last_active":"2024-05-15T12:10:27.391303+0000","last_peered":"2024-05-15T12:10:27.391303+0000","last_clean":"2024-05-15T12:10:27.391303+0000","last_became_active":"2024-05-15T12:10:25.326654+0000","last_became_peered":"2024-05-15T12:10:25.326654+0000","last_unstale":"2024-05-15T12:10:27.391303+0000","last_undegraded":"2024-05-15T12:10:27.391303+0000","last_fullsized":"2024-05-15T12:10:27.391303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:24:26.664886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327274+0000","last_change":"2024-05-15T12:10:26.330005+0000","last_active":"2024-05-15T12:10:27.327274+0000","last_peered":"2024-05-15T12:10:27.327274+0000","last_clean":"2024-05-15T12:10:27.327274+0000","last_became_active":"2024-05-15T12:10:26.329142+0000","last_became_peered":"2024-05-15T12:10:26.329142+0000","last_unstale":"2024-05-15T12:10:27.327274+0000","last_undegraded":"2024-05-15T12:10:27.327274+0000","last_fullsized":"2024-05-15T12:10:27.327274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:16.169638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326927+0000","last_change":"2024-05-15T12:10:25.329111+0000","last_active":"2024-05-15T12:10:27.326927+0000","last_peered":"2024-05-15T12:10:27.326927+0000","last_clean":"2024-05-15T12:10:27.326927+0000","last_became_active":"2024-05-15T12:10:25.328808+0000","last_became_peered":"2024-05-15T12:10:25.328808+0000","last_unstale":"2024-05-15T12:10:27.326927+0000","last_undegraded":"2024-05-15T12:10:27.326927+0000","last_fullsized":"2024-05-15T12:10:27.326927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:35:10.407838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326652+0000","last_change":"2024-05-15T12:10:26.330322+0000","last_active":"2024-05-15T12:10:27.326652+0000","last_peered":"2024-05-15T12:10:27.326652+0000","last_clean":"2024-05-15T12:10:27.326652+0000","last_became_active":"2024-05-15T12:10:26.329828+0000","last_became_peered":"2024-05-15T12:10:26.329828+0000","last_unstale":"2024-05-15T12:10:27.326652+0000","last_undegraded":"2024-05-15T12:10:27.326652+0000","last_fullsized":"2024-05-15T12:10:27.326652+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:00:38.970400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.392113+0000","last_change":"2024-05-15T12:10:25.326873+0000","last_active":"2024-05-15T12:10:27.392113+0000","last_peered":"2024-05-15T12:10:27.392113+0000","last_clean":"2024-05-15T12:10:27.392113+0000","last_became_active":"2024-05-15T12:10:25.326527+0000","last_became_peered":"2024-05-15T12:10:25.326527+0000","last_unstale":"2024-05-15T12:10:27.392113+0000","last_undegraded":"2024-05-15T12:10:27.392113+0000","last_fullsized":"2024-05-15T12:10:27.392113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391544+0000","last_change":"2024-05-15T12:10:26.332912+0000","last_active":"2024-05-15T12:10:27.391544+0000","last_peered":"2024-05-15T12:10:27.391544+0000","last_clean":"2024-05-15T12:10:27.391544+0000","last_became_active":"2024-05-15T12:10:26.332569+0000","last_became_peered":"2024-05-15T12:10:26.332569+0000","last_unstale":"2024-05-15T12:10:27.391544+0000","last_undegraded":"2024-05-15T12:10:27.391544+0000","last_fullsized":"2024-05-15T12:10:27.391544+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:23:03.273615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342398+0000","last_change":"2024-05-15T12:10:25.324206+0000","last_active":"2024-05-15T12:10:26.342398+0000","last_peered":"2024-05-15T12:10:26.342398+0000","last_clean":"2024-05-15T12:10:26.342398+0000","last_became_active":"2024-05-15T12:10:25.323870+0000","last_became_peered":"2024-05-15T12:10:25.323870+0000","last_unstale":"2024-05-15T12:10:26.342398+0000","last_undegraded":"2024-05-15T12:10:26.342398+0000","last_fullsized":"2024-05-15T12:10:26.342398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:41.670196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327149+0000","last_change":"2024-05-15T12:10:26.330460+0000","last_active":"2024-05-15T12:10:27.327149+0000","last_peered":"2024-05-15T12:10:27.327149+0000","last_clean":"2024-05-15T12:10:27.327149+0000","last_became_active":"2024-05-15T12:10:26.328907+0000","last_became_peered":"2024-05-15T12:10:26.328907+0000","last_unstale":"2024-05-15T12:10:27.327149+0000","last_undegraded":"2024-05-15T12:10:27.327149+0000","last_fullsized":"2024-05-15T12:10:27.327149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:38:55.374144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326993+0000","last_change":"2024-05-15T12:10:25.324008+0000","last_active":"2024-05-15T12:10:27.326993+0000","last_peered":"2024-05-15T12:10:27.326993+0000","last_clean":"2024-05-15T12:10:27.326993+0000","last_became_active":"2024-05-15T12:10:25.323593+0000","last_became_peered":"2024-05-15T12:10:25.323593+0000","last_unstale":"2024-05-15T12:10:27.326993+0000","last_undegraded":"2024-05-15T12:10:27.326993+0000","last_fullsized":"2024-05-15T12:10:27.326993+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:59:44.019689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.334677+0000","last_change":"2024-05-15T12:10:26.331819+0000","last_active":"2024-05-15T12:10:26.334677+0000","last_peered":"2024-05-15T12:10:26.334677+0000","last_clean":"2024-05-15T12:10:26.334677+0000","last_became_active":"2024-05-15T12:10:26.331530+0000","last_became_peered":"2024-05-15T12:10:26.331530+0000","last_unstale":"2024-05-15T12:10:26.334677+0000","last_undegraded":"2024-05-15T12:10:26.334677+0000","last_fullsized":"2024-05-15T12:10:26.334677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:00:35.872043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326699+0000","last_change":"2024-05-15T12:10:25.318876+0000","last_active":"2024-05-15T12:10:27.326699+0000","last_peered":"2024-05-15T12:10:27.326699+0000","last_clean":"2024-05-15T12:10:27.326699+0000","last_became_active":"2024-05-15T12:10:25.318597+0000","last_became_peered":"2024-05-15T12:10:25.318597+0000","last_unstale":"2024-05-15T12:10:27.326699+0000","last_undegraded":"2024-05-15T12:10:27.326699+0000","last_fullsized":"2024-05-15T12:10:27.326699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-17T00:05:01.590455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326308+0000","last_change":"2024-05-15T12:10:26.335357+0000","last_active":"2024-05-15T12:10:27.326308+0000","last_peered":"2024-05-15T12:10:27.326308+0000","last_clean":"2024-05-15T12:10:27.326308+0000","last_became_active":"2024-05-15T12:10:26.334409+0000","last_became_peered":"2024-05-15T12:10:26.334409+0000","last_unstale":"2024-05-15T12:10:27.326308+0000","last_undegraded":"2024-05-15T12:10:27.326308+0000","last_fullsized":"2024-05-15T12:10:27.326308+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:36:56.426749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391109+0000","last_change":"2024-05-15T12:10:25.326738+0000","last_active":"2024-05-15T12:10:27.391109+0000","last_peered":"2024-05-15T12:10:27.391109+0000","last_clean":"2024-05-15T12:10:27.391109+0000","last_became_active":"2024-05-15T12:10:25.326443+0000","last_became_peered":"2024-05-15T12:10:25.326443+0000","last_unstale":"2024-05-15T12:10:27.391109+0000","last_undegraded":"2024-05-15T12:10:27.391109+0000","last_fullsized":"2024-05-15T12:10:27.391109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:44:14.528690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327049+0000","last_change":"2024-05-15T12:10:26.340242+0000","last_active":"2024-05-15T12:10:27.327049+0000","last_peered":"2024-05-15T12:10:27.327049+0000","last_clean":"2024-05-15T12:10:27.327049+0000","last_became_active":"2024-05-15T12:10:26.339932+0000","last_became_peered":"2024-05-15T12:10:26.339932+0000","last_unstale":"2024-05-15T12:10:27.327049+0000","last_undegraded":"2024-05-15T12:10:27.327049+0000","last_fullsized":"2024-05-15T12:10:27.327049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:36:30.004499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391780+0000","last_change":"2024-05-15T12:10:25.327749+0000","last_active":"2024-05-15T12:10:27.391780+0000","last_peered":"2024-05-15T12:10:27.391780+0000","last_clean":"2024-05-15T12:10:27.391780+0000","last_became_active":"2024-05-15T12:10:25.327401+0000","last_became_peered":"2024-05-15T12:10:25.327401+0000","last_unstale":"2024-05-15T12:10:27.391780+0000","last_undegraded":"2024-05-15T12:10:27.391780+0000","last_fullsized":"2024-05-15T12:10:27.391780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T17:40:42.330426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391228+0000","last_change":"2024-05-15T12:10:26.323126+0000","last_active":"2024-05-15T12:10:27.391228+0000","last_peered":"2024-05-15T12:10:27.391228+0000","last_clean":"2024-05-15T12:10:27.391228+0000","last_became_active":"2024-05-15T12:10:26.322815+0000","last_became_peered":"2024-05-15T12:10:26.322815+0000","last_unstale":"2024-05-15T12:10:27.391228+0000","last_undegraded":"2024-05-15T12:10:27.391228+0000","last_fullsized":"2024-05-15T12:10:27.391228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:42.679987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.342495+0000","last_change":"2024-05-15T12:10:25.324285+0000","last_active":"2024-05-15T12:10:26.342495+0000","last_peered":"2024-05-15T12:10:26.342495+0000","last_clean":"2024-05-15T12:10:26.342495+0000","last_became_active":"2024-05-15T12:10:25.323952+0000","last_became_peered":"2024-05-15T12:10:25.323952+0000","last_unstale":"2024-05-15T12:10:26.342495+0000","last_undegraded":"2024-05-15T12:10:26.342495+0000","last_fullsized":"2024-05-15T12:10:26.342495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:30:55.449668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391185+0000","last_change":"2024-05-15T12:10:26.319491+0000","last_active":"2024-05-15T12:10:27.391185+0000","last_peered":"2024-05-15T12:10:27.391185+0000","last_clean":"2024-05-15T12:10:27.391185+0000","last_became_active":"2024-05-15T12:10:26.319133+0000","last_became_peered":"2024-05-15T12:10:26.319133+0000","last_unstale":"2024-05-15T12:10:27.391185+0000","last_undegraded":"2024-05-15T12:10:27.391185+0000","last_fullsized":"2024-05-15T12:10:27.391185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T12:57:48.692167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326832+0000","last_change":"2024-05-15T12:10:25.327089+0000","last_active":"2024-05-15T12:10:27.326832+0000","last_peered":"2024-05-15T12:10:27.326832+0000","last_clean":"2024-05-15T12:10:27.326832+0000","last_became_active":"2024-05-15T12:10:25.326815+0000","last_became_peered":"2024-05-15T12:10:25.326815+0000","last_unstale":"2024-05-15T12:10:27.326832+0000","last_undegraded":"2024-05-15T12:10:27.326832+0000","last_fullsized":"2024-05-15T12:10:27.326832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:04.799818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391659+0000","last_change":"2024-05-15T12:10:26.335703+0000","last_active":"2024-05-15T12:10:27.391659+0000","last_peered":"2024-05-15T12:10:27.391659+0000","last_clean":"2024-05-15T12:10:27.391659+0000","last_became_active":"2024-05-15T12:10:26.335451+0000","last_became_peered":"2024-05-15T12:10:26.335451+0000","last_unstale":"2024-05-15T12:10:27.391659+0000","last_undegraded":"2024-05-15T12:10:27.391659+0000","last_fullsized":"2024-05-15T12:10:27.391659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:35.506570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390487+0000","last_change":"2024-05-15T12:10:25.325393+0000","last_active":"2024-05-15T12:10:27.390487+0000","last_peered":"2024-05-15T12:10:27.390487+0000","last_clean":"2024-05-15T12:10:27.390487+0000","last_became_active":"2024-05-15T12:10:25.325157+0000","last_became_peered":"2024-05-15T12:10:25.325157+0000","last_unstale":"2024-05-15T12:10:27.390487+0000","last_undegraded":"2024-05-15T12:10:27.390487+0000","last_fullsized":"2024-05-15T12:10:27.390487+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T22:59:44.019689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391627+0000","last_change":"2024-05-15T12:10:26.337257+0000","last_active":"2024-05-15T12:10:27.391627+0000","last_peered":"2024-05-15T12:10:27.391627+0000","last_clean":"2024-05-15T12:10:27.391627+0000","last_became_active":"2024-05-15T12:10:26.335745+0000","last_became_peered":"2024-05-15T12:10:26.335745+0000","last_unstale":"2024-05-15T12:10:27.391627+0000","last_undegraded":"2024-05-15T12:10:27.391627+0000","last_fullsized":"2024-05-15T12:10:27.391627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:40:32.533928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391309+0000","last_change":"2024-05-15T12:10:25.324499+0000","last_active":"2024-05-15T12:10:27.391309+0000","last_peered":"2024-05-15T12:10:27.391309+0000","last_clean":"2024-05-15T12:10:27.391309+0000","last_became_active":"2024-05-15T12:10:25.324221+0000","last_became_peered":"2024-05-15T12:10:25.324221+0000","last_unstale":"2024-05-15T12:10:27.391309+0000","last_undegraded":"2024-05-15T12:10:27.391309+0000","last_fullsized":"2024-05-15T12:10:27.391309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:49:08.350725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391208+0000","last_change":"2024-05-15T12:10:26.327131+0000","last_active":"2024-05-15T12:10:27.391208+0000","last_peered":"2024-05-15T12:10:27.391208+0000","last_clean":"2024-05-15T12:10:27.391208+0000","last_became_active":"2024-05-15T12:10:26.326842+0000","last_became_peered":"2024-05-15T12:10:26.326842+0000","last_unstale":"2024-05-15T12:10:27.391208+0000","last_undegraded":"2024-05-15T12:10:27.391208+0000","last_fullsized":"2024-05-15T12:10:27.391208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:37:05.809609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.323806+0000","last_change":"2024-05-15T12:10:25.324364+0000","last_active":"2024-05-15T12:10:26.323806+0000","last_peered":"2024-05-15T12:10:26.323806+0000","last_clean":"2024-05-15T12:10:26.323806+0000","last_became_active":"2024-05-15T12:10:25.324098+0000","last_became_peered":"2024-05-15T12:10:25.324098+0000","last_unstale":"2024-05-15T12:10:26.323806+0000","last_undegraded":"2024-05-15T12:10:26.323806+0000","last_fullsized":"2024-05-15T12:10:26.323806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:41.292334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390715+0000","last_change":"2024-05-15T12:10:26.338299+0000","last_active":"2024-05-15T12:10:27.390715+0000","last_peered":"2024-05-15T12:10:27.390715+0000","last_clean":"2024-05-15T12:10:27.390715+0000","last_became_active":"2024-05-15T12:10:26.337729+0000","last_became_peered":"2024-05-15T12:10:26.337729+0000","last_unstale":"2024-05-15T12:10:27.390715+0000","last_undegraded":"2024-05-15T12:10:27.390715+0000","last_fullsized":"2024-05-15T12:10:27.390715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:42:47.781617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390671+0000","last_change":"2024-05-15T12:10:25.320515+0000","last_active":"2024-05-15T12:10:27.390671+0000","last_peered":"2024-05-15T12:10:27.390671+0000","last_clean":"2024-05-15T12:10:27.390671+0000","last_became_active":"2024-05-15T12:10:25.320225+0000","last_became_peered":"2024-05-15T12:10:25.320225+0000","last_unstale":"2024-05-15T12:10:27.390671+0000","last_undegraded":"2024-05-15T12:10:27.390671+0000","last_fullsized":"2024-05-15T12:10:27.390671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:13:06.478364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390767+0000","last_change":"2024-05-15T12:10:26.323304+0000","last_active":"2024-05-15T12:10:27.390767+0000","last_peered":"2024-05-15T12:10:27.390767+0000","last_clean":"2024-05-15T12:10:27.390767+0000","last_became_active":"2024-05-15T12:10:26.322911+0000","last_became_peered":"2024-05-15T12:10:26.322911+0000","last_unstale":"2024-05-15T12:10:27.390767+0000","last_undegraded":"2024-05-15T12:10:27.390767+0000","last_fullsized":"2024-05-15T12:10:27.390767+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:29.036807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326753+0000","last_change":"2024-05-15T12:10:25.326921+0000","last_active":"2024-05-15T12:10:27.326753+0000","last_peered":"2024-05-15T12:10:27.326753+0000","last_clean":"2024-05-15T12:10:27.326753+0000","last_became_active":"2024-05-15T12:10:25.326656+0000","last_became_peered":"2024-05-15T12:10:25.326656+0000","last_unstale":"2024-05-15T12:10:27.326753+0000","last_undegraded":"2024-05-15T12:10:27.326753+0000","last_fullsized":"2024-05-15T12:10:27.326753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:31:37.918036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391648+0000","last_change":"2024-05-15T12:10:26.336245+0000","last_active":"2024-05-15T12:10:27.391648+0000","last_peered":"2024-05-15T12:10:27.391648+0000","last_clean":"2024-05-15T12:10:27.391648+0000","last_became_active":"2024-05-15T12:10:26.335147+0000","last_became_peered":"2024-05-15T12:10:26.335147+0000","last_unstale":"2024-05-15T12:10:27.391648+0000","last_undegraded":"2024-05-15T12:10:27.391648+0000","last_fullsized":"2024-05-15T12:10:27.391648+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:42:42.679987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391063+0000","last_change":"2024-05-15T12:10:25.323229+0000","last_active":"2024-05-15T12:10:27.391063+0000","last_peered":"2024-05-15T12:10:27.391063+0000","last_clean":"2024-05-15T12:10:27.391063+0000","last_became_active":"2024-05-15T12:10:25.322944+0000","last_became_peered":"2024-05-15T12:10:25.322944+0000","last_unstale":"2024-05-15T12:10:27.391063+0000","last_undegraded":"2024-05-15T12:10:27.391063+0000","last_fullsized":"2024-05-15T12:10:27.391063+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:33:59.680962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327284+0000","last_change":"2024-05-15T12:10:26.338320+0000","last_active":"2024-05-15T12:10:27.327284+0000","last_peered":"2024-05-15T12:10:27.327284+0000","last_clean":"2024-05-15T12:10:27.327284+0000","last_became_active":"2024-05-15T12:10:26.338021+0000","last_became_peered":"2024-05-15T12:10:26.338021+0000","last_unstale":"2024-05-15T12:10:27.327284+0000","last_undegraded":"2024-05-15T12:10:27.327284+0000","last_fullsized":"2024-05-15T12:10:27.327284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:12:18.682096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391455+0000","last_change":"2024-05-15T12:10:25.327726+0000","last_active":"2024-05-15T12:10:27.391455+0000","last_peered":"2024-05-15T12:10:27.391455+0000","last_clean":"2024-05-15T12:10:27.391455+0000","last_became_active":"2024-05-15T12:10:25.327459+0000","last_became_peered":"2024-05-15T12:10:25.327459+0000","last_unstale":"2024-05-15T12:10:27.391455+0000","last_undegraded":"2024-05-15T12:10:27.391455+0000","last_fullsized":"2024-05-15T12:10:27.391455+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:09:38.331332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391662+0000","last_change":"2024-05-15T12:10:26.338792+0000","last_active":"2024-05-15T12:10:27.391662+0000","last_peered":"2024-05-15T12:10:27.391662+0000","last_clean":"2024-05-15T12:10:27.391662+0000","last_became_active":"2024-05-15T12:10:26.338323+0000","last_became_peered":"2024-05-15T12:10:26.338323+0000","last_unstale":"2024-05-15T12:10:27.391662+0000","last_undegraded":"2024-05-15T12:10:27.391662+0000","last_fullsized":"2024-05-15T12:10:27.391662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T13:34:07.846452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.392214+0000","last_change":"2024-05-15T12:10:25.327309+0000","last_active":"2024-05-15T12:10:27.392214+0000","last_peered":"2024-05-15T12:10:27.392214+0000","last_clean":"2024-05-15T12:10:27.392214+0000","last_became_active":"2024-05-15T12:10:25.326869+0000","last_became_peered":"2024-05-15T12:10:25.326869+0000","last_unstale":"2024-05-15T12:10:27.392214+0000","last_undegraded":"2024-05-15T12:10:27.392214+0000","last_fullsized":"2024-05-15T12:10:27.392214+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:52:29.785965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390388+0000","last_change":"2024-05-15T12:10:26.327320+0000","last_active":"2024-05-15T12:10:27.390388+0000","last_peered":"2024-05-15T12:10:27.390388+0000","last_clean":"2024-05-15T12:10:27.390388+0000","last_became_active":"2024-05-15T12:10:26.327060+0000","last_became_peered":"2024-05-15T12:10:26.327060+0000","last_unstale":"2024-05-15T12:10:27.390388+0000","last_undegraded":"2024-05-15T12:10:27.390388+0000","last_fullsized":"2024-05-15T12:10:27.390388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T20:26:17.098269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.392007+0000","last_change":"2024-05-15T12:10:25.318831+0000","last_active":"2024-05-15T12:10:27.392007+0000","last_peered":"2024-05-15T12:10:27.392007+0000","last_clean":"2024-05-15T12:10:27.392007+0000","last_became_active":"2024-05-15T12:10:25.318544+0000","last_became_peered":"2024-05-15T12:10:25.318544+0000","last_unstale":"2024-05-15T12:10:27.392007+0000","last_undegraded":"2024-05-15T12:10:27.392007+0000","last_fullsized":"2024-05-15T12:10:27.392007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:54:41.292334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327146+0000","last_change":"2024-05-15T12:10:26.328424+0000","last_active":"2024-05-15T12:10:27.327146+0000","last_peered":"2024-05-15T12:10:27.327146+0000","last_clean":"2024-05-15T12:10:27.327146+0000","last_became_active":"2024-05-15T12:10:26.327783+0000","last_became_peered":"2024-05-15T12:10:26.327783+0000","last_unstale":"2024-05-15T12:10:27.327146+0000","last_undegraded":"2024-05-15T12:10:27.327146+0000","last_fullsized":"2024-05-15T12:10:27.327146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:55:24.629655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.391692+0000","last_change":"2024-05-15T12:10:25.324125+0000","last_active":"2024-05-15T12:10:27.391692+0000","last_peered":"2024-05-15T12:10:27.391692+0000","last_clean":"2024-05-15T12:10:27.391692+0000","last_became_active":"2024-05-15T12:10:25.323807+0000","last_became_peered":"2024-05-15T12:10:25.323807+0000","last_unstale":"2024-05-15T12:10:27.391692+0000","last_undegraded":"2024-05-15T12:10:27.391692+0000","last_fullsized":"2024-05-15T12:10:27.391692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:07:34.496779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326854+0000","last_change":"2024-05-15T12:10:26.339437+0000","last_active":"2024-05-15T12:10:27.326854+0000","last_peered":"2024-05-15T12:10:27.326854+0000","last_clean":"2024-05-15T12:10:27.326854+0000","last_became_active":"2024-05-15T12:10:26.338450+0000","last_became_peered":"2024-05-15T12:10:26.338450+0000","last_unstale":"2024-05-15T12:10:27.326854+0000","last_undegraded":"2024-05-15T12:10:27.326854+0000","last_fullsized":"2024-05-15T12:10:27.326854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T21:47:41.012115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-05-15T12:10:26.320323+0000","last_change":"2024-05-15T12:10:25.324301+0000","last_active":"2024-05-15T12:10:26.320323+0000","last_peered":"2024-05-15T12:10:26.320323+0000","last_clean":"2024-05-15T12:10:26.320323+0000","last_became_active":"2024-05-15T12:10:25.323891+0000","last_became_peered":"2024-05-15T12:10:25.323891+0000","last_unstale":"2024-05-15T12:10:26.320323+0000","last_undegraded":"2024-05-15T12:10:26.320323+0000","last_fullsized":"2024-05-15T12:10:26.320323+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T18:50:28.027016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326504+0000","last_change":"2024-05-15T12:10:26.327944+0000","last_active":"2024-05-15T12:10:27.326504+0000","last_peered":"2024-05-15T12:10:27.326504+0000","last_clean":"2024-05-15T12:10:27.326504+0000","last_became_active":"2024-05-15T12:10:26.327635+0000","last_became_peered":"2024-05-15T12:10:26.327635+0000","last_unstale":"2024-05-15T12:10:27.326504+0000","last_undegraded":"2024-05-15T12:10:27.326504+0000","last_fullsized":"2024-05-15T12:10:27.326504+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T15:57:45.946824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.326786+0000","last_change":"2024-05-15T12:10:25.321633+0000","last_active":"2024-05-15T12:10:27.326786+0000","last_peered":"2024-05-15T12:10:27.326786+0000","last_clean":"2024-05-15T12:10:27.326786+0000","last_became_active":"2024-05-15T12:10:25.321235+0000","last_became_peered":"2024-05-15T12:10:25.321235+0000","last_unstale":"2024-05-15T12:10:27.326786+0000","last_undegraded":"2024-05-15T12:10:27.326786+0000","last_fullsized":"2024-05-15T12:10:27.326786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T16:53:07.294914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390450+0000","last_change":"2024-05-15T12:10:26.328610+0000","last_active":"2024-05-15T12:10:27.390450+0000","last_peered":"2024-05-15T12:10:27.390450+0000","last_clean":"2024-05-15T12:10:27.390450+0000","last_became_active":"2024-05-15T12:10:26.328358+0000","last_became_peered":"2024-05-15T12:10:26.328358+0000","last_unstale":"2024-05-15T12:10:27.390450+0000","last_undegraded":"2024-05-15T12:10:27.390450+0000","last_fullsized":"2024-05-15T12:10:27.390450+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:25.302821+0000","last_clean_scrub_stamp":"2024-05-15T12:10:25.302821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:51:30.820789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.327024+0000","last_change":"2024-05-15T12:10:25.326733+0000","last_active":"2024-05-15T12:10:27.327024+0000","last_peered":"2024-05-15T12:10:27.327024+0000","last_clean":"2024-05-15T12:10:27.327024+0000","last_became_active":"2024-05-15T12:10:25.326482+0000","last_became_peered":"2024-05-15T12:10:25.326482+0000","last_unstale":"2024-05-15T12:10:27.327024+0000","last_undegraded":"2024-05-15T12:10:27.327024+0000","last_fullsized":"2024-05-15T12:10:27.327024+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:10:24.293030+0000","last_clean_scrub_stamp":"2024-05-15T12:10:24.293030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T19:04:02.474299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-05-15T12:10:27.390833+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T12:10:27.390833+0000","last_peered":"2024-05-15T12:10:27.390833+0000","last_clean":"2024-05-15T12:10:27.390833+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T12:10:27.390833+0000","last_undegraded":"2024-05-15T12:10:27.390833+0000","last_fullsized":"2024-05-15T12:10:27.390833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":344064,"data_stored":129961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":137839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509456,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":727177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542160,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":136249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":137861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542160,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":137003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":950272,"data_stored":726665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":136317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T12:10:34.064 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T12:10:34.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-15T12:10:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.213+0000 7f46858cf640 1 Processor -- start 2024-05-15T12:10:34.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.213+0000 7f46858cf640 1 -- start start 2024-05-15T12:10:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f46858cf640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f46800b73d0 0x7f46800badd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f46858cf640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46800d3cb0 con 0x7f468015f450 2024-05-15T12:10:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f46858cf640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46800d3f90 con 0x7f46800d4d50 2024-05-15T12:10:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f46858cf640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f46800d4270 con 0x7f46800b73d0 2024-05-15T12:10:34.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f468015f450 0x7f46800b6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49728/0 (socket says 172.21.15.77:49728) 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467effd640 1 -- 172.21.15.77:0/2187127518 learned_addr learned my addr 172.21.15.77:0/2187127518 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f4677fff640 1 --2- 172.21.15.77:0/2187127518 >> v2:172.21.15.83:3300/0 conn(0x7f46800b73d0 0x7f46800badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298794959 0 0) 0x7f46800d3cb0 con 0x7f468015f450 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f466c003520 con 0x7f468015f450 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 767302957 0 0) 0x7f466c003520 con 0x7f468015f450 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 >> v2:172.21.15.83:3300/0 conn(0x7f46800b73d0 msgr2=0x7f46800badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 --2- 172.21.15.77:0/2187127518 >> v2:172.21.15.83:3300/0 conn(0x7f46800b73d0 0x7f46800badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 >> v1:172.21.15.83:6789/0 conn(0x7f46800d4d50 legacy=0x7f46800b8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46800d4550 con 0x7f468015f450 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f46700016f0 con 0x7f468015f450 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f4677fff640 1 --2- 172.21.15.77:0/2187127518 >> v2:172.21.15.83:3300/0 conn(0x7f46800b73d0 0x7f46800badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 >> v1:172.21.15.77:6789/0 conn(0x7f468015f450 legacy=0x7f46800b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c003ac0 0x7f466c003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f466c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.214+0000 7f467e7fc640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c005230 0x7f466c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46800d4270 con 0x7f466c004800 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f466c00c180 con 0x7f466c005230 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f466c00c380 con 0x7f466c003ac0 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f4677fff640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f466c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467f7fe640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c005230 0x7f466c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467effd640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c003ac0 0x7f466c003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f4677fff640 1 -- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c003ac0 msgr2=0x7f466c003ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f4677fff640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f466c003ac0 0x7f466c003ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f4677fff640 1 -- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c005230 msgr2=0x7f466c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f4677fff640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c005230 0x7f466c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f4677fff640 1 -- 172.21.15.77:0/2187127518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c003520 con 0x7f466c004800 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467f7fe640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f466c005230 0x7f466c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:34.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.215+0000 7f467f7fe640 1 -- 172.21.15.77:0/2187127518 reap_dead start 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f4677fff640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f466c004c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4668009c90 tx=0x7f466c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a627aca054d391b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668036070 con 0x7f466c004800 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4668031400 con 0x7f466c004800 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f467e7fc640 1 -- 172.21.15.77:0/2187127518 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4668009860 con 0x7f466c004800 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 -- 172.21.15.77:0/2187127518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 msgr2=0x7f466c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f466c004c80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4668009c90 tx=0x7f466c005830 comp rx=0 tx=0).stop 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 -- 172.21.15.77:0/2187127518 shutdown_connections 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 --2- 172.21.15.77:0/2187127518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f466c004c80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 -- 172.21.15.77:0/2187127518 >> 172.21.15.77:0/2187127518 conn(0x7f4680074150 msgr2=0x7f46800d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 -- 172.21.15.77:0/2187127518 shutdown_connections 2024-05-15T12:10:34.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.216+0000 7f46858cf640 1 -- 172.21.15.77:0/2187127518 wait complete. 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.217+0000 7f46858cf640 1 Processor -- start 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 -- start start 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f46801f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46801eef20 0x7f4680160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46800caf40 0x7f46800cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f46800bb160 con 0x7f466c004800 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f46800bafe0 con 0x7f46801eef20 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f46858cf640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f46800d3540 con 0x7f46800caf40 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f467effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f46801f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f467effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f46801f4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56522/0 (socket says 172.21.15.77:56522) 2024-05-15T12:10:34.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.218+0000 7f467effd640 1 -- 172.21.15.77:0/3405766266 learned_addr learned my addr 172.21.15.77:0/3405766266 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467effd640 1 -- 172.21.15.77:0/3405766266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46800caf40 msgr2=0x7f46800cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467effd640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46800caf40 0x7f46800cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467effd640 1 -- 172.21.15.77:0/3405766266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46801eef20 msgr2=0x7f4680160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467effd640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46801eef20 0x7f4680160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467effd640 1 -- 172.21.15.77:0/3405766266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4680160780 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467effd640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f46801f4f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f467000e7c0 tx=0x7f467000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670019070 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467000c850 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46801f55c0 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467000cc20 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.219+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46801f5b80 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.220+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46800cb900 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.220+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f467001c070 con 0x7f466c004800 2024-05-15T12:10:34.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.221+0000 7f467cff9640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46600762d0 0x7f4660078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.221+0000 7f4677fff640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46600762d0 0x7f4660078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.221+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f4670096d30 con 0x7f466c004800 2024-05-15T12:10:34.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.221+0000 7f4677fff640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46600762d0 0x7f4660078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4668033000 tx=0x7f466802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:34.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.225+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4670060600 con 0x7f466c004800 2024-05-15T12:10:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.485+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f468015d5e0 con 0x7f466c004800 2024-05-15T12:10:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.487+0000 7f467cff9640 1 -- 172.21.15.77:0/3405766266 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f467005ff00 con 0x7f466c004800 2024-05-15T12:10:34.482 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-05-15T12:10:34.483 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDOpURmdXQ6MBAAk41w2IfO9gjcJKGZ1RHHGw== 2024-05-15T12:10:34.483 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2024-05-15T12:10:34.483 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2024-05-15T12:10:34.483 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46600762d0 msgr2=0x7f4660078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46600762d0 0x7f4660078790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4668033000 tx=0x7f466802e000 comp rx=0 tx=0).stop 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 msgr2=0x7f46801f4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f46801f4f30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f467000e7c0 tx=0x7f467000ec80 comp rx=0 tx=0).stop 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 shutdown_connections 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f46600762d0 0x7f4660078790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f46800caf40 0x7f46800cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f46801eef20 0x7f4680160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 --2- 172.21.15.77:0/3405766266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f466c004800 0x7f46801f4f30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 >> 172.21.15.77:0/3405766266 conn(0x7f4680074150 msgr2=0x7f46800cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 shutdown_connections 2024-05-15T12:10:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.489+0000 7f46858cf640 1 -- 172.21.15.77:0/3405766266 wait complete. 2024-05-15T12:10:34.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T12:10:34.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.600+0000 7f499e623640 1 Processor -- start 2024-05-15T12:10:34.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.600+0000 7f499e623640 1 -- start start 2024-05-15T12:10:34.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f499e623640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f4998071c30 0x7f4998143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f499e623640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4998072210 con 0x7f499815d520 2024-05-15T12:10:34.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f499e623640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49980724f0 con 0x7f4998070e00 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f499e623640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f49980727d0 con 0x7f4998071c30 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f4997fff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f499815d520 0x7f49980706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49742/0 (socket says 172.21.15.77:49742) 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f4997fff640 1 -- 172.21.15.77:0/2373955200 learned_addr learned my addr 172.21.15.77:0/2373955200 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859496388 0 0) 0x7f4998072210 con 0x7f499815d520 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4984003520 con 0x7f499815d520 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.601+0000 7f499cbc0640 1 --2- 172.21.15.77:0/2373955200 >> v2:172.21.15.83:3300/0 conn(0x7f4998071c30 0x7f4998143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2111451643 0 0) 0x7f4984003520 con 0x7f499815d520 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 >> v2:172.21.15.83:3300/0 conn(0x7f4998071c30 msgr2=0x7f4998143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 --2- 172.21.15.77:0/2373955200 >> v2:172.21.15.83:3300/0 conn(0x7f4998071c30 0x7f4998143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 >> v1:172.21.15.83:6789/0 conn(0x7f4998070e00 legacy=0x7f49980d1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4998072ab0 con 0x7f499815d520 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f49880016f0 con 0x7f499815d520 2024-05-15T12:10:34.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 >> v1:172.21.15.77:6789/0 conn(0x7f499815d520 legacy=0x7f49980706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f4984003ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4984004800 0x7f4984004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49840052e0 0x7f498400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49980727d0 con 0x7f4984003ac0 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f498400c230 con 0x7f4984004800 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f498400c430 con 0x7f49840052e0 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f4997fff640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f4984003ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f498ffff640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4984004800 0x7f4984004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f499cbc0640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49840052e0 0x7f498400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f4997fff640 1 -- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49840052e0 msgr2=0x7f498400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f4997fff640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49840052e0 0x7f498400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f4997fff640 1 -- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4984004800 msgr2=0x7f4984004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f4997fff640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f4984004800 0x7f4984004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f4997fff640 1 -- 172.21.15.77:0/2373955200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4984003520 con 0x7f4984003ac0 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.602+0000 7f499cbc0640 1 -- 172.21.15.77:0/2373955200 reap_dead start 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.603+0000 7f4997fff640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f4984003ee0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4988001eb0 tx=0x7f4984005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d55bd655acaa0b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.603+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988007d30 con 0x7f4984003ac0 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.603+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4988005af0 con 0x7f4984003ac0 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.603+0000 7f49977fe640 1 -- 172.21.15.77:0/2373955200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988007070 con 0x7f4984003ac0 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.603+0000 7f499e623640 1 -- 172.21.15.77:0/2373955200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 msgr2=0x7f4984003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.603+0000 7f499e623640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f4984003ee0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4988001eb0 tx=0x7f4984005830 comp rx=0 tx=0).stop 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.604+0000 7f499e623640 1 -- 172.21.15.77:0/2373955200 shutdown_connections 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.604+0000 7f499e623640 1 --2- 172.21.15.77:0/2373955200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f4984003ee0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.604+0000 7f499e623640 1 -- 172.21.15.77:0/2373955200 >> 172.21.15.77:0/2373955200 conn(0x7f49980d2fd0 msgr2=0x7f49980d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.604+0000 7f499e623640 1 -- 172.21.15.77:0/2373955200 shutdown_connections 2024-05-15T12:10:34.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.604+0000 7f499e623640 1 -- 172.21.15.77:0/2373955200 wait complete. 2024-05-15T12:10:34.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.605+0000 7f499e623640 1 Processor -- start 2024-05-15T12:10:34.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.605+0000 7f499e623640 1 -- start start 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.605+0000 7f499e623640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f499813ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.605+0000 7f499e623640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49981587b0 0x7f4998159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499e623640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49981561f0 0x7f4998156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499e623640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f49980d1a40 con 0x7f4984003ac0 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499e623640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f49980d18c0 con 0x7f49981587b0 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499e623640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f49981406b0 con 0x7f49981561f0 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f499813ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f499813ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56544/0 (socket says 172.21.15.77:56544) 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 -- 172.21.15.77:0/416826649 learned_addr learned my addr 172.21.15.77:0/416826649 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:34.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f498ffff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49981587b0 0x7f4998159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 -- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49981561f0 msgr2=0x7f4998156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499cbc0640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49981561f0 0x7f4998156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49981561f0 0x7f4998156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 -- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49981587b0 msgr2=0x7f4998159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49981587b0 0x7f4998159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 -- 172.21.15.77:0/416826649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f499815a5d0 con 0x7f4984003ac0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f498ffff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49981587b0 0x7f4998159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f4997fff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f499813ba10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4988005aa0 tx=0x7f49980726c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49880016f0 con 0x7f4984003ac0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4988042070 con 0x7f4984003ac0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f499815a8b0 con 0x7f4984003ac0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4988007270 con 0x7f4984003ac0 2024-05-15T12:10:34.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.606+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f499813bf50 con 0x7f4984003ac0 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.607+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f499806a640 con 0x7f4984003ac0 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.608+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4988007410 con 0x7f4984003ac0 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.608+0000 7f49957fa640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f49780762d0 0x7f4978078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.608+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f49880b76f0 con 0x7f4984003ac0 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.608+0000 7f498ffff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f49780762d0 0x7f4978078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.609+0000 7f498ffff640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f49780762d0 0x7f4978078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4980000c00 tx=0x7f4980009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:34.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.613+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4988081110 con 0x7f4984003ac0 2024-05-15T12:10:34.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.828+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f499815e460 con 0x7f4984003ac0 2024-05-15T12:10:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.828+0000 7f49957fa640 1 -- 172.21.15.77:0/416826649 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5178 (secure 0 0 0) 0x7f4988089100 con 0x7f4984003ac0 2024-05-15T12:10:34.823 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:34.823 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:10:25.666896+0000","modified":"2024-05-15T12:10:27.671771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4863},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4863":{"gid":4863,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1303228576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1303228576},{"type":"v1","addr":"172.21.15.77:6837","nonce":1303228576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4863,"qdb_cluster":[4863]},"id":2}]} 2024-05-15T12:10:34.823 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f49780762d0 msgr2=0x7f4978078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f49780762d0 0x7f4978078790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4980000c00 tx=0x7f4980009040 comp rx=0 tx=0).stop 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 msgr2=0x7f499813ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f499813ba10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4988005aa0 tx=0x7f49980726c0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 shutdown_connections 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f49780762d0 0x7f4978078790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f49981561f0 0x7f4998156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f49981587b0 0x7f4998159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 --2- 172.21.15.77:0/416826649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4984003ac0 0x7f499813ba10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:34.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 >> 172.21.15.77:0/416826649 conn(0x7f49980d2fd0 msgr2=0x7f49980d1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 shutdown_connections 2024-05-15T12:10:34.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:34.830+0000 7f499e623640 1 -- 172.21.15.77:0/416826649 wait complete. 2024-05-15T12:10:35.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-15T12:10:25.666896+0000', 'modified': '2024-05-15T12:10:27.671771+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4863}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4863': {'gid': 4863, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6837/1303228576', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6835', 'nonce': 1303228576}, {'type': 'v1', 'addr': '172.21.15.77:6837', 'nonce': 1303228576}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4863, 'qdb_cluster': [4863]} 2024-05-15T12:10:35.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-15T12:10:35.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-15T12:10:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.347+0000 7fea03c47640 1 Processor -- start 2024-05-15T12:10:35.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.348+0000 7fea03c47640 1 -- start start 2024-05-15T12:10:35.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.348+0000 7fea03c47640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9fc15e460 0x7fe9fc15d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.348+0000 7fea03c47640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc0d0840 con 0x7fe9fc15d380 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.348+0000 7fea03c47640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9fc0cde00 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.348+0000 7fea03c47640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe9fc0ce0e0 con 0x7fe9fc15e460 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea011e2640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9fc15e460 0x7fe9fc15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea019e3640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe9fc15d380 0x7fe9fc0d0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49752/0 (socket says 172.21.15.77:49752) 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea019e3640 1 -- 172.21.15.77:0/1131162295 learned_addr learned my addr 172.21.15.77:0/1131162295 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea011e2640 1 -- 172.21.15.77:0/1131162295 >> v1:172.21.15.83:6789/0 conn(0x7fe9fc0cebc0 legacy=0x7fe9fc0d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea009e1640 1 -- 172.21.15.77:0/1131162295 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2832592529 0 0) 0x7fe9fc0d0840 con 0x7fe9fc15d380 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea011e2640 1 -- 172.21.15.77:0/1131162295 >> v1:172.21.15.77:6789/0 conn(0x7fe9fc15d380 legacy=0x7fe9fc0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.349+0000 7fea011e2640 1 -- 172.21.15.77:0/1131162295 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc0ce3c0 con 0x7fe9fc15e460 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea011e2640 1 --2- 172.21.15.77:0/1131162295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc15e460 0x7fe9fc15d760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0097a0 tx=0x7fe9ec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a8cd080fb6b221 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea009e1640 1 -- 172.21.15.77:0/1131162295 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec037070 con 0x7fe9fc15e460 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea009e1640 1 -- 172.21.15.77:0/1131162295 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec032440 con 0x7fe9fc15e460 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea009e1640 1 -- 172.21.15.77:0/1131162295 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec032810 con 0x7fe9fc15e460 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea03c47640 1 -- 172.21.15.77:0/1131162295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc15e460 msgr2=0x7fe9fc15d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea03c47640 1 --2- 172.21.15.77:0/1131162295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc15e460 0x7fe9fc15d760 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0097a0 tx=0x7fe9ec02a1a0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.350+0000 7fea03c47640 1 -- 172.21.15.77:0/1131162295 shutdown_connections 2024-05-15T12:10:35.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.351+0000 7fea03c47640 1 --2- 172.21.15.77:0/1131162295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc15e460 0x7fe9fc15d760 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.351+0000 7fea03c47640 1 -- 172.21.15.77:0/1131162295 >> 172.21.15.77:0/1131162295 conn(0x7fe9fc09ba30 msgr2=0x7fe9fc09be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.351+0000 7fea03c47640 1 -- 172.21.15.77:0/1131162295 shutdown_connections 2024-05-15T12:10:35.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.351+0000 7fea03c47640 1 -- 172.21.15.77:0/1131162295 wait complete. 2024-05-15T12:10:35.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.352+0000 7fea03c47640 1 Processor -- start 2024-05-15T12:10:35.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.352+0000 7fea03c47640 1 -- start start 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 0x7fe9fc15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9fc15d380 0x7fe9fc1f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9fc15e460 0x7fe9fc1f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc15dca0 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc0cdab0 con 0x7fe9fc15e460 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc15de20 con 0x7fe9fc15d380 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 0x7fe9fc15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 0x7fe9fc15e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56560/0 (socket says 172.21.15.77:56560) 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 -- 172.21.15.77:0/3891873893 learned_addr learned my addr 172.21.15.77:0/3891873893 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:35.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea021e4640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9fc15e460 0x7fe9fc1f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea011e2640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9fc15d380 0x7fe9fc1f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 -- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9fc15d380 msgr2=0x7fe9fc1f9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9fc15d380 0x7fe9fc1f9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 -- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9fc15e460 msgr2=0x7fe9fc1f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9fc15e460 0x7fe9fc1f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 -- 172.21.15.77:0/3891873893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9fc06e160 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea019e3640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 0x7fe9fc15e8a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c450 tx=0x7fe9f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fe9f27fc640 1 -- 172.21.15.77:0/3891873893 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8018070 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fe9f27fc640 1 -- 172.21.15.77:0/3891873893 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9f80074e0 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9fc06e440 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fe9f27fc640 1 -- 172.21.15.77:0/3891873893 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8004a20 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.353+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9fc06ea00 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.355+0000 7fe9f27fc640 1 -- 172.21.15.77:0/3891873893 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe9f801b070 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.356+0000 7fe9f27fc640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe9e00762d0 0x7fe9e0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.356+0000 7fe9f27fc640 1 -- 172.21.15.77:0/3891873893 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe9f8096930 con 0x7fe9fc0cebc0 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.356+0000 7fea011e2640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe9e00762d0 0x7fe9e0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.356+0000 7fea011e2640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe9e00762d0 0x7fe9e0078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec034000 tx=0x7fe9ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 Processor -- start 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 -- start start 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fdba730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 0x55725fdb8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fdb98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55725fd2bf10 con 0x55725fdb51e0 2024-05-15T12:10:35.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55725fd1bab0 con 0x55725fdba350 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x55725fd1faf0 con 0x55725fdb9490 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea011e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 0x55725fdb8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea011e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 0x55725fdb8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56572/0 (socket says 172.21.15.77:56572) 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.357+0000 7fea011e2640 1 -- 172.21.15.77:0/376630591 learned_addr learned my addr 172.21.15.77:0/376630591 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea021e4640 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fdb98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea019e3640 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fdba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea011e2640 1 -- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 msgr2=0x55725fdb98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea011e2640 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fdb98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea011e2640 1 -- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 msgr2=0x55725fdba730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea011e2640 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fdba730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea011e2640 1 -- 172.21.15.77:0/376630591 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725fcdf5d0 con 0x55725fdb51e0 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea019e3640 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fdba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fea011e2640 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 0x55725fdb8f50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec02a1e0 tx=0x7fe9ec02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafa65faee945ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fe9df7fe640 1 -- 172.21.15.77:0/376630591 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec04e070 con 0x55725fdb51e0 2024-05-15T12:10:35.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fe9df7fe640 1 -- 172.21.15.77:0/376630591 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec049470 con 0x55725fdb51e0 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.358+0000 7fe9df7fe640 1 -- 172.21.15.77:0/376630591 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec037040 con 0x55725fdb51e0 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 -- 172.21.15.77:0/376630591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 msgr2=0x55725fdb8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 0x55725fdb8f50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec02a1e0 tx=0x7fe9ec02c000 comp rx=0 tx=0).stop 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 -- 172.21.15.77:0/376630591 shutdown_connections 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fdb98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb51e0 0x55725fdb8f50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 --2- 172.21.15.77:0/376630591 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fdba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 -- 172.21.15.77:0/376630591 >> 172.21.15.77:0/376630591 conn(0x55725fdb7450 msgr2=0x55725fdfff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 -- 172.21.15.77:0/376630591 shutdown_connections 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 -- 172.21.15.77:0/376630591 wait complete. 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 -- start start 2024-05-15T12:10:35.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.359+0000 7fea06966740 1 Processor -- start 2024-05-15T12:10:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 0x55725fddd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fe025b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fddf450 0x55725fe02af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55725fa01850 con 0x55725fdb9490 2024-05-15T12:10:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55725fcd7c10 con 0x55725fdba350 2024-05-15T12:10:35.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x55725fde5ee0 con 0x55725fddf450 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea06966740 10 client.0 _ll_register_callbacks cb 0x55725fcdb150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea019e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 0x55725fddd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea019e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 0x55725fddd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56576/0 (socket says 172.21.15.77:56576) 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.360+0000 7fea019e3640 1 -- 172.21.15.77:0/559661912 learned_addr learned my addr 172.21.15.77:0/559661912 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea011e2640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fe025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea021e4640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fddf450 0x55725fe02af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea019e3640 1 -- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fddf450 msgr2=0x55725fe02af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea019e3640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fddf450 0x55725fe02af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea019e3640 1 -- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 msgr2=0x55725fe025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea019e3640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fe025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea019e3640 1 -- 172.21.15.77:0/559661912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55725fa302d0 con 0x55725fdb9490 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea019e3640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 0x55725fddd280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007fd0 tx=0x7fe9f805f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa72b7edf974bf3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fe9dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-05-15T12:10:35.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fe9dcff9640 1 -- 172.21.15.77:0/559661912 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8092060 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fe9dcff9640 1 -- 172.21.15.77:0/559661912 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe9f805eeb0 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ec049470 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fe9dcff9640 1 -- 172.21.15.77:0/559661912 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe9f8064000 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 10 client.5055 fetch_fsmap learned FSMap version 15 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55725fafa6b0 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fe9dcff9640 1 -- 172.21.15.77:0/559661912 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec049470 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fe9dcff9640 1 -- 172.21.15.77:0/559661912 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7fe9f807a030 con 0x55725fdb9490 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 10 client.5055 fetch_fsmap finished waiting for FSMap version 15 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 10 client.5055 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 20 client.5055 populate_metadata read hostname 'smithi077' 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fde1200 0x55725fddc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 4 client.5055 mds_command: new command op to 4863 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-15T12:10:35.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 --> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55725fd2de60 con 0x55725fde1200 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.361+0000 7fea011e2640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fde1200 0x55725fddc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.362+0000 7fe9dcff9640 10 client.5055 ms_handle_connect on v2:172.21.15.77:6835/1303228576 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.362+0000 7fea011e2640 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fde1200 0x55725fddc610 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a3e7c31af9de970 server_cookie=dbdeebc6211a2ce7 in_seq=0 out_seq=0 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.362+0000 7fe9dcff9640 1 -- 172.21.15.77:0/559661912 <== mds.0 v2:172.21.15.77:6835/1303228576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55725fd2de60 con 0x55725fde1200 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.362+0000 7fe9dcff9640 10 client.5055 handle_command_reply: tid=0 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.362+0000 7fea06966740 1 client.5055 shutdown 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 msgr2=0x55725fddd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 0x55725fddd280 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007fd0 tx=0x7fe9f805f820 comp rx=0 tx=0).stop 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 shutdown_connections 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fde1200 0x55725fddc610 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fddf450 0x55725fe02af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fdba350 0x55725fe025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fe9dcff9640 0 client.5055 ms_handle_reset on v2:172.21.15.77:6835/1303228576 2024-05-15T12:10:35.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 --2- 172.21.15.77:0/559661912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdb9490 0x55725fddd280 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 >> 172.21.15.77:0/559661912 conn(0x55725fdb51e0 msgr2=0x55725fdb4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 shutdown_connections 2024-05-15T12:10:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 1 -- 172.21.15.77:0/559661912 wait complete. 2024-05-15T12:10:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.363+0000 7fea06966740 20 client.5055 trim_cache size 0 max 16384 2024-05-15T12:10:35.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.381+0000 7fea06966740 1 Processor -- start 2024-05-15T12:10:35.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.381+0000 7fea06966740 1 -- start start 2024-05-15T12:10:35.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe02820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea06966740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fdff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fe779c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea06966740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc200910 con 0x55725fdba350 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe9fc1f6110 con 0x55725fddf450 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe9fc2002c0 con 0x55725fdb9490 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fdff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fdff1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56586/0 (socket says 172.21.15.77:56586) 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 -- 172.21.15.77:0/1677174243 learned_addr learned my addr 172.21.15.77:0/1677174243 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 -- 172.21.15.77:0/1677174243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 msgr2=0x55725fe02820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe02820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 -- 172.21.15.77:0/1677174243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 msgr2=0x55725fe779c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fe779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 -- 172.21.15.77:0/1677174243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55725fde1920 con 0x55725fdba350 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fea011e2640 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fdff1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec02a790 tx=0x7fe9ec03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af02f6bc1b20470d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.382+0000 7fe9deffd640 1 -- 172.21.15.77:0/1677174243 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec04e040 con 0x55725fdba350 2024-05-15T12:10:35.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fe9deffd640 1 -- 172.21.15.77:0/1677174243 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec03e850 con 0x55725fdba350 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fe9deffd640 1 -- 172.21.15.77:0/1677174243 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec053c70 con 0x55725fdba350 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 -- 172.21.15.77:0/1677174243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 msgr2=0x55725fdff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fdff1f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec02a790 tx=0x7fe9ec03b000 comp rx=0 tx=0).stop 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 -- 172.21.15.77:0/1677174243 shutdown_connections 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fe779c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fdff1f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 --2- 172.21.15.77:0/1677174243 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe02820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 -- 172.21.15.77:0/1677174243 >> 172.21.15.77:0/1677174243 conn(0x55725fdb51e0 msgr2=0x55725fde5280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 -- 172.21.15.77:0/1677174243 shutdown_connections 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.383+0000 7fea06966740 1 -- 172.21.15.77:0/1677174243 wait complete. 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.384+0000 7fea06966740 1 -- start start 2024-05-15T12:10:35.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.384+0000 7fea06966740 1 Processor -- start 2024-05-15T12:10:35.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe63a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fddcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fdff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55725fde1080 con 0x55725fdba350 2024-05-15T12:10:35.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x55725fde0360 con 0x55725fddf450 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x55725fde16d0 con 0x55725fdb9490 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 10 client.0 _ll_register_callbacks cb 0x7fe9f805f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fddcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fddcc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56602/0 (socket says 172.21.15.77:56602) 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 -- 172.21.15.77:0/1461902596 learned_addr learned my addr 172.21.15.77:0/1461902596 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea019e3640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe63a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea021e4640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fdff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 -- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 msgr2=0x55725fe63a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe63a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 -- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 msgr2=0x55725fdff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fdff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 -- 172.21.15.77:0/1461902596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55725fe233a0 con 0x55725fdba350 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea011e2640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fddcc20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec02c040 tx=0x7fe9ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f424b3d15abb100 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fe9dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fe9dcff9640 1 -- 172.21.15.77:0/1461902596 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec04e040 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fe9dcff9640 1 -- 172.21.15.77:0/1461902596 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ec03ea00 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ec03e850 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.385+0000 7fe9dcff9640 1 -- 172.21.15.77:0/1461902596 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fe9ec037040 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 10 client.5061 fetch_fsmap learned FSMap version 15 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55725fde5170 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fe9dcff9640 1 -- 172.21.15.77:0/1461902596 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ec03e850 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fe9dcff9640 1 -- 172.21.15.77:0/1461902596 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 15) ==== 3494+0+0 (secure 0 0 0) 0x7fe9ec03ec00 con 0x55725fdba350 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 10 client.5061 fetch_fsmap finished waiting for FSMap version 15 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 10 client.5061 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 20 client.5061 populate_metadata read hostname 'smithi077' 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fe075f0 0x55725fe079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 4 client.5061 mds_command: new command op to 4863 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-15T12:10:35.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 --> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] -- command(tid 0: {"prefix": "status"}) -- 0x55725fddefc0 con 0x55725fe075f0 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea019e3640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fe075f0 0x55725fe079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fe9dcff9640 10 client.5061 ms_handle_connect on v2:172.21.15.77:6835/1303228576 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea019e3640 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fe075f0 0x55725fe079d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac17415d252e3998 server_cookie=eafdcbefccbc44e8 in_seq=0 out_seq=0 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fe9dcff9640 1 -- 172.21.15.77:0/1461902596 <== mds.0 v2:172.21.15.77:6835/1303228576 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55725fddefc0 con 0x55725fe075f0 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fe9dcff9640 10 client.5061 handle_command_reply: tid=0 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 1 client.5061 shutdown 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 msgr2=0x55725fddcc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.386+0000 7fea06966740 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fddcc20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec02c040 tx=0x7fe9ec004730 comp rx=0 tx=0).stop 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 shutdown_connections 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:6835/1303228576,v1:172.21.15.77:6837/1303228576] conn(0x55725fe075f0 0x55725fe079d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x55725fddf450 0x55725fdff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fe9dcff9640 0 client.5061 ms_handle_reset on v2:172.21.15.77:6835/1303228576 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55725fdba350 0x55725fddcc20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 --2- 172.21.15.77:0/1461902596 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x55725fdb9490 0x55725fe63a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 >> 172.21.15.77:0/1461902596 conn(0x55725fdb51e0 msgr2=0x55725fdb8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 shutdown_connections 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 1 -- 172.21.15.77:0/1461902596 wait complete. 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea06966740 20 client.5061 trim_cache size 0 max 16384 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "80026697-69b5-4668-adbe-f40fd7cb21f7", 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4863, 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-05-15T12:10:35.388 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-05-15T12:10:35.389 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 9.0775828090000008, 2024-05-15T12:10:35.389 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 15, 2024-05-15T12:10:35.389 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 32, 2024-05-15T12:10:35.389 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 32, 2024-05-15T12:10:35.389 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 15.957714616000001 2024-05-15T12:10:35.389 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe9e00762d0 msgr2=0x7fe9e0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe9e00762d0 0x7fe9e0078790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec034000 tx=0x7fe9ec02e000 comp rx=0 tx=0).stop 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 msgr2=0x7fe9fc15e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 0x7fe9fc15e8a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c450 tx=0x7fe9f800c910 comp rx=0 tx=0).stop 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 shutdown_connections 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe9e00762d0 0x7fe9e0078790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe9fc15d380 0x7fe9fc1f9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe9fc15e460 0x7fe9fc1f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 --2- 172.21.15.77:0/3891873893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe9fc0cebc0 0x7fe9fc15e8a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 >> 172.21.15.77:0/3891873893 conn(0x7fe9fc09ba30 msgr2=0x7fe9fc158710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 shutdown_connections 2024-05-15T12:10:35.391 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.387+0000 7fea03c47640 1 -- 172.21.15.77:0/3891873893 wait complete. 2024-05-15T12:10:35.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-15T12:10:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.498+0000 7fe3e8809640 1 Processor -- start 2024-05-15T12:10:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.498+0000 7fe3e8809640 1 -- start start 2024-05-15T12:10:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e8809640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fe3e4072dd0 0x7fe3e40b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e8809640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3e406f0f0 0x7fe3e406f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e8809640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3e40b3fc0 con 0x7fe3e415b720 2024-05-15T12:10:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e8809640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e406faa0 con 0x7fe3e406f0f0 2024-05-15T12:10:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e8809640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fe3e40b6100 con 0x7fe3e4072dd0 2024-05-15T12:10:35.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e2d9d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3e406f0f0 0x7fe3e406f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e259c640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe3e415b720 0x7fe3e40b5920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:49764/0 (socket says 172.21.15.77:49764) 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e259c640 1 -- 172.21.15.77:0/3616950820 learned_addr learned my addr 172.21.15.77:0/3616950820 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e1d9b640 1 --2- 172.21.15.77:0/3616950820 >> v2:172.21.15.83:3300/0 conn(0x7fe3e4072dd0 0x7fe3e40b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e159a640 1 -- 172.21.15.77:0/3616950820 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602161954 0 0) 0x7fe3e40b3fc0 con 0x7fe3e415b720 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e159a640 1 -- 172.21.15.77:0/3616950820 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3d0003520 con 0x7fe3e415b720 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/3616950820 >> v2:172.21.15.83:3300/0 conn(0x7fe3e4072dd0 msgr2=0x7fe3e40b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e2d9d640 1 --2- 172.21.15.77:0/3616950820 >> v2:172.21.15.83:3300/0 conn(0x7fe3e4072dd0 0x7fe3e40b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/3616950820 >> v1:172.21.15.77:6789/0 conn(0x7fe3e415b720 legacy=0x7fe3e40b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.499+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/3616950820 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e40b4260 con 0x7fe3e406f0f0 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.500+0000 7fe3e2d9d640 1 --2- 172.21.15.77:0/3616950820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e406f0f0 0x7fe3e406f560 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4073730 tx=0x7fe3d402b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca973787f124059c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.500+0000 7fe3e159a640 1 -- 172.21.15.77:0/3616950820 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d400b040 con 0x7fe3e406f0f0 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.500+0000 7fe3e159a640 1 -- 172.21.15.77:0/3616950820 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d4030710 con 0x7fe3e406f0f0 2024-05-15T12:10:35.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.500+0000 7fe3e159a640 1 -- 172.21.15.77:0/3616950820 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4030ae0 con 0x7fe3e406f0f0 2024-05-15T12:10:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.500+0000 7fe3e8809640 1 -- 172.21.15.77:0/3616950820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e406f0f0 msgr2=0x7fe3e406f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.500+0000 7fe3e8809640 1 --2- 172.21.15.77:0/3616950820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e406f0f0 0x7fe3e406f560 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4073730 tx=0x7fe3d402b560 comp rx=0 tx=0).stop 2024-05-15T12:10:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.501+0000 7fe3e8809640 1 -- 172.21.15.77:0/3616950820 shutdown_connections 2024-05-15T12:10:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.501+0000 7fe3e8809640 1 --2- 172.21.15.77:0/3616950820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e406f0f0 0x7fe3e406f560 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.501+0000 7fe3e8809640 1 --2- 172.21.15.77:0/3616950820 >> v2:172.21.15.83:3300/0 conn(0x7fe3e4072dd0 0x7fe3e40b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.501+0000 7fe3e8809640 1 -- 172.21.15.77:0/3616950820 >> 172.21.15.77:0/3616950820 conn(0x7fe3e406c810 msgr2=0x7fe3e406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.501+0000 7fe3e8809640 1 -- 172.21.15.77:0/3616950820 shutdown_connections 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.501+0000 7fe3e8809640 1 -- 172.21.15.77:0/3616950820 wait complete. 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.502+0000 7fe3e8809640 1 Processor -- start 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.502+0000 7fe3e8809640 1 -- start start 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e406f0f0 0x7fe3e41f3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3e4072dd0 0x7fe3e415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 0x7fe3e4155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e40b4fa0 con 0x7fe3e415b720 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e40b63e0 con 0x7fe3e406f0f0 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe3e415bb00 con 0x7fe3e4072dd0 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 0x7fe3e4155d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 0x7fe3e4155d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56630/0 (socket says 172.21.15.77:56630) 2024-05-15T12:10:35.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/378081037 learned_addr learned my addr 172.21.15.77:0/378081037 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e259c640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e406f0f0 0x7fe3e41f3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e1d9b640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3e4072dd0 0x7fe3e415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3e4072dd0 msgr2=0x7fe3e415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3e4072dd0 0x7fe3e415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e406f0f0 msgr2=0x7fe3e41f3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e406f0f0 0x7fe3e41f3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 -- 172.21.15.77:0/378081037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e41f4140 con 0x7fe3e415b720 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e259c640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e406f0f0 0x7fe3e41f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e1d9b640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3e4072dd0 0x7fe3e415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e2d9d640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 0x7fe3e4155d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe3d402bb50 tx=0x7fe3d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4040070 con 0x7fe3e415b720 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3d40339d0 con 0x7fe3e415b720 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e415dde0 con 0x7fe3e415b720 2024-05-15T12:10:35.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d4033de0 con 0x7fe3e415b720 2024-05-15T12:10:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.503+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e415e680 con 0x7fe3e415b720 2024-05-15T12:10:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.504+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e406a640 con 0x7fe3e415b720 2024-05-15T12:10:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.505+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe3d403c410 con 0x7fe3e415b720 2024-05-15T12:10:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.505+0000 7fe3daffd640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe3c40762d0 0x7fe3c4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:10:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.506+0000 7fe3e259c640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe3c40762d0 0x7fe3c4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:10:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.506+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe3d40b9a40 con 0x7fe3e415b720 2024-05-15T12:10:35.502 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.506+0000 7fe3e259c640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe3c40762d0 0x7fe3c4078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc005c00 tx=0x7fe3dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:10:35.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.510+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe3d40833a0 con 0x7fe3e415b720 2024-05-15T12:10:35.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.729+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe3e4072380 con 0x7fe3e415b720 2024-05-15T12:10:35.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.729+0000 7fe3daffd640 1 -- 172.21.15.77:0/378081037 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+73 (secure 0 0 0) 0x7fe3d40b9e20 con 0x7fe3e415b720 2024-05-15T12:10:35.724 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe3c40762d0 msgr2=0x7fe3c4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe3c40762d0 0x7fe3c4078790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc005c00 tx=0x7fe3dc009040 comp rx=0 tx=0).stop 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 msgr2=0x7fe3e4155d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 0x7fe3e4155d30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe3d402bb50 tx=0x7fe3d40046c0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 shutdown_connections 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe3c40762d0 0x7fe3c4078790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe3e4072dd0 0x7fe3e415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3e415b720 0x7fe3e4155d30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 --2- 172.21.15.77:0/378081037 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe3e406f0f0 0x7fe3e41f3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:10:35.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 >> 172.21.15.77:0/378081037 conn(0x7fe3e406c810 msgr2=0x7fe3e4151880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:10:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 shutdown_connections 2024-05-15T12:10:35.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35.731+0000 7fe3e8809640 1 -- 172.21.15.77:0/378081037 wait complete. 2024-05-15T12:10:35.736 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-15T12:10:35.736 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-15T12:10:35.737 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-15T12:10:35.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:35.737 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-05-15T12:10:35.753 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-15T12:10:35.753 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-15T12:10:35.753 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-05-15T12:10:35.753 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-15T12:10:35.754 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42716sec preferred_lft 42716sec 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 12:b9:60:5b:b7:a6 brd ff:ff:ff:ff:ff:ff 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::2cd9:9bff:feeb:bfed/64 scope link 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 1e:6c:a3:78:41:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:35.755 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::1c6c:a3ff:fe78:4173/64 scope link 2024-05-15T12:10:35.756 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.756 INFO:teuthology.orchestra.run.smithi077.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-15T12:10:35.756 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 12:b9:60:5b:b7:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:35.756 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::10b9:60ff:fe5b:b7a6/64 scope link 2024-05-15T12:10:35.756 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-05-15T12:10:35.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:35.756 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-15T12:10:35.817 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-05-15T12:10:35.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:35.818 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-05-15T12:10:35.875 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-05-15T12:10:35.875 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-15T12:10:35.875 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-15T12:10:35.875 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-15T12:10:35.875 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-15T12:10:35.875 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-15T12:10:35.875 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-05-15T12:10:35.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-15T12:10:35.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-15T12:10:35.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-15T12:10:35.876 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-05-15T12:10:35.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-15T12:10:35.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:36.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.003 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-05-15T12:10:36.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-15T12:10:36.018 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-15T12:10:36.019 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-15T12:10:36.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-05-15T12:10:36.084 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-15T12:10:36.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:36.085 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:36.140 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-15T12:10:36.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-15T12:10:36.140 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:36.195 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-05-15T12:10:36.260 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-05-15T12:10:36.318 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2024-05-15T12:10:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:36.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.320 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-05-15T12:10:36.374 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-15T12:10:36.374 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-15T12:10:36.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-05-15T12:10:36.440 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-05-15T12:10:36.496 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-05-15T12:10:36.497 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-0 2024-05-15T12:10:36.498 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-1 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-2 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph/osd/ceph-3 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T12:10:36.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.499 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-05-15T12:10:36.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2024-05-15T12:10:36.504+0000 7f4341211480 -1 init, newargv = 0x55c42ef06c00 newargc=15 2024-05-15T12:10:36.500 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[48767]: starting ceph client 2024-05-15T12:10:36.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[48767]: starting fuse 2024-05-15T12:10:36.515 INFO:teuthology.orchestra.run.smithi077.stdout:40 2024-05-15T12:10:36.516 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-15T12:10:36.516 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-15T12:10:36.517 DEBUG:teuthology.orchestra.run.smithi077:> 2024-05-15T12:10:36.518 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2024-05-15T12:10:36.518 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-05-15T12:10:36.635 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.48767.asok 2024-05-15T12:10:36.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:10:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-15T12:10:36.646 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48767.asok 2024-05-15T12:10:36.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48767.asok status 2024-05-15T12:10:36.781 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T12:10:36.781 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-05-15T12:10:36.781 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "9b63866860f0b71216b2c0a73aedd2e0a8a5c98b", 2024-05-15T12:10:36.781 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.0.0-3687-g9b638668 (9b63866860f0b71216b2c0a73aedd2e0a8a5c98b) squid (dev)", 2024-05-15T12:10:36.781 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "48767", 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5079, 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-05-15T12:10:36.782 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 5079 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2683247981 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2683247981 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.5079 192.168.0.1:0/2683247981", 2024-05-15T12:10:36.783 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2683247981", 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 15, 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 32, 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-05-15T12:10:36.784 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T12:10:36.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.790 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-05-15T12:10:36.790 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:36.805 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-05-15T12:10:36.806 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:36.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-15T12:10:36.872 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=xfstests-dev 2024-05-15T12:10:36.928 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.DmRtshrLxIxfstests-dev 2024-05-15T12:10:36.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.928 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.DmRtshrLxIxfstests-dev) 2024-05-15T12:10:36.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:36.994 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.DmRtshrLxIxfstests-dev) 2024-05-15T12:10:37.053 INFO:teuthology.orchestra.run.smithi077.stderr:Cloning into '/tmp/tmp.DmRtshrLxIxfstests-dev'... 2024-05-15T12:10:37.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:37.891 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-15T12:10:37.953 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=test 2024-05-15T12:10:38.008 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.BgAiu3pKHAtest 2024-05-15T12:10:38.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:10:38.009 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-15T12:10:38.067 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=scratch 2024-05-15T12:10:38.122 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.7yeh0hEYITscratch 2024-05-15T12:10:38.123 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-05-15T12:10:38.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-05-15T12:10:38.749 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:03:26 ago on Wed 15 May 2024 12:07:12 PM UTC. 2024-05-15T12:10:38.831 INFO:teuthology.orchestra.run.smithi077.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T12:10:38.832 INFO:teuthology.orchestra.run.smithi077.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-05-15T12:10:38.833 INFO:teuthology.orchestra.run.smithi077.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-05-15T12:10:38.833 INFO:teuthology.orchestra.run.smithi077.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-05-15T12:10:38.834 INFO:teuthology.orchestra.run.smithi077.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-05-15T12:10:38.836 INFO:teuthology.orchestra.run.smithi077.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-05-15T12:10:38.837 INFO:teuthology.orchestra.run.smithi077.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-05-15T12:10:38.838 INFO:teuthology.orchestra.run.smithi077.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-05-15T12:10:38.840 INFO:teuthology.orchestra.run.smithi077.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-05-15T12:10:38.842 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-15T12:10:38.843 INFO:teuthology.orchestra.run.smithi077.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-05-15T12:10:38.844 INFO:teuthology.orchestra.run.smithi077.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-05-15T12:10:38.845 INFO:teuthology.orchestra.run.smithi077.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-05-15T12:10:38.846 INFO:teuthology.orchestra.run.smithi077.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-05-15T12:10:38.847 INFO:teuthology.orchestra.run.smithi077.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-05-15T12:10:38.848 INFO:teuthology.orchestra.run.smithi077.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-05-15T12:10:38.849 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-05-15T12:10:38.849 INFO:teuthology.orchestra.run.smithi077.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-05-15T12:10:38.850 INFO:teuthology.orchestra.run.smithi077.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-05-15T12:10:38.852 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-15T12:10:38.898 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-devel x86_64 5.14.0-446.el9 appstream 16 M 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-05-15T12:10:38.900 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: gdbm-libs x86_64 1:1.23-1.el9 baseos 56 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:Install 17 Packages 2024-05-15T12:10:38.901 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 1 Package 2024-05-15T12:10:38.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:10:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 24 M 2024-05-15T12:10:38.902 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-05-15T12:10:39.416 INFO:teuthology.orchestra.run.smithi077.stdout:(1/18): fio-engine-http-3.35-1.el9.x86_64.rpm 152 kB/s | 18 kB 00:00 2024-05-15T12:10:39.440 INFO:teuthology.orchestra.run.smithi077.stdout:(2/18): rmt-1.6-6.el9.x86_64.rpm 321 kB/s | 46 kB 00:00 2024-05-15T12:10:39.466 INFO:teuthology.orchestra.run.smithi077.stdout:(3/18): fio-engine-libaio-3.35-1.el9.x86_64.rpm 312 kB/s | 16 kB 00:00 2024-05-15T12:10:39.491 INFO:teuthology.orchestra.run.smithi077.stdout:(4/18): fio-engine-nbd-3.35-1.el9.x86_64.rpm 290 kB/s | 15 kB 00:00 2024-05-15T12:10:39.516 INFO:teuthology.orchestra.run.smithi077.stdout:(5/18): fio-engine-rados-3.35-1.el9.x86_64.rpm 313 kB/s | 16 kB 00:00 2024-05-15T12:10:39.542 INFO:teuthology.orchestra.run.smithi077.stdout:(6/18): fio-engine-rbd-3.35-1.el9.x86_64.rpm 323 kB/s | 16 kB 00:00 2024-05-15T12:10:39.600 INFO:teuthology.orchestra.run.smithi077.stdout:(7/18): fio-engine-rdma-3.35-1.el9.x86_64.rpm 248 kB/s | 21 kB 00:00 2024-05-15T12:10:39.709 INFO:teuthology.orchestra.run.smithi077.stdout:(8/18): libcap-devel-2.48-9.el9.x86_64.rpm 372 kB/s | 41 kB 00:00 2024-05-15T12:10:39.786 INFO:teuthology.orchestra.run.smithi077.stdout:(9/18): fio-3.35-1.el9.x86_64.rpm 13 MB/s | 6.2 MB 00:00 2024-05-15T12:10:39.843 INFO:teuthology.orchestra.run.smithi077.stdout:(10/18): libnbd-1.18.1-3.el9.x86_64.rpm 1.2 MB/s | 166 kB 00:00 2024-05-15T12:10:39.919 INFO:teuthology.orchestra.run.smithi077.stdout:(11/18): sqlite-3.34.1-7.el9.x86_64.rpm 5.5 MB/s | 748 kB 00:00 2024-05-15T12:10:39.944 INFO:teuthology.orchestra.run.smithi077.stdout:(12/18): udftools-2.2-5.el9.x86_64.rpm 1.5 MB/s | 149 kB 00:00 2024-05-15T12:10:40.061 INFO:teuthology.orchestra.run.smithi077.stdout:(13/18): gdbm-devel-1.23-1.el9.x86_64.rpm 690 kB/s | 81 kB 00:00 2024-05-15T12:10:40.086 INFO:teuthology.orchestra.run.smithi077.stdout:(14/18): gdbm-1.23-1.el9.x86_64.rpm 915 kB/s | 153 kB 00:00 2024-05-15T12:10:40.262 INFO:teuthology.orchestra.run.smithi077.stdout:(15/18): indent-2.2.13-5.el9.x86_64.rpm 1.0 MB/s | 179 kB 00:00 2024-05-15T12:10:40.286 INFO:teuthology.orchestra.run.smithi077.stdout:(16/18): dump-0.4-0.51.b47.el9.x86_64.rpm 390 kB/s | 88 kB 00:00 2024-05-15T12:10:40.345 INFO:teuthology.orchestra.run.smithi077.stdout:(17/18): gdbm-libs-1.23-1.el9.x86_64.rpm 676 kB/s | 56 kB 00:00 2024-05-15T12:10:40.621 INFO:teuthology.orchestra.run.smithi077.stdout:(18/18): kernel-devel-5.14.0-446.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-05-15T12:10:40.621 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-05-15T12:10:40.621 INFO:teuthology.orchestra.run.smithi077.stdout:Total 14 MB/s | 24 MB 00:01 2024-05-15T12:10:40.971 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-05-15T12:10:41.026 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-05-15T12:10:41.027 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-05-15T12:10:41.588 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-05-15T12:10:41.589 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-05-15T12:10:42.638 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-05-15T12:10:42.711 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : gdbm-libs-1:1.23-1.el9.x86_64 1/19 2024-05-15T12:10:42.747 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 2/19 2024-05-15T12:10:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 3/19 2024-05-15T12:10:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 4/19 2024-05-15T12:10:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 5/19 2024-05-15T12:10:42.853 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 6/19 2024-05-15T12:10:42.879 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 7/19 2024-05-15T12:10:42.904 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 8/19 2024-05-15T12:10:43.055 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 9/19 2024-05-15T12:10:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fio-3.35-1.el9.x86_64 10/19 2024-05-15T12:10:43.119 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rmt-2:1.6-6.el9.x86_64 11/19 2024-05-15T12:10:43.150 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 12/19 2024-05-15T12:10:43.194 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 13/19 2024-05-15T12:10:43.237 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : indent-2.2.13-5.el9.x86_64 14/19 2024-05-15T12:10:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : udftools-2.2-5.el9.x86_64 15/19 2024-05-15T12:10:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 16/19 2024-05-15T12:10:44.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:10:44.201 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:10:52.734 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 17/19 2024-05-15T12:10:53.070 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-15T12:11:03.833 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-15T12:11:03.913 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-3.35-1.el9.x86_64 2/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-devel-5.14.0-446.el9.x86_64 9/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/19 2024-05-15T12:11:05.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 11/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 14/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 15/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/19 2024-05-15T12:11:05.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gdbm-libs-1:1.23-1.el9.x86_64 18/19 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout: gdbm-libs-1:1.23-1.el9.x86_64 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-05-15T12:11:06.246 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-446.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: udftools-2.2-5.el9.x86_64 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:11:06.247 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-05-15T12:11:06.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd -m fsgqa 2024-05-15T12:11:06.642 INFO:teuthology.orchestra.run.smithi077.stderr:useradd: user 'fsgqa' already exists 2024-05-15T12:11:06.644 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-15T12:11:06.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo groupadd fsgqa 2024-05-15T12:11:06.709 INFO:teuthology.orchestra.run.smithi077.stderr:groupadd: group 'fsgqa' already exists 2024-05-15T12:11:06.710 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-15T12:11:06.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd fsgqa2 2024-05-15T12:11:07.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd 123456-fsgqa 2024-05-15T12:11:08.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-15T12:11:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.316+0000 7fa8a3607640 1 Processor -- start 2024-05-15T12:11:08.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.316+0000 7fa8a3607640 1 -- start start 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a3607640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 0x7fa89c1603a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a3607640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89c06ee60 con 0x7fa89c06f080 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a3607640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa89c0b4aa0 con 0x7fa89c06fbf0 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a3607640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa89c0b4850 con 0x7fa89c0b0e30 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a0ba2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa89c06f080 0x7fa89c06f4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53886/0 (socket says 172.21.15.77:53886) 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a0ba2640 1 -- 172.21.15.77:0/2546555010 learned_addr learned my addr 172.21.15.77:0/2546555010 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733710215 0 0) 0x7fa89c06ee60 con 0x7fa89c06f080 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.317+0000 7fa8a13a3640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 0x7fa89c1603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa884003520 con 0x7fa89c06f080 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2556801806 0 0) 0x7fa884003520 con 0x7fa89c06f080 2024-05-15T12:11:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 msgr2=0x7fa89c1603a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 0x7fa89c1603a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 >> v1:172.21.15.83:6789/0 conn(0x7fa89c06fbf0 legacy=0x7fa89c06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c0b4d80 con 0x7fa89c06f080 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7fa8900016f0 con 0x7fa89c06f080 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 >> v1:172.21.15.77:6789/0 conn(0x7fa89c06f080 legacy=0x7fa89c06f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 0x7fa884003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa884004110 0x7fa884004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa884004f40 0x7fa88400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c0b4850 con 0x7fa884004f40 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa88400bf00 con 0x7fa884004110 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa88400c080 con 0x7fa89c0b0e30 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a1ba4640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa884004f40 0x7fa88400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a0ba2640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa884004110 0x7fa884004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a13a3640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 0x7fa884003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a1ba4640 1 -- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 msgr2=0x7fa884003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a1ba4640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c0b0e30 0x7fa884003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a1ba4640 1 -- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa884004110 msgr2=0x7fa884004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a1ba4640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa884004110 0x7fa884004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.318+0000 7fa8a1ba4640 1 -- 172.21.15.77:0/2546555010 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa884003520 con 0x7fa884004f40 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa8a1ba4640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa884004f40 0x7fa88400b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa894001760 tx=0x7fa884005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4966c137cc94926e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8940013b0 con 0x7fa884004f40 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8940052d0 con 0x7fa884004f40 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa89bfff640 1 -- 172.21.15.77:0/2546555010 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89402aaa0 con 0x7fa884004f40 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa8a3607640 1 -- 172.21.15.77:0/2546555010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa884004f40 msgr2=0x7fa88400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2546555010 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa884004f40 0x7fa88400b9c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa894001760 tx=0x7fa884005830 comp rx=0 tx=0).stop 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.319+0000 7fa8a1ba4640 1 -- 172.21.15.77:0/2546555010 reap_dead start 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.320+0000 7fa8a3607640 1 -- 172.21.15.77:0/2546555010 shutdown_connections 2024-05-15T12:11:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.320+0000 7fa8a3607640 1 -- 172.21.15.77:0/2546555010 >> 172.21.15.77:0/2546555010 conn(0x7fa89c0d1dd0 msgr2=0x7fa89c0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:11:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.320+0000 7fa8a3607640 1 -- 172.21.15.77:0/2546555010 shutdown_connections 2024-05-15T12:11:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.320+0000 7fa8a3607640 1 -- 172.21.15.77:0/2546555010 wait complete. 2024-05-15T12:11:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.321+0000 7fa8a3607640 1 Processor -- start 2024-05-15T12:11:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.321+0000 7fa8a3607640 1 -- start start 2024-05-15T12:11:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c14d820 0x7fa89c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 0x7fa89c154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c14e620 0x7fa89c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c0b1210 con 0x7fa89c14dc00 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c0b53d0 con 0x7fa89c14d820 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fa89c0b5860 con 0x7fa89c14e620 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 0x7fa89c154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 0x7fa89c154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60948/0 (socket says 172.21.15.77:60948) 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 -- 172.21.15.77:0/2759074392 learned_addr learned my addr 172.21.15.77:0/2759074392 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a13a3640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c14d820 0x7fa89c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a1ba4640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c14e620 0x7fa89c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 -- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c14e620 msgr2=0x7fa89c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c14e620 0x7fa89c0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 -- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c14d820 msgr2=0x7fa89c1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c14d820 0x7fa89c1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 -- 172.21.15.77:0/2759074392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c152ce0 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a0ba2640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 0x7fa89c154be0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa890007340 tx=0x7fa890007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89001a070 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89000f860 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89000fc30 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.322+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89c152fc0 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.323+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89c158a00 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.324+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89c158d20 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.324+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa89001d070 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.324+0000 7fa899ffb640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa888076300 0x7fa8880787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.325+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fa890096dd0 con 0x7fa89c14dc00 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.325+0000 7fa8a13a3640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa888076300 0x7fa8880787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.325+0000 7fa8a13a3640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa888076300 0x7fa8880787c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa88c014510 tx=0x7fa88c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:11:08.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.329+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa89c158d20 con 0x7fa89c14dc00 2024-05-15T12:11:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.586+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa89c06a640 con 0x7fa89c14dc00 2024-05-15T12:11:08.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.587+0000 7fa899ffb640 1 -- 172.21.15.77:0/2759074392 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1277 (secure 0 0 0) 0x7fa890098090 con 0x7fa89c14dc00 2024-05-15T12:11:08.581 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:11:08.581 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":1,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","modified":"2024-05-15T12:08:45.710898Z","created":"2024-05-15T12:08:45.710898Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3300","nonce":0},{"type":"v1","addr":"172.21.15.83:6789","nonce":0}]},"addr":"172.21.15.83:6789/0","public_addr":"172.21.15.83:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:3301","nonce":0},{"type":"v1","addr":"172.21.15.83:6790","nonce":0}]},"addr":"172.21.15.83:6790/0","public_addr":"172.21.15.83:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-15T12:11:08.582 INFO:teuthology.orchestra.run.smithi077.stderr:dumped monmap epoch 1 2024-05-15T12:11:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa888076300 msgr2=0x7fa8880787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa888076300 0x7fa8880787c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa88c014510 tx=0x7fa88c00b040 comp rx=0 tx=0).stop 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 msgr2=0x7fa89c154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 0x7fa89c154be0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa890007340 tx=0x7fa890007800 comp rx=0 tx=0).stop 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 shutdown_connections 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fa888076300 0x7fa8880787c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fa89c14e620 0x7fa89c0cecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa89c14dc00 0x7fa89c154be0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 --2- 172.21.15.77:0/2759074392 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fa89c14d820 0x7fa89c1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 >> 172.21.15.77:0/2759074392 conn(0x7fa89c0d1dd0 msgr2=0x7fa89c15f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 shutdown_connections 2024-05-15T12:11:08.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.589+0000 7fa8a3607640 1 -- 172.21.15.77:0/2759074392 wait complete. 2024-05-15T12:11:08.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-05-15T12:11:08.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.703+0000 7fc1274bd640 1 Processor -- start 2024-05-15T12:11:08.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.703+0000 7fc1274bd640 1 -- start start 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc1274bd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc120159a30 0x7fc120073db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc1274bd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12015c4f0 0x7fc12015c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc1274bd640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc12006f4f0 0x7fc12006f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc1274bd640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fc12015d060 con 0x7fc12006f4f0 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc1274bd640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc12015d340 con 0x7fc120159a30 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc1274bd640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc1200735b0 con 0x7fc12015c4f0 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc12006f4f0 0x7fc12006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc12006f4f0 0x7fc12006f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60960/0 (socket says 172.21.15.77:60960) 2024-05-15T12:11:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 -- 172.21.15.77:0/3500421858 learned_addr learned my addr 172.21.15.77:0/3500421858 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc124a58640 1 --2- 172.21.15.77:0/3500421858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12015c4f0 0x7fc12015c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125259640 1 --2- 172.21.15.77:0/3500421858 >> v2:172.21.15.83:3300/0 conn(0x7fc120159a30 0x7fc120073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 -- 172.21.15.77:0/3500421858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12015c4f0 msgr2=0x7fc12015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 --2- 172.21.15.77:0/3500421858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12015c4f0 0x7fc12015c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 -- 172.21.15.77:0/3500421858 >> v2:172.21.15.83:3300/0 conn(0x7fc120159a30 msgr2=0x7fc120073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 --2- 172.21.15.77:0/3500421858 >> v2:172.21.15.83:3300/0 conn(0x7fc120159a30 0x7fc120073db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125a5a640 1 -- 172.21.15.77:0/3500421858 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc120073890 con 0x7fc12006f4f0 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.704+0000 7fc125259640 1 --2- 172.21.15.77:0/3500421858 >> v2:172.21.15.83:3300/0 conn(0x7fc120159a30 0x7fc120073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:11:08.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.705+0000 7fc125a5a640 1 --2- 172.21.15.77:0/3500421858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12006f4f0 0x7fc12006f980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc12015d550 tx=0x7fc11802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422cac357d0a7271 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.705+0000 7fc117fff640 1 -- 172.21.15.77:0/3500421858 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118036070 con 0x7fc12006f4f0 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.705+0000 7fc117fff640 1 -- 172.21.15.77:0/3500421858 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc118031600 con 0x7fc12006f4f0 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.705+0000 7fc117fff640 1 -- 172.21.15.77:0/3500421858 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1180319d0 con 0x7fc12006f4f0 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 -- 172.21.15.77:0/3500421858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12006f4f0 msgr2=0x7fc12006f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 --2- 172.21.15.77:0/3500421858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12006f4f0 0x7fc12006f980 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc12015d550 tx=0x7fc11802a680 comp rx=0 tx=0).stop 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 -- 172.21.15.77:0/3500421858 shutdown_connections 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 --2- 172.21.15.77:0/3500421858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12006f4f0 0x7fc12006f980 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 --2- 172.21.15.77:0/3500421858 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12015c4f0 0x7fc12015c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 --2- 172.21.15.77:0/3500421858 >> v2:172.21.15.83:3300/0 conn(0x7fc120159a30 0x7fc120073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 -- 172.21.15.77:0/3500421858 >> 172.21.15.77:0/3500421858 conn(0x7fc12006c3f0 msgr2=0x7fc12006c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:11:08.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 -- 172.21.15.77:0/3500421858 shutdown_connections 2024-05-15T12:11:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.706+0000 7fc1274bd640 1 -- 172.21.15.77:0/3500421858 wait complete. 2024-05-15T12:11:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.707+0000 7fc1274bd640 1 Processor -- start 2024-05-15T12:11:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.707+0000 7fc1274bd640 1 -- start start 2024-05-15T12:11:08.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc1274bd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12006f4f0 0x7fc1201e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc1274bd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120159a30 0x7fc12013f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc1274bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 0x7fc12006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc1274bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc120159f90 con 0x7fc12015c4f0 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc1274bd640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc120159e10 con 0x7fc120159a30 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc1274bd640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc1200742f0 con 0x7fc12006f4f0 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 0x7fc12006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 0x7fc12006e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60962/0 (socket says 172.21.15.77:60962) 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 -- 172.21.15.77:0/2003094470 learned_addr learned my addr 172.21.15.77:0/2003094470 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 -- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12006f4f0 msgr2=0x7fc1201e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12006f4f0 0x7fc1201e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 -- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120159a30 msgr2=0x7fc12013f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc124a58640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120159a30 0x7fc12013f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120159a30 0x7fc12013f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc125a5a640 1 -- 172.21.15.77:0/2003094470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12013fd70 con 0x7fc12015c4f0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.708+0000 7fc124a58640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120159a30 0x7fc12013f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.709+0000 7fc125a5a640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 0x7fc12006e3e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc118009f10 tx=0x7fc118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.709+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118036050 con 0x7fc12015c4f0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.709+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc118042070 con 0x7fc12015c4f0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.709+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc120140050 con 0x7fc12015c4f0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.709+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc118009510 con 0x7fc12015c4f0 2024-05-15T12:11:08.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.709+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc120140610 con 0x7fc12015c4f0 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.710+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1200768e0 con 0x7fc12015c4f0 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.711+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc118007bd0 con 0x7fc12015c4f0 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.711+0000 7fc115ffb640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc1040762d0 0x7fc104078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.711+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc1180b84f0 con 0x7fc12015c4f0 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.711+0000 7fc125259640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc1040762d0 0x7fc104078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.711+0000 7fc125259640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc1040762d0 0x7fc104078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006fd0 tx=0x7fc11c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T12:11:08.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.715+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc118081ee0 con 0x7fc12015c4f0 2024-05-15T12:11:08.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.971+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7fc1200b3730 con 0x7fc12015c4f0 2024-05-15T12:11:08.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.972+0000 7fc115ffb640 1 -- 172.21.15.77:0/2003094470 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) ==== 82+0+151 (secure 0 0 0) 0x7fc1180817e0 con 0x7fc12015c4f0 2024-05-15T12:11:08.966 INFO:teuthology.orchestra.run.smithi077.stdout:[client.admin] 2024-05-15T12:11:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDNpURmt205NxAANzOI5QpeQabOt5CM1+83vQ== 2024-05-15T12:11:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow *" 2024-05-15T12:11:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: caps mgr = "allow *" 2024-05-15T12:11:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow *" 2024-05-15T12:11:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow *" 2024-05-15T12:11:08.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc1040762d0 msgr2=0x7fc104078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc1040762d0 0x7fc104078790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc11c006fd0 tx=0x7fc11c008040 comp rx=0 tx=0).stop 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 msgr2=0x7fc12006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 0x7fc12006e3e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc118009f10 tx=0x7fc118004a40 comp rx=0 tx=0).stop 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 shutdown_connections 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc1040762d0 0x7fc104078790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc12015c4f0 0x7fc12006e3e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc120159a30 0x7fc12013f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 --2- 172.21.15.77:0/2003094470 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc12006f4f0 0x7fc1201e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 >> 172.21.15.77:0/2003094470 conn(0x7fc12006c3f0 msgr2=0x7fc1200b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 shutdown_connections 2024-05-15T12:11:08.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T12:11:08.974+0000 7fc1274bd640 1 -- 172.21.15.77:0/2003094470 wait complete. 2024-05-15T12:11:08.979 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-05-15T12:11:08.995 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.VwqSvuzSoH 2024-05-15T12:11:08.995 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:11:08.995 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/tmp/tmp.VwqSvuzSoH 2024-05-15T12:11:09.051 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:11:09.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/tmp/tmp.DmRtshrLxIxfstests-dev/local.config 2024-05-15T12:11:09.115 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.BgAiu3pKHAtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.7yeh0hEYITscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.77:6789 -k /tmp/tmp.VwqSvuzSoH --client_mountpoint /test" 2024-05-15T12:11:09.116 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T12:11:09.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/tmp/tmp.DmRtshrLxIxfstests-dev/ceph.exclude 2024-05-15T12:11:09.181 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo make) 2024-05-15T12:11:09.268 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize -cfi 2024-05-15T12:11:09.665 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-15T12:11:09.666 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './config.guess' 2024-05-15T12:11:09.669 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './config.sub' 2024-05-15T12:11:09.672 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './install-sh' 2024-05-15T12:11:09.676 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './ltmain.sh' 2024-05-15T12:11:09.698 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-15T12:11:09.699 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-15T12:11:09.703 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-15T12:11:09.707 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-15T12:11:09.712 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-15T12:11:09.716 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-15T12:11:09.723 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-15T12:11:09.725 INFO:teuthology.orchestra.run.smithi077.stdout:cp include/install-sh . 2024-05-15T12:11:09.725 INFO:teuthology.orchestra.run.smithi077.stdout:aclocal -I m4 2024-05-15T12:11:10.715 INFO:teuthology.orchestra.run.smithi077.stdout:autoheader 2024-05-15T12:11:11.019 INFO:teuthology.orchestra.run.smithi077.stdout:autoconf 2024-05-15T12:11:11.188 INFO:teuthology.orchestra.run.smithi077.stdout:./configure \ 2024-05-15T12:11:11.188 INFO:teuthology.orchestra.run.smithi077.stdout: --libexecdir=/usr/lib \ 2024-05-15T12:11:11.188 INFO:teuthology.orchestra.run.smithi077.stdout: --exec_prefix=/var/lib 2024-05-15T12:11:11.564 INFO:teuthology.orchestra.run.smithi077.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-15T12:11:11.564 INFO:teuthology.orchestra.run.smithi077.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-15T12:11:11.565 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to print strings... printf 2024-05-15T12:11:11.566 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc... gcc 2024-05-15T12:11:11.677 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether the C compiler works... yes 2024-05-15T12:11:11.677 INFO:teuthology.orchestra.run.smithi077.stdout:checking for C compiler default output file name... a.out 2024-05-15T12:11:11.705 INFO:teuthology.orchestra.run.smithi077.stdout:checking for suffix of executables... 2024-05-15T12:11:11.774 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are cross compiling... no 2024-05-15T12:11:11.791 INFO:teuthology.orchestra.run.smithi077.stdout:checking for suffix of object files... o 2024-05-15T12:11:11.806 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are using the GNU C compiler... yes 2024-05-15T12:11:11.821 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc accepts -g... yes 2024-05-15T12:11:11.869 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-15T12:11:11.871 INFO:teuthology.orchestra.run.smithi077.stdout:checking for a sed that does not truncate output... /bin/sed 2024-05-15T12:11:11.873 INFO:teuthology.orchestra.run.smithi077.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-05-15T12:11:11.874 INFO:teuthology.orchestra.run.smithi077.stdout:checking for egrep... /bin/grep -E 2024-05-15T12:11:11.875 INFO:teuthology.orchestra.run.smithi077.stdout:checking for fgrep... /bin/grep -F 2024-05-15T12:11:11.879 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ld used by gcc... /bin/ld 2024-05-15T12:11:11.880 INFO:teuthology.orchestra.run.smithi077.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-05-15T12:11:11.903 INFO:teuthology.orchestra.run.smithi077.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-05-15T12:11:12.793 INFO:teuthology.orchestra.run.smithi077.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-05-15T12:11:12.793 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether ln -s works... yes 2024-05-15T12:11:12.801 INFO:teuthology.orchestra.run.smithi077.stdout:checking the maximum length of command line arguments... 1572864 2024-05-15T12:11:12.805 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-15T12:11:12.805 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-15T12:11:12.805 INFO:teuthology.orchestra.run.smithi077.stdout:checking for /bin/ld option to reload object files... -r 2024-05-15T12:11:12.805 INFO:teuthology.orchestra.run.smithi077.stdout:checking for objdump... objdump 2024-05-15T12:11:12.805 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to recognize dependent libraries... pass_all 2024-05-15T12:11:12.806 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dlltool... no 2024-05-15T12:11:12.806 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-15T12:11:12.806 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ar... ar 2024-05-15T12:11:12.860 INFO:teuthology.orchestra.run.smithi077.stdout:checking for archiver @FILE support... @ 2024-05-15T12:11:12.860 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strip... strip 2024-05-15T12:11:12.860 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ranlib... ranlib 2024-05-15T12:11:12.860 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gawk... gawk 2024-05-15T12:11:12.926 INFO:teuthology.orchestra.run.smithi077.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-05-15T12:11:12.927 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sysroot... no 2024-05-15T12:11:12.930 INFO:teuthology.orchestra.run.smithi077.stdout:checking for a working dd... /bin/dd 2024-05-15T12:11:12.933 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-05-15T12:11:12.946 INFO:teuthology.orchestra.run.smithi077.stdout:checking for mt... no 2024-05-15T12:11:12.948 INFO:teuthology.orchestra.run.smithi077.stdout:checking if : is a manifest tool... no 2024-05-15T12:11:13.010 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to run the C preprocessor... gcc -E 2024-05-15T12:11:13.173 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ANSI C header files... yes 2024-05-15T12:11:13.195 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/types.h... yes 2024-05-15T12:11:13.226 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/stat.h... yes 2024-05-15T12:11:13.250 INFO:teuthology.orchestra.run.smithi077.stdout:checking for stdlib.h... yes 2024-05-15T12:11:13.275 INFO:teuthology.orchestra.run.smithi077.stdout:checking for string.h... yes 2024-05-15T12:11:13.301 INFO:teuthology.orchestra.run.smithi077.stdout:checking for memory.h... yes 2024-05-15T12:11:13.326 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strings.h... yes 2024-05-15T12:11:13.354 INFO:teuthology.orchestra.run.smithi077.stdout:checking for inttypes.h... yes 2024-05-15T12:11:13.379 INFO:teuthology.orchestra.run.smithi077.stdout:checking for stdint.h... yes 2024-05-15T12:11:13.427 INFO:teuthology.orchestra.run.smithi077.stdout:checking for unistd.h... yes 2024-05-15T12:11:13.453 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dlfcn.h... yes 2024-05-15T12:11:13.456 INFO:teuthology.orchestra.run.smithi077.stdout:checking for objdir... .libs 2024-05-15T12:11:13.518 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-15T12:11:13.519 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-15T12:11:13.534 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-15T12:11:13.560 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc static flag -static works... no 2024-05-15T12:11:13.581 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -c -o file.o... yes 2024-05-15T12:11:13.581 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-15T12:11:13.587 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-15T12:11:13.614 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether -lc should be explicitly linked in... no 2024-05-15T12:11:13.694 INFO:teuthology.orchestra.run.smithi077.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-15T12:11:13.694 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to hardcode library paths into programs... immediate 2024-05-15T12:11:13.695 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether stripping libraries is possible... yes 2024-05-15T12:11:13.695 INFO:teuthology.orchestra.run.smithi077.stdout:checking if libtool supports shared libraries... yes 2024-05-15T12:11:13.696 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether to build shared libraries... yes 2024-05-15T12:11:13.696 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether to build static libraries... yes 2024-05-15T12:11:13.701 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc... (cached) gcc 2024-05-15T12:11:13.717 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-15T12:11:13.718 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-15T12:11:13.718 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-15T12:11:13.718 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gmake... /usr/bin/gmake 2024-05-15T12:11:13.718 INFO:teuthology.orchestra.run.smithi077.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-05-15T12:11:13.719 INFO:teuthology.orchestra.run.smithi077.stdout:checking for tar... /bin/tar 2024-05-15T12:11:13.719 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gzip... /bin/gzip 2024-05-15T12:11:13.742 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc -MM is supported... yes 2024-05-15T12:11:13.742 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sort... /bin/sort 2024-05-15T12:11:13.742 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether ln -s works... yes 2024-05-15T12:11:13.743 INFO:teuthology.orchestra.run.smithi077.stdout:checking for rpm... /bin/rpm 2024-05-15T12:11:13.746 INFO:teuthology.orchestra.run.smithi077.stdout:checking for rpmbuild... no 2024-05-15T12:11:13.770 INFO:teuthology.orchestra.run.smithi077.stdout:checking assert.h usability... yes 2024-05-15T12:11:13.779 INFO:teuthology.orchestra.run.smithi077.stdout:checking assert.h presence... yes 2024-05-15T12:11:13.779 INFO:teuthology.orchestra.run.smithi077.stdout:checking for assert.h... yes 2024-05-15T12:11:13.806 INFO:teuthology.orchestra.run.smithi077.stdout:checking bstring.h usability... no 2024-05-15T12:11:13.817 INFO:teuthology.orchestra.run.smithi077.stdout:checking bstring.h presence... no 2024-05-15T12:11:13.817 INFO:teuthology.orchestra.run.smithi077.stdout:checking for bstring.h... no 2024-05-15T12:11:13.842 INFO:teuthology.orchestra.run.smithi077.stdout:checking libgen.h usability... yes 2024-05-15T12:11:13.851 INFO:teuthology.orchestra.run.smithi077.stdout:checking libgen.h presence... yes 2024-05-15T12:11:13.851 INFO:teuthology.orchestra.run.smithi077.stdout:checking for libgen.h... yes 2024-05-15T12:11:13.880 INFO:teuthology.orchestra.run.smithi077.stdout:checking dirent.h usability... yes 2024-05-15T12:11:13.889 INFO:teuthology.orchestra.run.smithi077.stdout:checking dirent.h presence... yes 2024-05-15T12:11:13.890 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dirent.h... yes 2024-05-15T12:11:13.946 INFO:teuthology.orchestra.run.smithi077.stdout:checking errno.h usability... yes 2024-05-15T12:11:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:checking errno.h presence... yes 2024-05-15T12:11:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:checking for errno.h... yes 2024-05-15T12:11:13.983 INFO:teuthology.orchestra.run.smithi077.stdout:checking malloc.h usability... yes 2024-05-15T12:11:13.992 INFO:teuthology.orchestra.run.smithi077.stdout:checking malloc.h presence... yes 2024-05-15T12:11:13.992 INFO:teuthology.orchestra.run.smithi077.stdout:checking for malloc.h... yes 2024-05-15T12:11:14.020 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid.h usability... no 2024-05-15T12:11:14.031 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid.h presence... no 2024-05-15T12:11:14.031 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid.h... no 2024-05-15T12:11:14.058 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid/uuid.h usability... yes 2024-05-15T12:11:14.069 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid/uuid.h presence... yes 2024-05-15T12:11:14.069 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid/uuid.h... yes 2024-05-15T12:11:14.095 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/uuid.h usability... no 2024-05-15T12:11:14.106 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/uuid.h presence... no 2024-05-15T12:11:14.106 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/uuid.h... no 2024-05-15T12:11:14.133 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/file.h usability... yes 2024-05-15T12:11:14.142 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/file.h presence... yes 2024-05-15T12:11:14.142 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/file.h... yes 2024-05-15T12:11:14.170 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fcntl.h usability... yes 2024-05-15T12:11:14.179 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fcntl.h presence... yes 2024-05-15T12:11:14.179 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fcntl.h... yes 2024-05-15T12:11:14.206 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/syssgi.h usability... no 2024-05-15T12:11:14.217 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/syssgi.h presence... no 2024-05-15T12:11:14.217 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/syssgi.h... no 2024-05-15T12:11:14.264 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/param.h usability... yes 2024-05-15T12:11:14.276 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/param.h presence... yes 2024-05-15T12:11:14.276 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/param.h... yes 2024-05-15T12:11:14.280 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/stat.h... (cached) yes 2024-05-15T12:11:14.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:11:14.287 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:11:14.309 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/statvfs.h usability... yes 2024-05-15T12:11:14.319 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/statvfs.h presence... yes 2024-05-15T12:11:14.319 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/statvfs.h... yes 2024-05-15T12:11:14.356 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/time.h usability... yes 2024-05-15T12:11:14.365 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/time.h presence... yes 2024-05-15T12:11:14.365 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/time.h... yes 2024-05-15T12:11:14.400 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/ioctl.h usability... yes 2024-05-15T12:11:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/ioctl.h presence... yes 2024-05-15T12:11:14.409 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/ioctl.h... yes 2024-05-15T12:11:14.448 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/wait.h usability... yes 2024-05-15T12:11:14.458 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/wait.h presence... yes 2024-05-15T12:11:14.458 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/wait.h... yes 2024-05-15T12:11:14.463 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/types.h... (cached) yes 2024-05-15T12:11:14.468 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strings.h... (cached) yes 2024-05-15T12:11:14.501 INFO:teuthology.orchestra.run.smithi077.stdout:checking err.h usability... yes 2024-05-15T12:11:14.510 INFO:teuthology.orchestra.run.smithi077.stdout:checking err.h presence... yes 2024-05-15T12:11:14.510 INFO:teuthology.orchestra.run.smithi077.stdout:checking for err.h... yes 2024-05-15T12:11:14.538 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/falloc.h usability... yes 2024-05-15T12:11:14.545 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/falloc.h presence... yes 2024-05-15T12:11:14.546 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/falloc.h... yes 2024-05-15T12:11:14.573 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-15T12:11:14.583 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-15T12:11:14.583 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-15T12:11:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-15T12:11:14.619 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-15T12:11:14.619 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-15T12:11:14.644 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/platform_defs.h usability... no 2024-05-15T12:11:14.655 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/platform_defs.h presence... no 2024-05-15T12:11:14.655 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/platform_defs.h... no 2024-05-15T12:11:14.680 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfs/ioctl.h usability... no 2024-05-15T12:11:14.691 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfs/ioctl.h presence... no 2024-05-15T12:11:14.691 INFO:teuthology.orchestra.run.smithi077.stdout:checking for btrfs/ioctl.h... no 2024-05-15T12:11:14.715 INFO:teuthology.orchestra.run.smithi077.stdout:checking cifs/ioctl.h usability... no 2024-05-15T12:11:14.726 INFO:teuthology.orchestra.run.smithi077.stdout:checking cifs/ioctl.h presence... no 2024-05-15T12:11:14.726 INFO:teuthology.orchestra.run.smithi077.stdout:checking for cifs/ioctl.h... no 2024-05-15T12:11:14.762 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/mman.h usability... yes 2024-05-15T12:11:14.771 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/mman.h presence... yes 2024-05-15T12:11:14.771 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/mman.h... yes 2024-05-15T12:11:14.799 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/ext4.h usability... no 2024-05-15T12:11:14.810 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/ext4.h presence... no 2024-05-15T12:11:14.810 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/ext4.h... no 2024-05-15T12:11:14.823 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xfs_log_format.h... no 2024-05-15T12:11:14.868 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid_compare... no 2024-05-15T12:11:14.899 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid_compare in -luuid... yes 2024-05-15T12:11:14.952 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xfs.h... yes 2024-05-15T12:11:14.966 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/libxfs.h... no 2024-05-15T12:11:14.981 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-15T12:11:15.011 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xqm.h... yes 2024-05-15T12:11:15.059 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-15T12:11:15.082 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/handle.h usability... yes 2024-05-15T12:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/handle.h presence... yes 2024-05-15T12:11:15.090 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/handle.h... yes 2024-05-15T12:11:15.132 INFO:teuthology.orchestra.run.smithi077.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-15T12:11:15.160 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/acl.h usability... yes 2024-05-15T12:11:15.169 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/acl.h presence... yes 2024-05-15T12:11:15.170 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/acl.h... yes 2024-05-15T12:11:15.199 INFO:teuthology.orchestra.run.smithi077.stdout:checking acl/libacl.h usability... yes 2024-05-15T12:11:15.209 INFO:teuthology.orchestra.run.smithi077.stdout:checking acl/libacl.h presence... yes 2024-05-15T12:11:15.209 INFO:teuthology.orchestra.run.smithi077.stdout:checking for acl/libacl.h... yes 2024-05-15T12:11:15.241 INFO:teuthology.orchestra.run.smithi077.stdout:checking for acl_init in -lacl... yes 2024-05-15T12:11:15.265 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm-ndbm.h usability... no 2024-05-15T12:11:15.276 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm-ndbm.h presence... no 2024-05-15T12:11:15.277 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gdbm-ndbm.h... no 2024-05-15T12:11:15.300 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm/ndbm.h usability... yes 2024-05-15T12:11:15.311 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm/ndbm.h presence... yes 2024-05-15T12:11:15.312 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gdbm/ndbm.h... yes 2024-05-15T12:11:15.347 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_open in -lgdbm... no 2024-05-15T12:11:15.381 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_fetch in -lgdbm... no 2024-05-15T12:11:15.415 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_store in -lgdbm... no 2024-05-15T12:11:15.450 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_close in -lgdbm... no 2024-05-15T12:11:15.481 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-05-15T12:11:15.512 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-05-15T12:11:15.545 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-05-15T12:11:15.577 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-05-15T12:11:15.601 INFO:teuthology.orchestra.run.smithi077.stdout:checking libaio.h usability... yes 2024-05-15T12:11:15.612 INFO:teuthology.orchestra.run.smithi077.stdout:checking libaio.h presence... yes 2024-05-15T12:11:15.612 INFO:teuthology.orchestra.run.smithi077.stdout:checking for libaio.h... yes 2024-05-15T12:11:15.635 INFO:teuthology.orchestra.run.smithi077.stdout:checking liburing.h usability... no 2024-05-15T12:11:15.646 INFO:teuthology.orchestra.run.smithi077.stdout:checking liburing.h presence... no 2024-05-15T12:11:15.646 INFO:teuthology.orchestra.run.smithi077.stdout:checking for liburing.h... no 2024-05-15T12:11:15.676 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/capability.h usability... yes 2024-05-15T12:11:15.688 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/capability.h presence... yes 2024-05-15T12:11:15.688 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/capability.h... yes 2024-05-15T12:11:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fiemap.h usability... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fiemap.h presence... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/fiemap.h... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking for fallocate... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking for open_by_handle_at... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fs.h usability... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fs.h presence... yes 2024-05-15T12:11:15.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/fs.h... yes 2024-05-15T12:11:15.845 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfsutil.h usability... no 2024-05-15T12:11:15.856 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfsutil.h presence... no 2024-05-15T12:11:15.856 INFO:teuthology.orchestra.run.smithi077.stdout:checking for btrfsutil.h... no 2024-05-15T12:11:15.903 INFO:teuthology.orchestra.run.smithi077.stdout:checking for copy_file_range... yes 2024-05-15T12:11:15.939 INFO:teuthology.orchestra.run.smithi077.stdout:checking for SEEK_DATA... yes 2024-05-15T12:11:15.988 INFO:teuthology.orchestra.run.smithi077.stdout:checking for BMV_OF_SHARED... yes 2024-05-15T12:11:16.025 INFO:teuthology.orchestra.run.smithi077.stdout:checking for nftw... yes 2024-05-15T12:11:16.065 INFO:teuthology.orchestra.run.smithi077.stdout:checking for RLIMIT_NOFILE... yes 2024-05-15T12:11:16.097 INFO:teuthology.orchestra.run.smithi077.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-15T12:11:16.130 INFO:teuthology.orchestra.run.smithi077.stdout:checking for FICLONE... yes 2024-05-15T12:11:16.164 INFO:teuthology.orchestra.run.smithi077.stdout:checking for renameat2... yes 2024-05-15T12:11:16.197 INFO:teuthology.orchestra.run.smithi077.stdout:checking for reallocarray... yes 2024-05-15T12:11:16.228 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct mount_attr... yes 2024-05-15T12:11:16.267 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-15T12:11:16.301 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-15T12:11:16.334 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-15T12:11:16.366 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-15T12:11:16.399 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-15T12:11:16.432 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-15T12:11:16.465 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-15T12:11:16.491 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs.h usability... yes 2024-05-15T12:11:16.500 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs.h presence... yes 2024-05-15T12:11:16.500 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/btrfs.h... yes 2024-05-15T12:11:16.530 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-15T12:11:16.539 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-15T12:11:16.539 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/btrfs_tree.h... yes 2024-05-15T12:11:16.560 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-15T12:11:16.581 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-15T12:11:16.597 INFO:teuthology.orchestra.run.smithi077.stdout:configure: creating ./config.status 2024-05-15T12:11:16.889 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: creating include/builddefs 2024-05-15T12:11:16.900 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: creating include/config.h 2024-05-15T12:11:16.908 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: executing libtool commands 2024-05-15T12:11:16.946 INFO:teuthology.orchestra.run.smithi077.stdout:Building include 2024-05-15T12:11:16.950 INFO:teuthology.orchestra.run.smithi077.stdout:Building lib 2024-05-15T12:11:16.953 INFO:teuthology.orchestra.run.smithi077.stdout: [LTDEP] 2024-05-15T12:11:17.095 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dataascii.lo 2024-05-15T12:11:17.208 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] databin.lo 2024-05-15T12:11:17.345 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] datapid.lo 2024-05-15T12:11:17.441 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] file_lock.lo 2024-05-15T12:11:17.576 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] forker.lo 2024-05-15T12:11:17.701 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] pattern.lo 2024-05-15T12:11:17.812 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] open_flags.lo 2024-05-15T12:11:17.940 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] random_range.lo 2024-05-15T12:11:18.147 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] string_to_tokens.lo 2024-05-15T12:11:18.241 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] str_to_bytes.lo 2024-05-15T12:11:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] tlibio.lo 2024-05-15T12:11:18.588 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] write_log.lo 2024-05-15T12:11:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] random.lo 2024-05-15T12:11:18.900 INFO:teuthology.orchestra.run.smithi077.stdout: [LD] 2024-05-15T12:11:18.978 INFO:teuthology.orchestra.run.smithi077.stdout:Building ltp 2024-05-15T12:11:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2024-05-15T12:11:19.137 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] doio 2024-05-15T12:11:19.750 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsstress 2024-05-15T12:11:21.059 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsx 2024-05-15T12:11:21.720 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] growfiles 2024-05-15T12:11:22.170 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] iogen 2024-05-15T12:11:22.510 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-stress 2024-05-15T12:11:22.890 INFO:teuthology.orchestra.run.smithi077.stdout:Building src 2024-05-15T12:11:22.896 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2024-05-15T12:11:24.635 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2024-05-15T12:11:24.665 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2024-05-15T12:11:24.673 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2024-05-15T12:11:24.886 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2024-05-15T12:11:24.907 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirstress 2024-05-15T12:11:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fill 2024-05-15T12:11:25.247 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fill2 2024-05-15T12:11:25.449 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] getpagesize 2024-05-15T12:11:25.565 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] holes 2024-05-15T12:11:25.732 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] lstat64 2024-05-15T12:11:25.889 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] nametest 2024-05-15T12:11:26.097 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] permname 2024-05-15T12:11:26.271 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] randholes 2024-05-15T12:11:26.489 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] runas 2024-05-15T12:11:26.641 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] truncfile 2024-05-15T12:11:26.794 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] usemem 2024-05-15T12:11:26.922 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmapcat 2024-05-15T12:11:27.048 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] append_reader 2024-05-15T12:11:27.176 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] append_writer 2024-05-15T12:11:27.303 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirperf 2024-05-15T12:11:27.510 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] metaperf 2024-05-15T12:11:27.761 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] devzero 2024-05-15T12:11:27.910 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] feature 2024-05-15T12:11:28.095 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] alloc 2024-05-15T12:11:28.276 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fault 2024-05-15T12:11:28.413 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fstest 2024-05-15T12:11:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_access_root 2024-05-15T12:11:28.751 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] godown 2024-05-15T12:11:28.894 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] resvtest 2024-05-15T12:11:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] writemod 2024-05-15T12:11:29.175 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] writev_on_pagefault 2024-05-15T12:11:29.312 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] makeextents 2024-05-15T12:11:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] itrash 2024-05-15T12:11:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] rename 2024-05-15T12:11:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] multi_open_unlink 2024-05-15T12:11:29.854 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] unwritten_sync 2024-05-15T12:11:30.008 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] genhashnames 2024-05-15T12:11:30.172 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_holes 2024-05-15T12:11:30.299 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_writev 2024-05-15T12:11:30.425 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_truncate_cmtime 2024-05-15T12:11:30.560 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirhash_collide 2024-05-15T12:11:30.728 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_rename_overwrite 2024-05-15T12:11:30.848 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] holetest 2024-05-15T12:11:31.050 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_truncate_self 2024-05-15T12:11:31.170 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] af_unix 2024-05-15T12:11:31.300 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_stale_pmd 2024-05-15T12:11:31.430 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_cow_race 2024-05-15T12:11:31.572 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_fallocate 2024-05-15T12:11:31.701 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsync-err 2024-05-15T12:11:31.859 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_write_ro 2024-05-15T12:11:31.989 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-15T12:11:32.126 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-15T12:11:32.258 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ofd_locks 2024-05-15T12:11:32.426 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_collision 2024-05-15T12:11:32.599 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmap-write-concurrent 2024-05-15T12:11:32.745 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_get_file_time 2024-05-15T12:11:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_create_short_dirs 2024-05-15T12:11:33.015 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_create_long_dirs 2024-05-15T12:11:33.157 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_enospc 2024-05-15T12:11:33.336 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_writev_overlap 2024-05-15T12:11:33.483 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] checkpoint_journal 2024-05-15T12:11:33.615 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmap-rw-fault 2024-05-15T12:11:33.774 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] allocstale 2024-05-15T12:11:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_cow_memory_failure 2024-05-15T12:11:34.062 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fake-dump-rootino 2024-05-15T12:11:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-buf-fault 2024-05-15T12:11:34.320 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] rewinddir-test 2024-05-15T12:11:34.465 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] readdir-while-renames 2024-05-15T12:11:34.608 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] xfsctl 2024-05-15T12:11:34.770 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bstat 2024-05-15T12:11:34.948 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mtab 2024-05-15T12:11:35.109 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] getdevicesize 2024-05-15T12:11:35.229 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] preallo_rw_pattern_reader 2024-05-15T12:11:35.364 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] preallo_rw_pattern_writer 2024-05-15T12:11:35.497 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] ftrunc 2024-05-15T12:11:35.624 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] trunc 2024-05-15T12:11:35.762 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fs_perms 2024-05-15T12:11:35.902 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] testx 2024-05-15T12:11:36.014 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] looptest 2024-05-15T12:11:36.181 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] locktest 2024-05-15T12:11:36.452 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] unwritten_mmap 2024-05-15T12:11:36.591 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_unlink_test 2024-05-15T12:11:36.762 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] deduperace 2024-05-15T12:11:36.930 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_unlink_test_modified 2024-05-15T12:11:37.099 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_offset 2024-05-15T12:11:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_futimens 2024-05-15T12:11:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_immutable 2024-05-15T12:11:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] stale_handle 2024-05-15T12:11:38.045 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] pwrite_mmap_blocked 2024-05-15T12:11:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_offset2 2024-05-15T12:11:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] seek_sanity_test 2024-05-15T12:11:38.741 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] seek_copy_test 2024-05-15T12:11:38.893 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_1 2024-05-15T12:11:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_2 2024-05-15T12:11:39.148 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsync-tester 2024-05-15T12:11:39.369 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] nsexec 2024-05-15T12:11:39.521 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] cloner 2024-05-15T12:11:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] renameat2 2024-05-15T12:11:39.817 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_getcwd 2024-05-15T12:11:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] e4compact 2024-05-15T12:11:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] test-nextquota 2024-05-15T12:11:40.274 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] punch-alternating 2024-05-15T12:11:40.419 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-15T12:11:40.564 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] listxattr 2024-05-15T12:11:40.690 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-interleaved 2024-05-15T12:11:40.828 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_type 2024-05-15T12:11:40.962 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-invalidate-cache 2024-05-15T12:11:41.136 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] stat_test 2024-05-15T12:11:41.397 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_encrypted_d_revalidate 2024-05-15T12:11:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] attr_replace_test 2024-05-15T12:11:41.678 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] swapon 2024-05-15T12:11:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mkswap 2024-05-15T12:11:41.950 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_attr_corruption 2024-05-15T12:11:42.078 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_open_tmpfiles 2024-05-15T12:11:42.231 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fscrypt-crypt-util 2024-05-15T12:11:42.833 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_null_ocount 2024-05-15T12:11:42.968 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] splice-test 2024-05-15T12:11:43.123 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] chprojid_fail 2024-05-15T12:11:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] detached_mounts_propagation 2024-05-15T12:11:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] ext4_resize 2024-05-15T12:11:43.551 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_3 2024-05-15T12:11:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] splice2pipe 2024-05-15T12:11:43.859 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] uuid_ioctl 2024-05-15T12:11:43.993 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-15T12:11:44.132 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fiemap-fault 2024-05-15T12:11:44.266 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fiemap-tester 2024-05-15T12:11:44.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:11:44.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:11:44.504 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_stripealign 2024-05-15T12:11:44.636 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] open_by_handle 2024-05-15T12:11:44.862 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dbtest 2024-05-15T12:11:45.085 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_dio 2024-05-15T12:11:45.223 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] xfsfind 2024-05-15T12:11:45.395 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_reflink_read_race 2024-05-15T12:11:45.561 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fssum 2024-05-15T12:11:45.965 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2024-05-15T12:11:45.971 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] replay-log 2024-05-15T12:11:46.252 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2024-05-15T12:11:46.256 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2024-05-15T12:11:46.262 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aiocp 2024-05-15T12:11:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-15T12:11:46.606 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-append-write-read-race 2024-05-15T12:11:46.757 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-cow-race 2024-05-15T12:11:46.889 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-cycle-write 2024-05-15T12:11:47.048 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-eof-race 2024-05-15T12:11:47.206 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-extend-stat 2024-05-15T12:11:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-fcntl-race 2024-05-15T12:11:47.487 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-hole-filling-race 2024-05-15T12:11:47.614 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-invalidate-failure 2024-05-15T12:11:47.751 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-invalidate-readahead 2024-05-15T12:11:47.893 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aiodio_sparse2 2024-05-15T12:11:48.084 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-subblock-eof-read 2024-05-15T12:11:48.205 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-write-verify 2024-05-15T12:11:48.378 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-15T12:11:48.491 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-15T12:11:48.603 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-last-ref-held-by-io 2024-05-15T12:11:48.752 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2024-05-15T12:11:48.757 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] vfstest 2024-05-15T12:11:52.048 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mount-idmapped 2024-05-15T12:11:52.387 INFO:teuthology.orchestra.run.smithi077.stdout:Building m4 2024-05-15T12:11:52.390 INFO:teuthology.orchestra.run.smithi077.stdout:Building common 2024-05-15T12:11:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:Building tests 2024-05-15T12:11:52.399 INFO:teuthology.orchestra.run.smithi077.stdout:Building btrfs 2024-05-15T12:11:52.405 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/btrfs/group.list 2024-05-15T12:11:52.467 INFO:teuthology.orchestra.run.smithi077.stdout:Building ceph 2024-05-15T12:11:52.472 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ceph/group.list 2024-05-15T12:11:52.487 INFO:teuthology.orchestra.run.smithi077.stdout:Building cifs 2024-05-15T12:11:52.493 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/cifs/group.list 2024-05-15T12:11:52.506 INFO:teuthology.orchestra.run.smithi077.stdout:Building ext4 2024-05-15T12:11:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ext4/group.list 2024-05-15T12:11:52.551 INFO:teuthology.orchestra.run.smithi077.stdout:Building f2fs 2024-05-15T12:11:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/f2fs/group.list 2024-05-15T12:11:52.574 INFO:teuthology.orchestra.run.smithi077.stdout:Building generic 2024-05-15T12:11:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/generic/group.list 2024-05-15T12:11:52.683 INFO:teuthology.orchestra.run.smithi077.stdout:Building nfs 2024-05-15T12:11:52.688 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/nfs/group.list 2024-05-15T12:11:52.702 INFO:teuthology.orchestra.run.smithi077.stdout:Building ocfs2 2024-05-15T12:11:52.707 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ocfs2/group.list 2024-05-15T12:11:52.721 INFO:teuthology.orchestra.run.smithi077.stdout:Building overlay 2024-05-15T12:11:52.726 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/overlay/group.list 2024-05-15T12:11:52.768 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2024-05-15T12:11:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/perf/group.list 2024-05-15T12:11:52.785 INFO:teuthology.orchestra.run.smithi077.stdout:Building selftest 2024-05-15T12:11:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/selftest/group.list 2024-05-15T12:11:52.803 INFO:teuthology.orchestra.run.smithi077.stdout:Building shared 2024-05-15T12:11:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/shared/group.list 2024-05-15T12:11:52.826 INFO:teuthology.orchestra.run.smithi077.stdout:Building tmpfs 2024-05-15T12:11:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/tmpfs/group.list 2024-05-15T12:11:52.844 INFO:teuthology.orchestra.run.smithi077.stdout:Building udf 2024-05-15T12:11:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/udf/group.list 2024-05-15T12:11:52.861 INFO:teuthology.orchestra.run.smithi077.stdout:Building xfs 2024-05-15T12:11:52.868 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/xfs/group.list 2024-05-15T12:11:52.969 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo make install) 2024-05-15T12:11:53.005 INFO:teuthology.orchestra.run.smithi077.stdout:Building include 2024-05-15T12:11:53.009 INFO:teuthology.orchestra.run.smithi077.stdout:Building lib 2024-05-15T12:11:53.013 INFO:teuthology.orchestra.run.smithi077.stdout:Building ltp 2024-05-15T12:11:53.017 INFO:teuthology.orchestra.run.smithi077.stdout:Building src 2024-05-15T12:11:53.051 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2024-05-15T12:11:53.054 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2024-05-15T12:11:53.058 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2024-05-15T12:11:53.062 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2024-05-15T12:11:53.066 INFO:teuthology.orchestra.run.smithi077.stdout:Building m4 2024-05-15T12:11:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:Building common 2024-05-15T12:11:53.073 INFO:teuthology.orchestra.run.smithi077.stdout:Building tests 2024-05-15T12:11:53.078 INFO:teuthology.orchestra.run.smithi077.stdout:Building btrfs 2024-05-15T12:11:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/btrfs/group.list 2024-05-15T12:11:53.146 INFO:teuthology.orchestra.run.smithi077.stdout:Building ceph 2024-05-15T12:11:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ceph/group.list 2024-05-15T12:11:53.166 INFO:teuthology.orchestra.run.smithi077.stdout:Building cifs 2024-05-15T12:11:53.171 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/cifs/group.list 2024-05-15T12:11:53.184 INFO:teuthology.orchestra.run.smithi077.stdout:Building ext4 2024-05-15T12:11:53.189 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ext4/group.list 2024-05-15T12:11:53.228 INFO:teuthology.orchestra.run.smithi077.stdout:Building f2fs 2024-05-15T12:11:53.233 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/f2fs/group.list 2024-05-15T12:11:53.250 INFO:teuthology.orchestra.run.smithi077.stdout:Building generic 2024-05-15T12:11:53.257 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/generic/group.list 2024-05-15T12:11:53.357 INFO:teuthology.orchestra.run.smithi077.stdout:Building nfs 2024-05-15T12:11:53.362 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/nfs/group.list 2024-05-15T12:11:53.377 INFO:teuthology.orchestra.run.smithi077.stdout:Building ocfs2 2024-05-15T12:11:53.381 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ocfs2/group.list 2024-05-15T12:11:53.395 INFO:teuthology.orchestra.run.smithi077.stdout:Building overlay 2024-05-15T12:11:53.401 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/overlay/group.list 2024-05-15T12:11:53.442 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2024-05-15T12:11:53.447 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/perf/group.list 2024-05-15T12:11:53.459 INFO:teuthology.orchestra.run.smithi077.stdout:Building selftest 2024-05-15T12:11:53.464 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/selftest/group.list 2024-05-15T12:11:53.477 INFO:teuthology.orchestra.run.smithi077.stdout:Building shared 2024-05-15T12:11:53.482 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/shared/group.list 2024-05-15T12:11:53.500 INFO:teuthology.orchestra.run.smithi077.stdout:Building tmpfs 2024-05-15T12:11:53.505 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/tmpfs/group.list 2024-05-15T12:11:53.519 INFO:teuthology.orchestra.run.smithi077.stdout:Building udf 2024-05-15T12:11:53.524 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/udf/group.list 2024-05-15T12:11:53.536 INFO:teuthology.orchestra.run.smithi077.stdout:Building xfs 2024-05-15T12:11:53.542 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/xfs/group.list 2024-05-15T12:11:53.641 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-15T12:11:53.643 INFO:teuthology.orchestra.run.smithi077.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-15T12:11:53.643 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-15T12:11:53.645 INFO:teuthology.orchestra.run.smithi077.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-15T12:11:53.645 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-15T12:11:53.647 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-15T12:11:53.656 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-15T12:11:53.726 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-15T12:11:53.735 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-15T12:11:53.752 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2024-05-15T12:11:53.755 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2024-05-15T12:11:53.759 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2024-05-15T12:11:53.763 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2024-05-15T12:11:53.766 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C log-writes install 2024-05-15T12:11:53.767 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-15T12:11:53.776 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-15T12:11:53.785 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C perf install 2024-05-15T12:11:53.786 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-15T12:11:53.795 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-15T12:11:53.817 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-15T12:11:53.819 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-15T12:11:53.828 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-05-15T12:11:53.878 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake -C vfs install 2024-05-15T12:11:53.880 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-15T12:11:53.888 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-15T12:11:53.900 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-15T12:11:53.909 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-15T12:11:55.098 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-15T12:11:55.194 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-15T12:11:55.219 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-15T12:11:55.220 INFO:teuthology.orchestra.run.smithi077.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-15T12:11:55.220 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-15T12:11:55.222 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-15T12:11:55.230 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-15T12:11:55.364 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-15T12:11:55.366 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/btrfs/ install 2024-05-15T12:11:55.369 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/btrfs/group.list 2024-05-15T12:11:55.433 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-15T12:11:55.442 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 313 314 315 316 317 318 320 330 /var/lib/xfstests/tests/btrfs 2024-05-15T12:11:56.278 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-15T12:11:56.288 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 313.out 314.out 315.out 316.out 317.out 318.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-05-15T12:11:57.124 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ceph/ install 2024-05-15T12:11:57.126 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ceph/group.list 2024-05-15T12:11:57.140 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-15T12:11:57.149 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-15T12:11:57.168 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-15T12:11:57.176 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-05-15T12:11:57.195 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/cifs/ install 2024-05-15T12:11:57.198 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/cifs/group.list 2024-05-15T12:11:57.209 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-15T12:11:57.218 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-15T12:11:57.227 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-15T12:11:57.235 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-15T12:11:57.244 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ext4/ install 2024-05-15T12:11:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ext4/group.list 2024-05-15T12:11:57.285 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-15T12:11:57.294 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-15T12:11:57.475 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-15T12:11:57.484 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-05-15T12:11:57.676 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/f2fs/ install 2024-05-15T12:11:57.678 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/f2fs/group.list 2024-05-15T12:11:57.695 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-15T12:11:57.704 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-15T12:11:57.715 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-15T12:11:57.724 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-15T12:11:57.735 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/generic/ install 2024-05-15T12:11:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/generic/group.list 2024-05-15T12:11:57.840 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-15T12:11:57.849 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 744 /var/lib/xfstests/tests/generic 2024-05-15T12:11:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-15T12:11:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out 744.out /var/lib/xfstests/tests/generic 2024-05-15T12:12:01.771 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/nfs/ install 2024-05-15T12:12:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/nfs/group.list 2024-05-15T12:12:01.787 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-15T12:12:01.796 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-15T12:12:01.804 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-15T12:12:01.813 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-15T12:12:01.822 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ocfs2/ install 2024-05-15T12:12:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/ocfs2/group.list 2024-05-15T12:12:01.837 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-15T12:12:01.846 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-15T12:12:01.854 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-15T12:12:01.863 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-15T12:12:01.872 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/overlay/ install 2024-05-15T12:12:01.875 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/overlay/group.list 2024-05-15T12:12:01.916 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-15T12:12:01.925 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-15T12:12:02.200 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-15T12:12:02.208 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-05-15T12:12:02.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/perf/ install 2024-05-15T12:12:02.487 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/perf/group.list 2024-05-15T12:12:02.498 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-15T12:12:02.507 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-15T12:12:02.515 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-15T12:12:02.524 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-15T12:12:02.533 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/selftest/ install 2024-05-15T12:12:02.535 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/selftest/group.list 2024-05-15T12:12:02.548 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-15T12:12:02.557 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-15T12:12:02.578 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-15T12:12:02.586 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-05-15T12:12:02.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/shared/ install 2024-05-15T12:12:02.610 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/shared/group.list 2024-05-15T12:12:02.627 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-15T12:12:02.636 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-15T12:12:02.650 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-15T12:12:02.659 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-05-15T12:12:02.673 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/tmpfs/ install 2024-05-15T12:12:02.675 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/tmpfs/group.list 2024-05-15T12:12:02.689 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-15T12:12:02.697 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-15T12:12:02.706 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-15T12:12:02.715 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-15T12:12:02.723 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/udf/ install 2024-05-15T12:12:02.726 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/udf/group.list 2024-05-15T12:12:02.737 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-15T12:12:02.745 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-15T12:12:02.754 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-15T12:12:02.763 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-15T12:12:02.771 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.DmRtshrLxIxfstests-dev/tests/xfs/ install 2024-05-15T12:12:02.775 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.DmRtshrLxIxfstests-dev/tests/xfs/group.list 2024-05-15T12:12:02.876 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-15T12:12:02.884 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 612 613 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-15T12:12:04.720 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-15T12:12:04.729 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 612.out 613.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-05-15T12:12:06.589 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-15T12:12:06.597 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-15T12:12:06.606 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-15T12:12:06.615 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-15T12:12:06.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T12:12:06.626 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec ls tests/generic) 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:001 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:001.out 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:002 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:002.out 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:003 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:003.out 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:004 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:004.out 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:005 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:005.out 2024-05-15T12:12:06.683 INFO:teuthology.orchestra.run.smithi077.stdout:006 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:006.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:007 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:007.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:008 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:008.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:009 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:009.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:010 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:010.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:011 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:011.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:012 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:012.out 2024-05-15T12:12:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:013 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:013.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:014 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:014.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:015 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:015.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:016 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:016.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:017 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:017.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:018 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:018.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:019 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:019.out 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:020 2024-05-15T12:12:06.685 INFO:teuthology.orchestra.run.smithi077.stdout:020.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:021 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:021.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:022 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:022.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:023 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:023.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:024 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:024.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:025 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:025.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:026 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:026.out 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:027 2024-05-15T12:12:06.686 INFO:teuthology.orchestra.run.smithi077.stdout:027.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:028 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:028.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:029 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:029.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:030 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:030.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:031 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:031.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:032 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:032.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:033 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:033.out 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:034 2024-05-15T12:12:06.687 INFO:teuthology.orchestra.run.smithi077.stdout:034.out 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:035 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:035.cfg 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:035.out.default 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:035.out.nfs 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:036 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:036.out 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:037 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:037.out 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:038 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:038.out 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:039 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:039.out 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:040 2024-05-15T12:12:06.688 INFO:teuthology.orchestra.run.smithi077.stdout:040.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:041 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:041.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:042 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:042.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:043 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:043.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:044 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:044.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:045 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:045.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:046 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:046.out 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:047 2024-05-15T12:12:06.689 INFO:teuthology.orchestra.run.smithi077.stdout:047.out 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:048 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:048.out 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:049 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:049.out 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:050 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:050.cfg 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.default 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.nojournal 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.xfsquota 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:051 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:051.out 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:052 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:052.out 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:053 2024-05-15T12:12:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:053.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:054 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:054.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:055 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:055.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:056 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:056.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:057 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:057.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:058 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:058.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:059 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:059.out 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:060 2024-05-15T12:12:06.691 INFO:teuthology.orchestra.run.smithi077.stdout:060.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:061 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:061.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:062 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:062.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:063 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:063.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:064 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:064.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:065 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:065.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:066 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:066.out 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:067 2024-05-15T12:12:06.692 INFO:teuthology.orchestra.run.smithi077.stdout:067.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:068 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:068.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:069 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:069.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:070 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:070.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:071 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:071.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:072 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:072.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:073 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:073.out 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:074 2024-05-15T12:12:06.693 INFO:teuthology.orchestra.run.smithi077.stdout:074.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:075 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:075.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:076 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:076.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:077 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:077.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:078 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:078.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:079 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:079.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:080 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:080.out 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:081 2024-05-15T12:12:06.694 INFO:teuthology.orchestra.run.smithi077.stdout:081.out 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:082 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:082.out 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:083 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:083.out 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:084 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:084.out 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:085 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:085.out 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:086 2024-05-15T12:12:06.695 INFO:teuthology.orchestra.run.smithi077.stdout:086.out 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:087 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:087.out 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:088 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:088.out 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:089 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:089.out 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:090 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:090.out 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:091 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:091.out 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:092 2024-05-15T12:12:06.696 INFO:teuthology.orchestra.run.smithi077.stdout:092.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:093 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:093.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:094 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:094.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:095 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:095.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:096 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:096.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:097 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:097.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:098 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:098.out 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:099 2024-05-15T12:12:06.697 INFO:teuthology.orchestra.run.smithi077.stdout:099.out 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:100 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:100.out 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:101 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:101.out 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:102 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:102.out 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:103 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:103.out 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:104 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:104.out 2024-05-15T12:12:06.698 INFO:teuthology.orchestra.run.smithi077.stdout:105 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:105.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:106 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:106.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:107 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:107.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:108 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:108.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:109 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:109.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:110 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:110.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:111 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:111.out 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:112 2024-05-15T12:12:06.699 INFO:teuthology.orchestra.run.smithi077.stdout:112.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:113 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:113.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:114 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:114.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:115 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:115.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:116 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:116.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:117 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:117.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:118 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:118.out 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:119 2024-05-15T12:12:06.700 INFO:teuthology.orchestra.run.smithi077.stdout:119.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:120 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:120.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:121 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:121.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:122 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:122.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:123 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:123.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:124 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:124.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:125 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:125.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:126 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:126.out 2024-05-15T12:12:06.701 INFO:teuthology.orchestra.run.smithi077.stdout:127 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:127.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:128 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:128.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:129 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:129.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:130 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:130.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:131 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:131.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:132 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:132.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:133 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:133.out 2024-05-15T12:12:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:134 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:134.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:135 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:135.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:136 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:136.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:137 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:137.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:138 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:138.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:139 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:139.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:140 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:140.out 2024-05-15T12:12:06.703 INFO:teuthology.orchestra.run.smithi077.stdout:141 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:141.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:142 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:142.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:143 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:143.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:144 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:144.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:145 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:145.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:146 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:146.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:147 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:147.out 2024-05-15T12:12:06.704 INFO:teuthology.orchestra.run.smithi077.stdout:148 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:148.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:149 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:149.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:150 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:150.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:151 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:151.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:152 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:152.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:153 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:153.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:154 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:154.out 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:155 2024-05-15T12:12:06.705 INFO:teuthology.orchestra.run.smithi077.stdout:155.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:156 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:156.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:157 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:157.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:158 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:158.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:159 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:159.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:160 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:160.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:161 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:161.out 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:162 2024-05-15T12:12:06.706 INFO:teuthology.orchestra.run.smithi077.stdout:162.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:163 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:163.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:164 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:164.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:165 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:165.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:166 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:166.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:167 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:167.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:168 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:168.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:169 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:169.out 2024-05-15T12:12:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:170 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:170.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:171 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:171.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:172 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:172.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:173 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:173.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:174 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:174.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:175 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:175.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:176 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:176.out 2024-05-15T12:12:06.708 INFO:teuthology.orchestra.run.smithi077.stdout:177 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:177.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:178 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:178.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:179 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:179.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:180 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:180.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:181 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:181.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:182 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:182.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:183 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:183.out 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:184 2024-05-15T12:12:06.709 INFO:teuthology.orchestra.run.smithi077.stdout:184.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:185 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:185.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:186 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:186.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:187 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:187.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:188 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:188.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:189 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:189.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:190 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:190.out 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:191 2024-05-15T12:12:06.710 INFO:teuthology.orchestra.run.smithi077.stdout:191.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:192 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:192.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:193 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:193.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:194 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:194.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:195 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:195.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:196 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:196.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:197 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:197.out 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:198 2024-05-15T12:12:06.711 INFO:teuthology.orchestra.run.smithi077.stdout:198.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:199 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:199.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:200 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:200.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:201 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:201.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:202 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:202.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:203 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:203.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:204 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:204.out 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:205 2024-05-15T12:12:06.712 INFO:teuthology.orchestra.run.smithi077.stdout:205.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:206 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:206.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:207 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:207.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:208 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:208.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:209 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:209.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:210 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:210.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:211 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:211.out 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:212 2024-05-15T12:12:06.713 INFO:teuthology.orchestra.run.smithi077.stdout:212.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:213 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:213.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:214 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:214.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:215 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:215.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:216 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:216.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:217 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:217.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:218 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:218.out 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:219 2024-05-15T12:12:06.714 INFO:teuthology.orchestra.run.smithi077.stdout:219.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:220 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:220.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:221 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:221.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:222 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:222.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:223 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:223.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:224 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:224.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:225 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:225.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:226 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:226.out 2024-05-15T12:12:06.715 INFO:teuthology.orchestra.run.smithi077.stdout:227 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:227.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:228 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:228.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:229 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:229.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:230 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:230.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:231 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:231.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:232 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:232.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:233 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:233.out 2024-05-15T12:12:06.716 INFO:teuthology.orchestra.run.smithi077.stdout:234 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:234.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:235 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:235.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:236 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:236.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:237 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:237.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:238 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:238.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:239 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:239.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:240 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:240.out 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:241 2024-05-15T12:12:06.717 INFO:teuthology.orchestra.run.smithi077.stdout:241.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:242 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:242.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:243 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:243.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:244 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:244.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:245 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:245.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:246 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:246.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:247 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:247.out 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:248 2024-05-15T12:12:06.718 INFO:teuthology.orchestra.run.smithi077.stdout:248.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:249 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:249.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:250 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:250.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:251 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:251.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:252 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:252.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:253 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:253.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:254 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:254.out 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:255 2024-05-15T12:12:06.719 INFO:teuthology.orchestra.run.smithi077.stdout:255.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:256 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:256.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:257 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:257.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:258 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:258.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:259 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:259.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:260 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:260.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:261 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:261.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:262 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:262.out 2024-05-15T12:12:06.720 INFO:teuthology.orchestra.run.smithi077.stdout:263 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:263.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:264 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:264.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:265 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:265.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:266 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:266.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:267 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:267.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:268 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:268.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:269 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:269.out 2024-05-15T12:12:06.721 INFO:teuthology.orchestra.run.smithi077.stdout:270 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:270.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:271 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:271.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:272 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:272.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:273 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:273.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:274 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:274.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:275 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:275.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:276 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:276.out 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:277 2024-05-15T12:12:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:277.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:278 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:278.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:279 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:279.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:280 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:280.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:281 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:281.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:282 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:282.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:283 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:283.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:284 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:284.out 2024-05-15T12:12:06.723 INFO:teuthology.orchestra.run.smithi077.stdout:285 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:285.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:286 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:286.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:287 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:287.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:288 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:288.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:289 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:289.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:290 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:290.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:291 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:291.out 2024-05-15T12:12:06.724 INFO:teuthology.orchestra.run.smithi077.stdout:292 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:292.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:293 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:293.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:294 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:294.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:295 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:295.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:296 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:296.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:297 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:297.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:298 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:298.out 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:299 2024-05-15T12:12:06.725 INFO:teuthology.orchestra.run.smithi077.stdout:299.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:300 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:300.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:301 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:301.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:302 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:302.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:303 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:303.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:304 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:304.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:305 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:305.out 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:306 2024-05-15T12:12:06.726 INFO:teuthology.orchestra.run.smithi077.stdout:306.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:307 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:307.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:308 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:308.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:309 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:309.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:310 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:310.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:311 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:311.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:312 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:312.out 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:313 2024-05-15T12:12:06.727 INFO:teuthology.orchestra.run.smithi077.stdout:313.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:314 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:314.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:315 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:315.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:316 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:316.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:317 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:317.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:318 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:318.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:319 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:319.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:320 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:320.out 2024-05-15T12:12:06.728 INFO:teuthology.orchestra.run.smithi077.stdout:321 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:321.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:322 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:322.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:323 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:323.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:324 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:324.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:325 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:325.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:326 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:326.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:327 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:327.out 2024-05-15T12:12:06.729 INFO:teuthology.orchestra.run.smithi077.stdout:328 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:328.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:329 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:329.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:330 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:330.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:331 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:331.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:332 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:332.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:333 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:333.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:334 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:334.out 2024-05-15T12:12:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:335 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:335.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:336 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:336.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:337 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:337.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:338 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:338.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:339 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:339.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:340 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:340.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:341 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:341.out 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:342 2024-05-15T12:12:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:342.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:343 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:343.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:344 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:344.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:345 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:345.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:346 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:346.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:347 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:347.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:348 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:348.out 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:349 2024-05-15T12:12:06.732 INFO:teuthology.orchestra.run.smithi077.stdout:349.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:350 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:350.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:351 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:351.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:352 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:352.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:353 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:353.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:354 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:354.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:355 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:355.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:356 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:356.out 2024-05-15T12:12:06.733 INFO:teuthology.orchestra.run.smithi077.stdout:357 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:357.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:358 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:358.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:359 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:359.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:360 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:360.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:361 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:361.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:362 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:362.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:363 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:363.out 2024-05-15T12:12:06.734 INFO:teuthology.orchestra.run.smithi077.stdout:364 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:364.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:365 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:365.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:366 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:366.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:367 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:367.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:368 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:368.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:369 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:369.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:370 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:370.out 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:371 2024-05-15T12:12:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:371.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:372 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:372.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:373 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:373.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:374 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:374.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:375 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:375.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:376 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:376.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:377 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:377.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:378 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:378.out 2024-05-15T12:12:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:379 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:379.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:380 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:380.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:381 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:381.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:382 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:382.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:383 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:383.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:384 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:384.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:385 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:385.out 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:386 2024-05-15T12:12:06.737 INFO:teuthology.orchestra.run.smithi077.stdout:386.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:387 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:387.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:388 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:388.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:389 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:389.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:390 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:390.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:391 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:391.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:392 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:392.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:393 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:393.out 2024-05-15T12:12:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:394 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:394.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:395 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:395.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:396 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:396.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:397 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:397.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:398 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:398.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:399 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:399.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:400 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:400.out 2024-05-15T12:12:06.739 INFO:teuthology.orchestra.run.smithi077.stdout:401 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:401.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:402 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:402.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:403 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:403.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:404 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:404.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:405 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:405.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:406 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:406.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:407 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:407.out 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:408 2024-05-15T12:12:06.740 INFO:teuthology.orchestra.run.smithi077.stdout:408.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:409 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:409.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:410 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:410.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:411 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:411.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:412 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:412.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:413 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:413.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:414 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:414.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:415 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:415.out 2024-05-15T12:12:06.741 INFO:teuthology.orchestra.run.smithi077.stdout:416 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:416.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:417 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:417.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:418 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:418.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:419 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:419.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:420 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:420.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:421 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:421.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:422 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:422.out 2024-05-15T12:12:06.742 INFO:teuthology.orchestra.run.smithi077.stdout:423 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:423.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:424 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:424.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:425 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:425.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:426 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:426.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:427 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:427.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:428 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:428.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:429 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:429.out 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:430 2024-05-15T12:12:06.743 INFO:teuthology.orchestra.run.smithi077.stdout:430.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:431 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:431.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:432 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:432.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:433 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:433.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:434 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:434.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:435 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:435.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:436 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:436.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:437 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:437.out 2024-05-15T12:12:06.744 INFO:teuthology.orchestra.run.smithi077.stdout:438 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:438.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:439 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:439.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:440 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:440.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:441 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:441.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:442 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:442.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:443 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:443.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:444 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:444.out 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:445 2024-05-15T12:12:06.745 INFO:teuthology.orchestra.run.smithi077.stdout:445.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:446 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:446.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:447 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:447.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:448 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:448.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:449 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:449.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:450 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:450.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:451 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:451.out 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:452 2024-05-15T12:12:06.746 INFO:teuthology.orchestra.run.smithi077.stdout:452.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:453 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:453.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:454 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:454.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:455 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:455.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:456 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:456.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:457 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:457.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:458 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:458.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:459 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:459.out 2024-05-15T12:12:06.747 INFO:teuthology.orchestra.run.smithi077.stdout:460 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:460.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:461 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:461.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:462 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:462.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:463 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:463.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:464 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:464.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:465 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:465.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:466 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:466.out 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:467 2024-05-15T12:12:06.748 INFO:teuthology.orchestra.run.smithi077.stdout:467.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:468 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:468.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:469 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:469.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:470 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:470.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:471 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:471.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:472 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:472.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:473 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:473.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:474 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:474.out 2024-05-15T12:12:06.749 INFO:teuthology.orchestra.run.smithi077.stdout:475 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:475.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:476 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:476.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:477 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:477.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:478 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:478.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:479 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:479.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:480 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:480.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:481 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:481.out 2024-05-15T12:12:06.750 INFO:teuthology.orchestra.run.smithi077.stdout:482 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:482.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:483 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:483.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:484 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:484.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:485 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:485.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:486 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:486.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:487 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:487.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:488 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:488.out 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:489 2024-05-15T12:12:06.751 INFO:teuthology.orchestra.run.smithi077.stdout:489.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:490 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:490.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:491 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:491.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:492 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:492.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:493 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:493.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:494 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:494.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:495 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:495.out 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:496 2024-05-15T12:12:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:496.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:497 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:497.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:498 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:498.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:499 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:499.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:500 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:500.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:501 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:501.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:502 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:502.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:503 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:503.out 2024-05-15T12:12:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:504 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:504.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:505 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:505.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:506 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:506.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:507 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:507.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:508 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:508.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:509 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:509.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:510 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:510.out 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:511 2024-05-15T12:12:06.754 INFO:teuthology.orchestra.run.smithi077.stdout:511.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:512 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:512.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:513 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:513.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:514 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:514.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:515 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:515.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:516 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:516.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:517 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:517.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:518 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:518.out 2024-05-15T12:12:06.755 INFO:teuthology.orchestra.run.smithi077.stdout:519 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:519.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:520 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:520.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:521 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:521.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:522 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:522.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:523 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:523.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:524 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:524.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:525 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:525.out 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:526 2024-05-15T12:12:06.756 INFO:teuthology.orchestra.run.smithi077.stdout:526.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:527 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:527.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:528 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:528.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:529 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:529.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:530 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:530.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:531 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:531.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:532 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:532.out 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:533 2024-05-15T12:12:06.757 INFO:teuthology.orchestra.run.smithi077.stdout:533.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:534 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:534.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:535 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:535.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:536 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:536.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:537 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:537.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:538 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:538.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:539 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:539.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:540 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:540.out 2024-05-15T12:12:06.758 INFO:teuthology.orchestra.run.smithi077.stdout:541 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:541.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:542 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:542.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:543 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:543.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:544 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:544.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:545 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:545.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:546 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:546.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:547 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:547.out 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:548 2024-05-15T12:12:06.759 INFO:teuthology.orchestra.run.smithi077.stdout:548.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:549 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:549.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:550 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:550.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:551 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:551.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:552 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:552.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:553 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:553.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:554 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:554.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:555 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:555.out 2024-05-15T12:12:06.760 INFO:teuthology.orchestra.run.smithi077.stdout:556 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:556.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:557 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:557.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:558 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:558.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:559 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:559.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:560 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:560.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:561 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:561.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:562 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:562.out 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:563 2024-05-15T12:12:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:563.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:564 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:564.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:565 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:565.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:566 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:566.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:567 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:567.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:568 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:568.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:569 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:569.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:570 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:570.out 2024-05-15T12:12:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:571 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:571.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:572 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:572.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:573 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:573.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:574 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:574.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:575 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:575.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:576 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:576.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:577 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:577.out 2024-05-15T12:12:06.763 INFO:teuthology.orchestra.run.smithi077.stdout:578 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:578.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:579 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:579.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:580 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:580.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:581 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:581.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:582 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:582.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:583 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:583.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:584 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:584.out 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:585 2024-05-15T12:12:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:585.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:586 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:586.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:587 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:587.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:588 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:588.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:589 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:589.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:590 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:590.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:591 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:591.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:592 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:592.out 2024-05-15T12:12:06.765 INFO:teuthology.orchestra.run.smithi077.stdout:593 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:593.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:594 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:594.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:595 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:595.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:596 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:596.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:597 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:597.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:598 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:598.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:599 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:599.out 2024-05-15T12:12:06.766 INFO:teuthology.orchestra.run.smithi077.stdout:600 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:600.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:601 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:601.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:602 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:602.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:603 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:603.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:604 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:604.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:605 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:605.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:606 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:606.out 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:607 2024-05-15T12:12:06.767 INFO:teuthology.orchestra.run.smithi077.stdout:607.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:608 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:608.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:609 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:609.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:610 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:610.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:611 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:611.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:612 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:612.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:613 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:613.out 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:614 2024-05-15T12:12:06.768 INFO:teuthology.orchestra.run.smithi077.stdout:614.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:615 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:615.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:616 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:616.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:617 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:617.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:618 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:618.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:619 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:619.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:620 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:620.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:621 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:621.out 2024-05-15T12:12:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:622 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:622.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:623 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:623.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:624 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:624.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:625 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:625.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:626 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:626.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:627 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:627.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:628 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:628.out 2024-05-15T12:12:06.770 INFO:teuthology.orchestra.run.smithi077.stdout:629 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:629.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:630 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:630.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:631 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:631.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:632 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:632.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:633 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:633.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:634 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:634.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:635 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:635.out 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:636 2024-05-15T12:12:06.771 INFO:teuthology.orchestra.run.smithi077.stdout:636.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:637 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:637.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:638 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:638.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:639 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:639.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:640 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:640.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:641 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:641.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:642 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:642.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:643 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:643.out 2024-05-15T12:12:06.772 INFO:teuthology.orchestra.run.smithi077.stdout:644 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:644.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:645 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:645.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:646 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:646.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:647 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:647.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:648 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:648.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:649 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:649.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:650 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:650.out 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:651 2024-05-15T12:12:06.773 INFO:teuthology.orchestra.run.smithi077.stdout:651.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:652 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:652.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:653 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:653.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:654 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:654.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:655 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:655.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:656 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:656.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:657 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:657.out 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:658 2024-05-15T12:12:06.774 INFO:teuthology.orchestra.run.smithi077.stdout:658.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:659 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:659.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:660 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:660.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:661 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:661.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:662 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:662.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:663 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:663.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:664 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:664.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:665 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:665.out 2024-05-15T12:12:06.775 INFO:teuthology.orchestra.run.smithi077.stdout:666 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:666.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:667 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:667.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:668 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:668.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:669 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:669.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:670 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:670.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:671 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:671.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:672 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:672.out 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:673 2024-05-15T12:12:06.776 INFO:teuthology.orchestra.run.smithi077.stdout:673.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:674 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:674.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:675 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:675.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:676 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:676.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:677 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:677.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:678 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:678.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:679 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:679.out 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:680 2024-05-15T12:12:06.777 INFO:teuthology.orchestra.run.smithi077.stdout:680.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:681 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:681.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:682 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:682.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:683 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:683.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:684 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:684.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:685 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:685.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:686 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:686.out 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:687 2024-05-15T12:12:06.778 INFO:teuthology.orchestra.run.smithi077.stdout:687.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:688 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:688.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:689 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:689.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:690 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:690.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:691 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:691.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:692 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:692.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:693 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:693.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:694 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:694.out 2024-05-15T12:12:06.779 INFO:teuthology.orchestra.run.smithi077.stdout:695 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:695.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:696 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:696.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:697 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:697.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:698 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:698.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:699 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:699.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:700 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:700.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:701 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:701.out 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:702 2024-05-15T12:12:06.780 INFO:teuthology.orchestra.run.smithi077.stdout:702.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:703 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:703.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:704 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:704.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:705 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:705.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:706 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:706.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:707 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:707.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:708 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:708.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:709 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:709.out 2024-05-15T12:12:06.781 INFO:teuthology.orchestra.run.smithi077.stdout:710 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:710.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:711 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:711.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:712 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:712.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:713 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:713.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:714 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:714.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:715 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:715.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:716 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:716.out 2024-05-15T12:12:06.782 INFO:teuthology.orchestra.run.smithi077.stdout:717 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:717.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:718 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:718.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:719 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:719.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:720 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:720.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:721 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:721.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:722 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:722.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:723 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:723.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:724 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:724.out 2024-05-15T12:12:06.783 INFO:teuthology.orchestra.run.smithi077.stdout:725 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:725.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:726 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:726.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:727 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:727.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:728 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:728.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:729 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:729.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:730 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:730.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:731 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:731.out 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:732 2024-05-15T12:12:06.784 INFO:teuthology.orchestra.run.smithi077.stdout:732.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:733 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:733.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:734 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:734.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:735 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:735.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:736 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:736.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:737 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:737.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:738 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:738.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:739 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:739.out 2024-05-15T12:12:06.785 INFO:teuthology.orchestra.run.smithi077.stdout:741 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:741.out 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:742 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:742.out 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:743 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:743.out 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:744 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:744.out 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:group.list 2024-05-15T12:12:06.786 INFO:teuthology.orchestra.run.smithi077.stdout:Makefile 2024-05-15T12:12:06.787 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-05-15T12:12:06.991 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:06.995 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:06.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:09.028 INFO:teuthology.orchestra.run.smithi077.stdout:generic/001 2s 2024-05-15T12:12:09.033 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/001 2024-05-15T12:12:09.033 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:12:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:09.037 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[48767]: fuse finished with error 0 and tester_r 0 2024-05-15T12:12:09.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:12:09.045 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-05-15T12:12:09.225 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:09.229 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:09.614 INFO:teuthology.orchestra.run.smithi077.stdout:generic/002 0s 2024-05-15T12:12:09.619 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/002 2024-05-15T12:12:09.619 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:12:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:09.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:12:09.631 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-05-15T12:12:09.849 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:09.853 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:09.980 INFO:teuthology.orchestra.run.smithi077.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:12:09.984 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/003 2024-05-15T12:12:09.984 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/003 2024-05-15T12:12:09.984 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:12:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:09.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:12:09.995 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-05-15T12:12:10.168 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:10.172 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:10.302 INFO:teuthology.orchestra.run.smithi077.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-05-15T12:12:10.306 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/004 2024-05-15T12:12:10.306 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/004 2024-05-15T12:12:10.306 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:12:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:10.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:12:10.318 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-05-15T12:12:10.489 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:10.493 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:10.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:10.969 INFO:teuthology.orchestra.run.smithi077.stdout:generic/005 0s 2024-05-15T12:12:10.975 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/005 2024-05-15T12:12:10.975 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:12:10.977 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:10.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:12:10.986 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-05-15T12:12:11.185 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:11.189 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:11.190 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:14.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:12:14.481 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:12:44.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:12:44.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:12:44.902 INFO:teuthology.orchestra.run.smithi077.stdout:generic/006 33s 2024-05-15T12:12:44.980 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/006 2024-05-15T12:12:44.981 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:12:44.983 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:12:44.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:12:44.993 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-05-15T12:12:45.192 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:12:45.196 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:12:45.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:14.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:13:14.924 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:13:45.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:13:45.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:13:55.501 INFO:teuthology.orchestra.run.smithi077.stdout:generic/007 70s 2024-05-15T12:13:55.649 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/007 2024-05-15T12:13:55.649 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:13:55.652 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:55.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:13:55.663 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-05-15T12:13:55.871 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:13:55.875 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:13:55.875 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:56.738 INFO:teuthology.orchestra.run.smithi077.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-15T12:13:56.741 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/008 2024-05-15T12:13:56.741 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/008 2024-05-15T12:13:56.741 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:13:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:56.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:13:56.753 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-05-15T12:13:56.922 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:13:56.926 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:13:56.927 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:57.724 INFO:teuthology.orchestra.run.smithi077.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-15T12:13:57.728 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/009 2024-05-15T12:13:57.728 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/009 2024-05-15T12:13:57.728 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:13:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:57.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:13:57.740 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-05-15T12:13:57.912 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:13:57.916 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:13:57.916 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:58.536 INFO:teuthology.orchestra.run.smithi077.stdout:generic/010 1s 2024-05-15T12:13:58.603 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/010 2024-05-15T12:13:58.603 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:13:58.605 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:13:58.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:13:58.633 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-05-15T12:13:58.817 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:13:58.821 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:13:58.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:14:15.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:14:15.389 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:14:35.993 INFO:teuthology.orchestra.run.smithi077.stdout:generic/011 37s 2024-05-15T12:14:36.051 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/011 2024-05-15T12:14:36.051 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:14:36.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:14:36.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:14:36.063 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-05-15T12:14:36.268 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:14:36.272 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:14:36.272 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:14:37.167 INFO:teuthology.orchestra.run.smithi077.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:14:37.170 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/012 2024-05-15T12:14:37.171 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/012 2024-05-15T12:14:37.171 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:14:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:14:37.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:14:37.201 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-05-15T12:14:37.396 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:14:37.400 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:14:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:14:45.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:14:45.539 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:15:15.961 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:15:15.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:15:46.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:15:46.675 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:15:46.744 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T12:15:46.751+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 113120) UID: 0 2024-05-15T12:15:46.744 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T12:15:46.751+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 113120) UID: 0 2024-05-15T12:16:10.963 INFO:teuthology.orchestra.run.smithi077.stdout:generic/013 93s 2024-05-15T12:16:11.028 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/013 2024-05-15T12:16:11.028 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:11.031 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:11.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:11.045 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-05-15T12:16:11.338 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:11.345 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:11.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:11.930 INFO:teuthology.orchestra.run.smithi077.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-05-15T12:16:11.935 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/014 2024-05-15T12:16:11.935 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/014 2024-05-15T12:16:11.935 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:11.939 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:11.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:11.954 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-05-15T12:16:12.238 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:12.244 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:12.244 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:12.432 INFO:teuthology.orchestra.run.smithi077.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:12.437 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/015 2024-05-15T12:16:12.437 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/015 2024-05-15T12:16:12.437 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:12.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:12.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:12.458 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-05-15T12:16:12.732 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:12.741 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:12.741 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:14.288 INFO:teuthology.orchestra.run.smithi077.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:16:14.293 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/016 2024-05-15T12:16:14.294 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/016 2024-05-15T12:16:14.294 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:14.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:14.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:14.312 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-05-15T12:16:14.644 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:14.650 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:14.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:14.838 INFO:teuthology.orchestra.run.smithi077.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:14.842 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/017 2024-05-15T12:16:14.842 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/017 2024-05-15T12:16:14.843 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:14.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:14.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:14.860 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-05-15T12:16:15.136 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:15.141 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:15.141 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:15.331 INFO:teuthology.orchestra.run.smithi077.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:15.338 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/018 2024-05-15T12:16:15.339 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/018 2024-05-15T12:16:15.339 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:15.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:15.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:15.356 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-05-15T12:16:15.638 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:15.645 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:15.645 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:15.828 INFO:teuthology.orchestra.run.smithi077.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:15.833 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/019 2024-05-15T12:16:15.833 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/019 2024-05-15T12:16:15.833 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:15.836 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:15.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:15.849 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-05-15T12:16:16.126 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:16.132 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:16.132 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:generic/020 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/020.out.bad) 2024-05-15T12:16:26.952 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/020.out 2024-05-15 12:10:37.798389455 +0000 2024-05-15T12:16:26.952 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/020.out.bad 2024-05-15 12:16:26.955666082 +0000 2024-05-15T12:16:26.952 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -47,9 +47,13 @@ 2024-05-15T12:16:26.952 INFO:teuthology.orchestra.run.smithi077.stdout: user.snrub="fish2\012" 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: *** really long value 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: -0000000 00 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: -* 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: -ATTRSIZE 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_set: No space left on device 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not set "long_attr" for 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_get: No data available 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not get "long_attr" for 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +0000000 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_remove: No data available 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not remove "long_attr" for 2024-05-15T12:16:26.953 INFO:teuthology.orchestra.run.smithi077.stdout: *** set/get/remove really long names (expect failure) 2024-05-15T12:16:26.954 INFO:teuthology.orchestra.run.smithi077.stdout: attr_set: Invalid argument 2024-05-15T12:16:26.954 INFO:teuthology.orchestra.run.smithi077.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-05-15T12:16:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/020 2024-05-15T12:16:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/020 2024-05-15T12:16:26.956 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T12:16:26.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:26.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T12:16:26.988 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T12:16:26.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T12:16:26.988 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-05-15T12:16:27.314 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:28.770 INFO:teuthology.orchestra.run.smithi077.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:16:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/021 2024-05-15T12:16:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/021 2024-05-15T12:16:28.775 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:28.779 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:28.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:28.791 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-05-15T12:16:29.138 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:29.143 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:30.588 INFO:teuthology.orchestra.run.smithi077.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:16:30.593 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/022 2024-05-15T12:16:30.593 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/022 2024-05-15T12:16:30.593 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:30.596 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:30.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:30.610 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-05-15T12:16:30.951 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:30.957 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:30.957 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:32.796 INFO:teuthology.orchestra.run.smithi077.stdout:generic/023 2s 2024-05-15T12:16:32.804 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/023 2024-05-15T12:16:32.804 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:32.807 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:32.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:32.820 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-05-15T12:16:33.167 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:33.173 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:33.404 INFO:teuthology.orchestra.run.smithi077.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-05-15T12:16:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/024 2024-05-15T12:16:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/024 2024-05-15T12:16:33.410 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:33.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:33.442 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-05-15T12:16:33.757 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:33.762 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:33.762 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:33.999 INFO:teuthology.orchestra.run.smithi077.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-05-15T12:16:34.006 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/025 2024-05-15T12:16:34.006 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/025 2024-05-15T12:16:34.006 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:34.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:34.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:34.024 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-05-15T12:16:34.368 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:34.375 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:34.375 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:34.621 INFO:teuthology.orchestra.run.smithi077.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T12:16:34.626 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/026 2024-05-15T12:16:34.626 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/026 2024-05-15T12:16:34.626 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:34.630 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:34.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:34.643 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-05-15T12:16:34.918 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:34.924 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:34.924 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:35.109 INFO:teuthology.orchestra.run.smithi077.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:35.114 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/027 2024-05-15T12:16:35.115 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/027 2024-05-15T12:16:35.115 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:35.118 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:35.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:35.132 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-05-15T12:16:35.412 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:35.418 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:35.419 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:40.640 INFO:teuthology.orchestra.run.smithi077.stdout:generic/028 5s 2024-05-15T12:16:40.651 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/028 2024-05-15T12:16:40.651 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:40.655 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:40.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:40.671 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-05-15T12:16:40.960 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:40.966 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:41.156 INFO:teuthology.orchestra.run.smithi077.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:41.162 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/029 2024-05-15T12:16:41.162 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/029 2024-05-15T12:16:41.162 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:41.165 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:41.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:41.179 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-05-15T12:16:41.451 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:41.462 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:41.462 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:41.639 INFO:teuthology.orchestra.run.smithi077.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:41.643 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/030 2024-05-15T12:16:41.643 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/030 2024-05-15T12:16:41.643 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:41.647 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:41.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:41.660 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-05-15T12:16:41.947 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:41.952 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:41.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:42.136 INFO:teuthology.orchestra.run.smithi077.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:42.141 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/031 2024-05-15T12:16:42.141 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/031 2024-05-15T12:16:42.141 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:42.145 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:42.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:42.159 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-05-15T12:16:42.446 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:42.452 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:42.453 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:42.637 INFO:teuthology.orchestra.run.smithi077.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:42.643 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/032 2024-05-15T12:16:42.643 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/032 2024-05-15T12:16:42.643 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:42.647 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:42.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:42.661 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-05-15T12:16:42.945 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:42.952 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:42.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:43.134 INFO:teuthology.orchestra.run.smithi077.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:43.140 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/033 2024-05-15T12:16:43.140 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/033 2024-05-15T12:16:43.140 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:43.144 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:43.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:43.158 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-05-15T12:16:43.433 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:43.440 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:43.636 INFO:teuthology.orchestra.run.smithi077.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:43.641 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/034 2024-05-15T12:16:43.641 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/034 2024-05-15T12:16:43.641 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:43.644 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:43.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:43.656 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-05-15T12:16:43.931 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:43.936 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:44.227 INFO:teuthology.orchestra.run.smithi077.stdout:generic/035 1s 2024-05-15T12:16:44.234 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/035 2024-05-15T12:16:44.234 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:44.238 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:44.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:44.256 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-05-15T12:16:44.609 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:44.615 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:44.616 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:54.942 INFO:teuthology.orchestra.run.smithi077.stdout:generic/036 10s 2024-05-15T12:16:55.006 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/036 2024-05-15T12:16:55.006 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:55.006 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:55.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:55.024 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-05-15T12:16:55.369 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:55.377 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:55.377 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:55.560 INFO:teuthology.orchestra.run.smithi077.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:55.564 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/037 2024-05-15T12:16:55.566 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/037 2024-05-15T12:16:55.566 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:55.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:55.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:55.581 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-05-15T12:16:55.866 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:55.872 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:55.872 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:56.052 INFO:teuthology.orchestra.run.smithi077.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:56.059 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/038 2024-05-15T12:16:56.059 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/038 2024-05-15T12:16:56.060 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:56.063 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:56.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:56.076 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-05-15T12:16:56.368 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:56.373 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:56.373 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:56.577 INFO:teuthology.orchestra.run.smithi077.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:56.582 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/039 2024-05-15T12:16:56.582 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/039 2024-05-15T12:16:56.582 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:56.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:56.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:56.601 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-05-15T12:16:56.877 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:56.883 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:56.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:57.088 INFO:teuthology.orchestra.run.smithi077.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:57.093 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/040 2024-05-15T12:16:57.094 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/040 2024-05-15T12:16:57.094 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:57.097 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:57.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:57.114 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-05-15T12:16:57.398 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:57.403 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:57.403 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:57.603 INFO:teuthology.orchestra.run.smithi077.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:57.611 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/041 2024-05-15T12:16:57.611 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/041 2024-05-15T12:16:57.611 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:57.614 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:57.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:57.629 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-05-15T12:16:57.918 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:57.924 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:57.924 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:58.115 INFO:teuthology.orchestra.run.smithi077.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:58.120 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/042 2024-05-15T12:16:58.120 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/042 2024-05-15T12:16:58.121 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:58.125 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:58.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:58.139 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-05-15T12:16:58.436 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:58.440 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:58.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:58.634 INFO:teuthology.orchestra.run.smithi077.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:58.639 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/043 2024-05-15T12:16:58.639 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/043 2024-05-15T12:16:58.639 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:58.642 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:58.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:58.657 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-05-15T12:16:58.938 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:58.945 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:58.945 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:59.131 INFO:teuthology.orchestra.run.smithi077.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:59.136 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/044 2024-05-15T12:16:59.137 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/044 2024-05-15T12:16:59.137 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:59.139 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:59.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:59.157 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-05-15T12:16:59.434 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:59.441 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:59.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:59.633 INFO:teuthology.orchestra.run.smithi077.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:16:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/045 2024-05-15T12:16:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/045 2024-05-15T12:16:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:16:59.641 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:16:59.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:16:59.654 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-05-15T12:16:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:16:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:16:59.950 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:00.138 INFO:teuthology.orchestra.run.smithi077.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:00.143 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/046 2024-05-15T12:17:00.143 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/046 2024-05-15T12:17:00.143 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:00.147 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:00.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:00.160 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-05-15T12:17:00.446 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:00.451 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:00.451 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:00.640 INFO:teuthology.orchestra.run.smithi077.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/047 2024-05-15T12:17:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/047 2024-05-15T12:17:00.645 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:00.649 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:00.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:00.665 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-05-15T12:17:00.951 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:00.958 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:00.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:01.145 INFO:teuthology.orchestra.run.smithi077.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:01.150 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/048 2024-05-15T12:17:01.150 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/048 2024-05-15T12:17:01.150 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:01.154 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:01.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:01.169 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-05-15T12:17:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:01.447 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:01.634 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/049 2024-05-15T12:17:01.635 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/049 2024-05-15T12:17:01.635 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:01.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:01.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:01.652 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-05-15T12:17:01.935 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:01.942 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:01.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:02.137 INFO:teuthology.orchestra.run.smithi077.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:02.141 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/050 2024-05-15T12:17:02.142 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/050 2024-05-15T12:17:02.142 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:02.145 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:02.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:02.161 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-05-15T12:17:02.440 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:02.450 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:02.625 INFO:teuthology.orchestra.run.smithi077.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:02.630 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/051 2024-05-15T12:17:02.630 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/051 2024-05-15T12:17:02.630 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:02.635 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:02.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:02.648 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-05-15T12:17:02.918 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:02.925 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:02.925 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:03.116 INFO:teuthology.orchestra.run.smithi077.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:03.121 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/052 2024-05-15T12:17:03.121 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/052 2024-05-15T12:17:03.121 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:03.124 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:03.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:03.139 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-05-15T12:17:03.404 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:03.409 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:03.409 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:03.606 INFO:teuthology.orchestra.run.smithi077.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:03.612 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/053 2024-05-15T12:17:03.612 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/053 2024-05-15T12:17:03.612 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:03.615 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:03.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:03.631 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-05-15T12:17:03.910 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:03.915 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:03.916 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:04.098 INFO:teuthology.orchestra.run.smithi077.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:04.103 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/054 2024-05-15T12:17:04.103 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/054 2024-05-15T12:17:04.103 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:04.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:04.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:04.115 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-05-15T12:17:04.378 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:04.385 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:04.385 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:04.591 INFO:teuthology.orchestra.run.smithi077.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/055 2024-05-15T12:17:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/055 2024-05-15T12:17:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:04.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:04.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:04.613 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-05-15T12:17:04.891 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:04.897 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:04.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:05.103 INFO:teuthology.orchestra.run.smithi077.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:05.108 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/056 2024-05-15T12:17:05.108 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/056 2024-05-15T12:17:05.108 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:05.112 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:05.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:05.124 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-05-15T12:17:05.415 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:05.422 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:05.422 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:05.627 INFO:teuthology.orchestra.run.smithi077.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:05.632 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/057 2024-05-15T12:17:05.632 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/057 2024-05-15T12:17:05.632 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:05.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:05.652 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-05-15T12:17:05.946 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:05.952 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:05.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:07.397 INFO:teuthology.orchestra.run.smithi077.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:17:07.402 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/058 2024-05-15T12:17:07.402 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/058 2024-05-15T12:17:07.403 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:07.407 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:07.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:07.425 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-05-15T12:17:07.782 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:07.788 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:07.788 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:07.993 INFO:teuthology.orchestra.run.smithi077.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:07.998 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/059 2024-05-15T12:17:07.998 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/059 2024-05-15T12:17:07.998 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:08.003 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:08.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:08.016 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-05-15T12:17:08.301 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:08.308 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:08.308 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:09.758 INFO:teuthology.orchestra.run.smithi077.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:17:09.765 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/060 2024-05-15T12:17:09.765 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/060 2024-05-15T12:17:09.765 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:09.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:09.784 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-05-15T12:17:10.150 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:10.156 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:11.586 INFO:teuthology.orchestra.run.smithi077.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:17:11.590 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/061 2024-05-15T12:17:11.591 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/061 2024-05-15T12:17:11.591 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:11.594 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:11.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:11.611 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-05-15T12:17:11.953 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:11.960 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:11.960 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:12.145 INFO:teuthology.orchestra.run.smithi077.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:12.149 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/062 2024-05-15T12:17:12.149 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/062 2024-05-15T12:17:12.149 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:12.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:12.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:12.166 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-05-15T12:17:12.446 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:12.453 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:12.453 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:13.885 INFO:teuthology.orchestra.run.smithi077.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T12:17:13.890 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/063 2024-05-15T12:17:13.890 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/063 2024-05-15T12:17:13.890 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:13.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:13.908 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-05-15T12:17:14.268 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:14.274 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:14.461 INFO:teuthology.orchestra.run.smithi077.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:14.467 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/064 2024-05-15T12:17:14.467 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/064 2024-05-15T12:17:14.468 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:14.472 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:14.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:14.487 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-05-15T12:17:14.766 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:14.772 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:14.982 INFO:teuthology.orchestra.run.smithi077.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:14.989 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/065 2024-05-15T12:17:14.990 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/065 2024-05-15T12:17:14.990 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:14.994 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:15.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:15.008 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-05-15T12:17:15.288 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:15.297 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:15.297 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:15.503 INFO:teuthology.orchestra.run.smithi077.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:15.508 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/066 2024-05-15T12:17:15.508 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/066 2024-05-15T12:17:15.508 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:15.512 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:15.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:15.528 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-05-15T12:17:15.803 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:15.809 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:15.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:16.030 INFO:teuthology.orchestra.run.smithi077.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:16.036 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/067 2024-05-15T12:17:16.036 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/067 2024-05-15T12:17:16.036 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:16.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:16.055 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-05-15T12:17:16.331 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:16.337 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:16.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:16.532 INFO:teuthology.orchestra.run.smithi077.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:16.537 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/068 2024-05-15T12:17:16.537 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/068 2024-05-15T12:17:16.538 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:16.541 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:16.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:16.556 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-05-15T12:17:16.844 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:16.850 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:16.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:17.032 INFO:teuthology.orchestra.run.smithi077.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:17:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/069 2024-05-15T12:17:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/069 2024-05-15T12:17:17.038 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:17:17.041 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:17:17.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:17:17.056 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-05-15T12:17:17.335 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:17:17.340 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:17:17.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:52.223 INFO:teuthology.orchestra.run.smithi077.stdout:generic/070 95s 2024-05-15T12:18:52.229 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/070 2024-05-15T12:18:52.229 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:18:52.233 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:52.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:18:52.247 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-05-15T12:18:52.622 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:18:52.626 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:18:52.627 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:52.789 INFO:teuthology.orchestra.run.smithi077.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:18:52.793 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/071 2024-05-15T12:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/071 2024-05-15T12:18:52.794 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:18:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:52.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:18:52.809 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-05-15T12:18:53.063 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:18:53.069 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:18:53.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:53.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:18:53.674 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:18:54.341 INFO:teuthology.orchestra.run.smithi077.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-15T12:18:54.347 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/072 2024-05-15T12:18:54.347 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/072 2024-05-15T12:18:54.347 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:18:54.351 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:54.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:18:54.363 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-05-15T12:18:54.613 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:18:54.619 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:18:54.619 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:54.802 INFO:teuthology.orchestra.run.smithi077.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:18:54.807 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/073 2024-05-15T12:18:54.807 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/073 2024-05-15T12:18:54.807 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:18:54.810 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:18:54.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:18:54.823 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-05-15T12:18:55.090 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:18:55.095 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:18:55.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:19:23.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:19:23.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:19:53.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:19:53.831 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:20:24.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:20:24.265 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:20:54.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:20:54.335 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:21:24.498 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:21:24.502 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:21:54.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:21:54.802 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:22:24.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:22:24.941 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:22:55.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:22:55.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:23:25.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:23:25.261 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:23:39.357 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:23:39.364+0000 7fc26c9ba640 -1 bdev(0x56211dd6ae00 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-05-15T12:23:39.357 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:23:39.364+0000 7fc26e9be640 -1 bdev(0x56211dd6ae00 /var/lib/ceph/osd/ceph-2/block) aio_submit retries 1 2024-05-15T12:23:55.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:23:55.370 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:24:25.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:24:25.558 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:24:55.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:24:55.933 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:25:26.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:25:26.154 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:25:56.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:25:56.239 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:26:26.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:26:26.352 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:26:56.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:26:56.664 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:27:26.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:27:26.966 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:27:57.027 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:27:57.031 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:28:27.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:28:27.184 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:28:57.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:28:57.516 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:29:27.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:29:27.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:29:58.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:29:58.091 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:30:28.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:30:28.225 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:30:58.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:30:58.532 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:31:28.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:31:28.837 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:31:58.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:31:58.993 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:32:29.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:32:29.075 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:32:59.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:32:59.223 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:33:29.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:33:29.330 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:33:59.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:33:59.486 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:34:29.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:34:29.574 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:34:59.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:34:59.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:35:29.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:35:29.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:36:00.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:36:00.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:36:30.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:36:30.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:37:00.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:37:00.299 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:37:30.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:37:30.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:38:00.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:38:00.508 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:38:30.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:38:30.616 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:39:00.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:39:00.748 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:39:30.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:39:30.900 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:40:01.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:40:01.031 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:40:31.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:40:31.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:41:01.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:41:01.374 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:41:31.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:41:31.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:42:01.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:42:01.848 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:42:31.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:42:31.929 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:43:01.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:43:02.002 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:43:32.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:43:32.249 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:44:02.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:44:02.326 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:44:32.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:44:32.444 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:45:02.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:45:02.891 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:45:32.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:45:32.974 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:46:03.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:46:03.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:46:33.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:46:33.465 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:46:52.198 INFO:teuthology.orchestra.run.smithi077.stdout:generic/074 1677s 2024-05-15T12:46:52.211 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/074 2024-05-15T12:46:52.211 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:46:52.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:46:52.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:46:52.228 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-05-15T12:46:52.703 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:46:52.707 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:46:52.708 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:03.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:47:03.524 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:47:28.017 INFO:teuthology.orchestra.run.smithi077.stdout:generic/075 36s 2024-05-15T12:47:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/075 2024-05-15T12:47:28.022 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:28.024 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:28.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:28.051 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-05-15T12:47:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:28.432 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:28.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:28.554 INFO:teuthology.orchestra.run.smithi077.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/076 2024-05-15T12:47:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/076 2024-05-15T12:47:28.557 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:28.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:28.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-05-15T12:47:28.744 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:28.748 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:28.748 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:29.555 INFO:teuthology.orchestra.run.smithi077.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/077 2024-05-15T12:47:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/077 2024-05-15T12:47:29.559 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:29.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:29.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:29.571 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-05-15T12:47:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:29.749 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:29.749 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-05-15T12:47:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/078 2024-05-15T12:47:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/078 2024-05-15T12:47:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:29.912 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:29.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:29.941 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-05-15T12:47:30.348 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:30.521 INFO:teuthology.orchestra.run.smithi077.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-05-15T12:47:30.525 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/079 2024-05-15T12:47:30.525 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/079 2024-05-15T12:47:30.525 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:30.527 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:30.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:30.537 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-05-15T12:47:30.716 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:30.720 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:30.720 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:32.901 INFO:teuthology.orchestra.run.smithi077.stdout:generic/080 2s 2024-05-15T12:47:32.908 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/080 2024-05-15T12:47:32.908 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:32.910 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:32.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:32.921 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-05-15T12:47:33.099 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:33.103 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:33.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:33.226 INFO:teuthology.orchestra.run.smithi077.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:33.230 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/081 2024-05-15T12:47:33.230 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/081 2024-05-15T12:47:33.230 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:33.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:33.241 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-05-15T12:47:33.420 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:33.424 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:33.551 INFO:teuthology.orchestra.run.smithi077.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:33.557 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/082 2024-05-15T12:47:33.557 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/082 2024-05-15T12:47:33.558 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:33.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:33.566 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-05-15T12:47:33.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:47:33.611 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:47:33.752 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:33.756 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:33.756 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:33.884 INFO:teuthology.orchestra.run.smithi077.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:33.888 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/083 2024-05-15T12:47:33.888 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/083 2024-05-15T12:47:33.888 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:33.890 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:33.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:33.899 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-05-15T12:47:34.081 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:34.085 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:34.085 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:34.206 INFO:teuthology.orchestra.run.smithi077.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:34.210 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/084 2024-05-15T12:47:34.210 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/084 2024-05-15T12:47:34.210 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:34.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:34.232 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-05-15T12:47:34.412 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:34.416 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:34.416 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:34.572 INFO:teuthology.orchestra.run.smithi077.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T12:47:34.578 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/085 2024-05-15T12:47:34.578 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/085 2024-05-15T12:47:34.578 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:34.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:34.586 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-05-15T12:47:34.758 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:34.763 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:34.763 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:40.106 INFO:teuthology.orchestra.run.smithi077.stdout:generic/086 6s 2024-05-15T12:47:40.175 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/086 2024-05-15T12:47:40.175 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:40.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:40.343 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-05-15T12:47:41.345 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:41.354 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:41.354 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:41.762 INFO:teuthology.orchestra.run.smithi077.stdout:generic/087 0s 2024-05-15T12:47:41.767 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/087 2024-05-15T12:47:41.767 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:41.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:41.779 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-05-15T12:47:42.218 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:42.222 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:42.222 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:42.391 INFO:teuthology.orchestra.run.smithi077.stdout:generic/088 0s 2024-05-15T12:47:42.396 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/088 2024-05-15T12:47:42.396 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T12:47:42.398 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:47:42.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T12:47:42.408 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-05-15T12:47:42.819 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T12:47:42.823 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T12:47:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T12:48:03.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:48:03.753 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:48:33.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:48:33.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:49:04.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:49:04.256 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:49:34.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:49:34.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:50:04.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:50:04.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:50:34.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:50:34.816 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:50:34.932 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T12:50:34.942+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 152557) UID: 0 2024-05-15T12:50:34.973 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T12:50:34.942+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 152557) UID: 0 2024-05-15T12:53:11.405 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T12:53:11.414+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152770) UID: 0 2024-05-15T12:53:11.406 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T12:53:11.414+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152770) UID: 0 2024-05-15T12:53:11.407 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T12:53:11.414+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152770) UID: 0 2024-05-15T12:53:11.407 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T12:53:11.414+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152770) UID: 0 2024-05-15T12:57:40.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:57:40.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T12:57:40.668 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T12:57:40.678+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 154802) UID: 0 2024-05-15T12:57:40.668 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T12:57:40.678+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 154802) UID: 0 2024-05-15T13:01:27.834 INFO:teuthology.orchestra.run.smithi077.stdout:generic/089 825s 2024-05-15T13:01:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/089 2024-05-15T13:01:27.869 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:01:27.875 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:01:27.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:01:27.881 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-05-15T13:01:28.394 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:01:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:01:28.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:01:28.719 INFO:teuthology.orchestra.run.smithi077.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:01:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/090 2024-05-15T13:01:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/090 2024-05-15T13:01:28.722 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:01:28.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:01:28.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:01:28.734 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-05-15T13:01:28.916 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:01:28.920 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:01:28.920 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:25.570 INFO:teuthology.orchestra.run.smithi077.stdout:generic/091 117s 2024-05-15T13:03:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/091 2024-05-15T13:03:25.574 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:25.576 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:25.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:25.587 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-05-15T13:03:26.063 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:26.067 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:26.067 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:26.260 INFO:teuthology.orchestra.run.smithi077.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T13:03:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/092 2024-05-15T13:03:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/092 2024-05-15T13:03:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:26.267 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:26.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:26.276 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-05-15T13:03:26.776 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:26.780 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:26.780 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:28.359 INFO:teuthology.orchestra.run.smithi077.stdout:generic/093 2s 2024-05-15T13:03:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/093 2024-05-15T13:03:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:28.367 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:28.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:28.377 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-05-15T13:03:28.863 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:28.867 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:28.867 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:28.990 INFO:teuthology.orchestra.run.smithi077.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:03:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/094 2024-05-15T13:03:28.993 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/094 2024-05-15T13:03:28.994 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:28.996 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:29.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:29.007 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-05-15T13:03:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:29.195 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:29.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:29.323 INFO:teuthology.orchestra.run.smithi077.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:03:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/095 2024-05-15T13:03:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/095 2024-05-15T13:03:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:29.329 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:29.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:29.338 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-05-15T13:03:29.524 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:03:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/096 2024-05-15T13:03:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/096 2024-05-15T13:03:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:29.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:29.669 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-05-15T13:03:29.853 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:29.858 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:30.537 INFO:teuthology.orchestra.run.smithi077.stdout:generic/097 1s 2024-05-15T13:03:30.543 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/097 2024-05-15T13:03:30.543 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:30.545 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:30.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:30.554 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-05-15T13:03:30.728 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:30.732 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:30.732 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:03:30.857 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/098 2024-05-15T13:03:30.857 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/098 2024-05-15T13:03:30.857 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:30.859 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:30.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:30.869 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-15T13:03:31.050 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:31.055 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:31.272 INFO:teuthology.orchestra.run.smithi077.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T13:03:31.276 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/099 2024-05-15T13:03:31.276 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/099 2024-05-15T13:03:31.276 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:31.278 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:31.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:31.299 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-05-15T13:03:31.479 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:31.483 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:31.483 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:59.532 INFO:teuthology.orchestra.run.smithi077.stdout:generic/100 28s 2024-05-15T13:03:59.536 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/100 2024-05-15T13:03:59.536 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:03:59.538 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:03:59.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:03:59.556 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-05-15T13:03:59.879 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:03:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:03:59.891 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:00.229 INFO:teuthology.orchestra.run.smithi077.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:00.233 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/101 2024-05-15T13:04:00.233 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/101 2024-05-15T13:04:00.233 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:00.238 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:00.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:00.245 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-05-15T13:04:00.430 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:00.435 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:00.435 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:00.560 INFO:teuthology.orchestra.run.smithi077.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:00.564 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/102 2024-05-15T13:04:00.564 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/102 2024-05-15T13:04:00.564 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:00.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:00.575 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-05-15T13:04:00.758 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:00.762 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:00.906 INFO:teuthology.orchestra.run.smithi077.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:00.910 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/103 2024-05-15T13:04:00.910 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/103 2024-05-15T13:04:00.910 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:00.912 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:00.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:00.922 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-05-15T13:04:01.104 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:01.109 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:01.244 INFO:teuthology.orchestra.run.smithi077.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:01.248 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/104 2024-05-15T13:04:01.248 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/104 2024-05-15T13:04:01.248 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:01.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:01.260 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-05-15T13:04:01.440 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:01.445 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:01.445 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:01.573 INFO:teuthology.orchestra.run.smithi077.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:01.576 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/105 2024-05-15T13:04:01.577 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/105 2024-05-15T13:04:01.577 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:01.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:01.588 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-05-15T13:04:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:01.772 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:01.915 INFO:teuthology.orchestra.run.smithi077.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:01.919 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/106 2024-05-15T13:04:01.919 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/106 2024-05-15T13:04:01.919 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:01.921 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:01.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:01.930 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-05-15T13:04:02.113 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:02.118 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:02.118 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:02.258 INFO:teuthology.orchestra.run.smithi077.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:02.262 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/107 2024-05-15T13:04:02.262 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/107 2024-05-15T13:04:02.262 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:02.264 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:02.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:02.273 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-05-15T13:04:02.454 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:02.458 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:02.459 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:02.879 INFO:teuthology.orchestra.run.smithi077.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:02.883 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/108 2024-05-15T13:04:02.883 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/108 2024-05-15T13:04:02.883 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:02.885 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:02.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:02.910 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-05-15T13:04:03.106 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:03.107 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:03.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:03.241 INFO:teuthology.orchestra.run.smithi077.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:04:03.244 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/109 2024-05-15T13:04:03.244 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/109 2024-05-15T13:04:03.245 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:03.247 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:03.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:03.257 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-05-15T13:04:03.432 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:03.436 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:03.436 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:04.038 INFO:teuthology.orchestra.run.smithi077.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:04:04.042 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/110 2024-05-15T13:04:04.042 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/110 2024-05-15T13:04:04.042 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:04.045 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:04.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:04.055 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-05-15T13:04:04.489 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:04.494 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:04.494 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:04.658 INFO:teuthology.orchestra.run.smithi077.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:04:04.662 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/111 2024-05-15T13:04:04.662 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/111 2024-05-15T13:04:04.662 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:04.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:04.673 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-05-15T13:04:05.097 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:05.101 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:05.101 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:45.369 INFO:teuthology.orchestra.run.smithi077.stdout:generic/112 40s 2024-05-15T13:04:45.374 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/112 2024-05-15T13:04:45.374 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:04:45.376 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:45.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:04:45.387 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-05-15T13:04:45.798 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:04:45.802 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:04:45.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:04:50.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:04:50.830 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:04:50.891 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T13:04:50.902+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 179653) UID: 0 2024-05-15T13:04:50.892 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T13:04:50.902+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 179653) UID: 0 2024-05-15T13:04:50.958 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T13:04:50.969+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45675) UID: 0 2024-05-15T13:04:50.959 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T13:04:50.969+0000 7fc8edfdb640 -1 received signal: Hangup from (PID: 45675) UID: 0 2024-05-15T13:04:50.962 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T13:04:50.973+0000 7f719cffc640 -1 Fail to open '/proc/45675/cmdline' error = (2) No such file or directory 2024-05-15T13:04:50.962 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T13:04:50.973+0000 7f719cffc640 -1 received signal: Hangup from (PID: 45675) UID: 0 2024-05-15T13:04:50.964 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T13:04:50.974+0000 7fba5b258640 -1 Fail to open '/proc/45675/cmdline' error = (2) No such file or directory 2024-05-15T13:04:50.964 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T13:04:50.974+0000 7fba5b258640 -1 received signal: Hangup from (PID: 45675) UID: 0 2024-05-15T13:05:26.296 INFO:teuthology.orchestra.run.smithi077.stdout:generic/113 41s 2024-05-15T13:05:26.311 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/113 2024-05-15T13:05:26.312 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:26.314 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:26.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:26.353 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-05-15T13:05:26.797 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:26.801 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:26.801 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-05-15T13:05:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/114 2024-05-15T13:05:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/114 2024-05-15T13:05:26.999 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:27.001 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:27.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:27.010 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-05-15T13:05:27.185 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:27.189 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:27.189 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:28.108 INFO:teuthology.orchestra.run.smithi077.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:05:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/115 2024-05-15T13:05:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/115 2024-05-15T13:05:28.113 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:28.115 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:28.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:28.125 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-05-15T13:05:28.572 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:28.576 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:29.008 INFO:teuthology.orchestra.run.smithi077.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:05:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/116 2024-05-15T13:05:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/116 2024-05-15T13:05:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:29.014 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:29.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:29.023 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-05-15T13:05:29.482 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:29.486 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:05:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/117 2024-05-15T13:05:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/117 2024-05-15T13:05:29.841 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:29.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:29.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:29.852 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-05-15T13:05:30.027 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:30.031 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:30.031 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:30.314 INFO:teuthology.orchestra.run.smithi077.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:05:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/118 2024-05-15T13:05:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/118 2024-05-15T13:05:30.318 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:30.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:30.329 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-05-15T13:05:30.798 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:30.802 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:30.802 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:30.971 INFO:teuthology.orchestra.run.smithi077.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:05:30.975 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/119 2024-05-15T13:05:30.975 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/119 2024-05-15T13:05:30.975 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:30.977 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:30.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:30.986 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-05-15T13:05:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:31.426 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:31.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:31.548 INFO:teuthology.orchestra.run.smithi077.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:05:31.552 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/120 2024-05-15T13:05:31.552 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/120 2024-05-15T13:05:31.552 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:31.554 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:31.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:31.563 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-05-15T13:05:31.751 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:31.755 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:31.755 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:31.922 INFO:teuthology.orchestra.run.smithi077.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:05:31.926 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/121 2024-05-15T13:05:31.926 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/121 2024-05-15T13:05:31.926 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:31.929 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:31.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:31.937 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-05-15T13:05:32.396 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:32.400 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:32.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:32.586 INFO:teuthology.orchestra.run.smithi077.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:05:32.590 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/122 2024-05-15T13:05:32.590 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/122 2024-05-15T13:05:32.590 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:32.592 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:32.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:32.601 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-05-15T13:05:33.057 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:33.061 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:33.062 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:34.462 INFO:teuthology.orchestra.run.smithi077.stdout:generic/123 1s 2024-05-15T13:05:34.468 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/123 2024-05-15T13:05:34.468 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:34.470 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:34.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:34.479 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-05-15T13:05:34.926 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:34.932 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:34.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:35.065 INFO:teuthology.orchestra.run.smithi077.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:05:35.069 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/124 2024-05-15T13:05:35.069 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/124 2024-05-15T13:05:35.069 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:05:35.071 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:05:35.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:05:35.090 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-05-15T13:05:35.265 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:05:35.269 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:05:35.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:06:36.663 INFO:teuthology.orchestra.run.smithi077.stdout:generic/125 61s 2024-05-15T13:06:36.668 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/125 2024-05-15T13:06:36.668 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:06:36.670 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:06:36.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:06:36.694 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-05-15T13:06:37.134 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:06:37.138 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:06:37.138 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:06:37.692 INFO:teuthology.orchestra.run.smithi077.stdout:generic/126 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/126.out.bad) 2024-05-15T13:06:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/126.out 2024-05-15 12:10:37.804389340 +0000 2024-05-15T13:06:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/126.out.bad 2024-05-15 13:06:37.700048918 +0000 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,7 +1,7 @@ 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 126 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-05-15T13:06:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-05-15T13:06:37.696 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/126 2024-05-15T13:06:37.696 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/126 2024-05-15T13:06:37.696 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:06:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:06:37.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:06:37.707 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:06:37.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:06:37.707 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-05-15T13:06:38.192 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:06:38.196 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:06:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:06:47.926 INFO:teuthology.orchestra.run.smithi083.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-05-15T13:06:47.926 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: stdin: file size changed while zipping 2024-05-15T13:07:48.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:07:48.235 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:08:18.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:08:18.362 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:08:48.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:08:48.435 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:09:18.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:09:18.557 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:09:48.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:09:48.813 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:10:18.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:10:18.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:10:49.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:10:49.009 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:11:19.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:11:19.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:11:49.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:11:49.214 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:11:49.242 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T13:11:49.250+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45846) UID: 0 2024-05-15T13:11:49.242 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T13:11:49.250+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45846) UID: 0 2024-05-15T13:11:49.243 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T13:11:49.250+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45846) UID: 0 2024-05-15T13:11:49.243 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T13:11:49.250+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45846) UID: 0 2024-05-15T13:14:17.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:14:17.395 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:14:47.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:14:47.526 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:15:17.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:15:17.639 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:15:47.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:15:47.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:16:17.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:16:17.882 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:16:47.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:16:47.940 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:17:18.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:17:18.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:17:48.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:17:48.382 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:18:18.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:18:18.434 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:18:48.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:18:48.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:18:48.921 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T13:18:48.923+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 186601) UID: 0 2024-05-15T13:18:48.921 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T13:18:48.923+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 186601) UID: 0 2024-05-15T13:18:48.922 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T13:18:48.923+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 186601) UID: 0 2024-05-15T13:18:48.922 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T13:18:48.923+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 186601) UID: 0 2024-05-15T13:19:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:generic/127 742s 2024-05-15T13:19:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/127 2024-05-15T13:19:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:19:00.094 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:00.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:19:00.104 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-05-15T13:19:00.565 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:19:00.570 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:19:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:00.695 INFO:teuthology.orchestra.run.smithi077.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:19:00.699 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/128 2024-05-15T13:19:00.699 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/128 2024-05-15T13:19:00.699 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:19:00.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:00.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:19:00.711 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-05-15T13:19:00.889 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:19:00.893 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:19:00.893 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:01.023 INFO:teuthology.orchestra.run.smithi077.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:19:01.027 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/129 2024-05-15T13:19:01.027 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/129 2024-05-15T13:19:01.028 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:19:01.030 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:01.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:19:01.039 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-05-15T13:19:01.218 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:19:01.222 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:19:01.222 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:01.343 INFO:teuthology.orchestra.run.smithi077.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:19:01.347 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/130 2024-05-15T13:19:01.347 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/130 2024-05-15T13:19:01.347 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:19:01.349 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:01.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:19:01.359 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-05-15T13:19:01.537 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:19:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:19:01.541 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:02.863 INFO:teuthology.orchestra.run.smithi077.stdout:generic/131 1s 2024-05-15T13:19:02.869 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/131 2024-05-15T13:19:02.869 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:19:02.871 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:02.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:19:02.881 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-05-15T13:19:03.363 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:19:03.367 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:19:03.367 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:03.499 INFO:teuthology.orchestra.run.smithi077.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:19:03.503 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/132 2024-05-15T13:19:03.503 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/132 2024-05-15T13:19:03.503 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:19:03.505 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:19:03.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:19:03.515 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-05-15T13:19:03.697 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:19:03.701 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:19:03.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:21:18.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:21:18.715 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:21:48.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:21:48.843 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:22:19.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:22:19.075 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:22:40.436 INFO:teuthology.orchestra.run.smithi077.stdout:generic/133 217s 2024-05-15T13:22:40.441 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/133 2024-05-15T13:22:40.442 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:40.444 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:40.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:40.454 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-05-15T13:22:40.876 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:40.880 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:40.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:41.140 INFO:teuthology.orchestra.run.smithi077.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:41.144 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/134 2024-05-15T13:22:41.144 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/134 2024-05-15T13:22:41.144 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:41.146 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:41.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:41.155 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-05-15T13:22:41.575 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:41.579 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:41.737 INFO:teuthology.orchestra.run.smithi077.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:41.741 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/135 2024-05-15T13:22:41.742 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/135 2024-05-15T13:22:41.742 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:41.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:41.752 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-05-15T13:22:41.934 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:41.938 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:41.939 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:42.107 INFO:teuthology.orchestra.run.smithi077.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:42.111 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/136 2024-05-15T13:22:42.111 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/136 2024-05-15T13:22:42.111 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:42.113 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:42.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:42.122 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-05-15T13:22:42.538 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:42.543 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:42.543 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:42.706 INFO:teuthology.orchestra.run.smithi077.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:42.710 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/137 2024-05-15T13:22:42.710 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/137 2024-05-15T13:22:42.710 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:42.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:42.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:42.721 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-05-15T13:22:43.151 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:43.155 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:43.155 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:43.323 INFO:teuthology.orchestra.run.smithi077.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:43.326 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/138 2024-05-15T13:22:43.327 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/138 2024-05-15T13:22:43.327 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:43.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:43.338 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-05-15T13:22:43.765 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:43.769 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:43.926 INFO:teuthology.orchestra.run.smithi077.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:43.930 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/139 2024-05-15T13:22:43.930 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/139 2024-05-15T13:22:43.930 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:43.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:43.942 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-05-15T13:22:44.375 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:44.379 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:44.380 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:44.549 INFO:teuthology.orchestra.run.smithi077.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:44.553 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/140 2024-05-15T13:22:44.553 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/140 2024-05-15T13:22:44.553 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:44.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:44.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:44.564 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-05-15T13:22:44.979 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:44.984 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:44.984 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:45.109 INFO:teuthology.orchestra.run.smithi077.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:45.113 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/141 2024-05-15T13:22:45.113 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/141 2024-05-15T13:22:45.113 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:45.115 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:45.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:45.125 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-05-15T13:22:45.299 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:45.303 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:45.478 INFO:teuthology.orchestra.run.smithi077.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:45.482 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/142 2024-05-15T13:22:45.482 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/142 2024-05-15T13:22:45.482 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:45.484 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:45.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:45.493 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-05-15T13:22:45.911 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:45.915 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:45.916 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:46.084 INFO:teuthology.orchestra.run.smithi077.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:46.088 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/143 2024-05-15T13:22:46.088 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/143 2024-05-15T13:22:46.088 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:46.090 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:46.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:46.099 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-05-15T13:22:46.503 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:46.507 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:46.692 INFO:teuthology.orchestra.run.smithi077.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:46.695 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/144 2024-05-15T13:22:46.696 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/144 2024-05-15T13:22:46.696 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:46.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:46.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:46.707 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-05-15T13:22:47.129 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:47.133 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:47.299 INFO:teuthology.orchestra.run.smithi077.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:47.302 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/145 2024-05-15T13:22:47.302 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/145 2024-05-15T13:22:47.302 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:47.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:47.335 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-05-15T13:22:47.735 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:47.739 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:47.739 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:47.908 INFO:teuthology.orchestra.run.smithi077.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:47.911 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/146 2024-05-15T13:22:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/146 2024-05-15T13:22:47.912 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:47.914 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:47.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:47.946 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-05-15T13:22:48.347 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:48.351 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:48.352 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:48.521 INFO:teuthology.orchestra.run.smithi077.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:48.525 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/147 2024-05-15T13:22:48.525 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/147 2024-05-15T13:22:48.525 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:48.527 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:48.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:48.537 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-05-15T13:22:48.967 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:48.971 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:48.972 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:49.133 INFO:teuthology.orchestra.run.smithi077.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:49.137 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/148 2024-05-15T13:22:49.137 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/148 2024-05-15T13:22:49.137 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:49.139 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:49.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:49.149 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-05-15T13:22:49.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:22:49.194 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:22:49.576 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:49.580 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:49.580 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:49.740 INFO:teuthology.orchestra.run.smithi077.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:49.744 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/149 2024-05-15T13:22:49.744 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/149 2024-05-15T13:22:49.744 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:49.746 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:49.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:49.755 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-05-15T13:22:50.168 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:50.172 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:50.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:50.342 INFO:teuthology.orchestra.run.smithi077.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:50.346 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/150 2024-05-15T13:22:50.346 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/150 2024-05-15T13:22:50.346 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:50.348 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:50.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:50.358 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-05-15T13:22:50.770 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:50.775 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:50.775 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:50.940 INFO:teuthology.orchestra.run.smithi077.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:50.944 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/151 2024-05-15T13:22:50.944 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/151 2024-05-15T13:22:50.944 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:50.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:51.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:51.007 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-05-15T13:22:51.383 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:51.387 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:51.387 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:51.547 INFO:teuthology.orchestra.run.smithi077.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:51.551 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/152 2024-05-15T13:22:51.551 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/152 2024-05-15T13:22:51.551 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:51.553 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:51.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:51.563 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-05-15T13:22:51.985 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:51.990 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:51.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:52.152 INFO:teuthology.orchestra.run.smithi077.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:52.155 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/153 2024-05-15T13:22:52.156 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/153 2024-05-15T13:22:52.156 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:52.158 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:52.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:52.168 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-05-15T13:22:52.590 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:52.594 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:52.762 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/154 2024-05-15T13:22:52.762 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/154 2024-05-15T13:22:52.762 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:52.764 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:52.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:52.774 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-05-15T13:22:53.187 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:53.191 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:53.191 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:53.349 INFO:teuthology.orchestra.run.smithi077.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:53.353 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/155 2024-05-15T13:22:53.353 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/155 2024-05-15T13:22:53.353 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:53.355 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:53.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:53.365 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-05-15T13:22:53.774 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:53.778 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:53.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:53.950 INFO:teuthology.orchestra.run.smithi077.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:53.953 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/156 2024-05-15T13:22:53.953 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/156 2024-05-15T13:22:53.954 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:53.956 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:54.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:54.004 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-05-15T13:22:54.401 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:54.405 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:54.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:54.572 INFO:teuthology.orchestra.run.smithi077.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/157 2024-05-15T13:22:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/157 2024-05-15T13:22:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:54.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:54.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:54.587 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-05-15T13:22:55.012 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:55.017 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:55.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:55.194 INFO:teuthology.orchestra.run.smithi077.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:22:55.198 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/158 2024-05-15T13:22:55.198 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/158 2024-05-15T13:22:55.198 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:55.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:55.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:55.210 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-05-15T13:22:55.624 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:55.628 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:55.628 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:55.818 INFO:teuthology.orchestra.run.smithi077.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-05-15T13:22:55.822 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/159 2024-05-15T13:22:55.822 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/159 2024-05-15T13:22:55.822 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:55.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:55.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:55.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-05-15T13:22:56.011 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:56.015 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:56.015 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:56.191 INFO:teuthology.orchestra.run.smithi077.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-05-15T13:22:56.194 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/160 2024-05-15T13:22:56.195 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/160 2024-05-15T13:22:56.195 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:56.197 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:56.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:56.207 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-05-15T13:22:56.382 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:56.386 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:56.386 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:56.517 INFO:teuthology.orchestra.run.smithi077.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:56.521 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/161 2024-05-15T13:22:56.521 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/161 2024-05-15T13:22:56.521 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:56.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:56.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:56.532 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-05-15T13:22:56.712 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:56.716 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:56.716 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:56.839 INFO:teuthology.orchestra.run.smithi077.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:56.843 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/162 2024-05-15T13:22:56.843 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/162 2024-05-15T13:22:56.843 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:56.845 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:56.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:56.854 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-05-15T13:22:57.032 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:57.036 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:57.177 INFO:teuthology.orchestra.run.smithi077.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:57.181 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/163 2024-05-15T13:22:57.181 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/163 2024-05-15T13:22:57.181 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:57.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:57.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:57.193 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-05-15T13:22:57.365 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:57.369 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:57.369 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:57.489 INFO:teuthology.orchestra.run.smithi077.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:57.492 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/164 2024-05-15T13:22:57.492 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/164 2024-05-15T13:22:57.492 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:57.495 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:57.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:57.512 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-05-15T13:22:57.691 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:57.695 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:57.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:57.818 INFO:teuthology.orchestra.run.smithi077.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:57.822 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/165 2024-05-15T13:22:57.822 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/165 2024-05-15T13:22:57.822 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:57.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:57.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:57.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-05-15T13:22:58.008 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:58.012 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:58.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:58.152 INFO:teuthology.orchestra.run.smithi077.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:58.155 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/166 2024-05-15T13:22:58.156 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/166 2024-05-15T13:22:58.156 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:58.158 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:58.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:58.167 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-05-15T13:22:58.357 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:58.361 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:58.361 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:58.493 INFO:teuthology.orchestra.run.smithi077.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:58.497 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/167 2024-05-15T13:22:58.497 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/167 2024-05-15T13:22:58.497 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:58.499 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:58.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:58.508 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-05-15T13:22:58.689 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:58.693 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:58.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:58.825 INFO:teuthology.orchestra.run.smithi077.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:58.829 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/168 2024-05-15T13:22:58.829 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/168 2024-05-15T13:22:58.829 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:58.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:58.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:58.840 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-05-15T13:22:59.022 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:59.026 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:59.026 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:59.141 INFO:teuthology.orchestra.run.smithi077.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:59.145 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/169 2024-05-15T13:22:59.145 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/169 2024-05-15T13:22:59.145 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:59.147 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:59.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:59.158 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-05-15T13:22:59.332 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:59.336 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:59.336 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:59.454 INFO:teuthology.orchestra.run.smithi077.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:59.458 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/170 2024-05-15T13:22:59.458 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/170 2024-05-15T13:22:59.458 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:59.460 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:59.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:59.469 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-05-15T13:22:59.645 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:59.649 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:22:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/171 2024-05-15T13:22:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/171 2024-05-15T13:22:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:22:59.798 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:22:59.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:22:59.807 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-05-15T13:22:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:22:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:22:59.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:00.123 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/172 2024-05-15T13:23:00.123 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/172 2024-05-15T13:23:00.123 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:00.125 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:00.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:00.135 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-05-15T13:23:00.315 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:00.319 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:00.449 INFO:teuthology.orchestra.run.smithi077.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:00.453 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/173 2024-05-15T13:23:00.453 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/173 2024-05-15T13:23:00.453 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:00.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:00.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:00.464 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-05-15T13:23:00.638 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:00.642 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:00.643 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:00.770 INFO:teuthology.orchestra.run.smithi077.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:00.774 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/174 2024-05-15T13:23:00.774 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/174 2024-05-15T13:23:00.774 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:00.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:00.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-05-15T13:23:00.964 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:00.968 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:00.968 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:01.088 INFO:teuthology.orchestra.run.smithi077.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:01.092 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/175 2024-05-15T13:23:01.092 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/175 2024-05-15T13:23:01.092 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:01.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:01.115 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-05-15T13:23:01.301 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:01.305 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:01.429 INFO:teuthology.orchestra.run.smithi077.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/176 2024-05-15T13:23:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/176 2024-05-15T13:23:01.432 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:01.435 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:01.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:01.444 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-05-15T13:23:01.629 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:01.633 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:01.776 INFO:teuthology.orchestra.run.smithi077.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/177 2024-05-15T13:23:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/177 2024-05-15T13:23:01.779 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:01.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:01.791 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-05-15T13:23:01.978 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:01.983 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:01.983 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:02.172 INFO:teuthology.orchestra.run.smithi077.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:23:02.176 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/178 2024-05-15T13:23:02.176 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/178 2024-05-15T13:23:02.176 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:02.178 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:02.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:02.188 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-05-15T13:23:02.601 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:02.605 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:02.606 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:02.771 INFO:teuthology.orchestra.run.smithi077.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:23:02.775 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/179 2024-05-15T13:23:02.775 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/179 2024-05-15T13:23:02.775 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:02.777 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:02.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:02.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-05-15T13:23:03.209 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:03.213 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:03.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:03.379 INFO:teuthology.orchestra.run.smithi077.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:23:03.383 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/180 2024-05-15T13:23:03.383 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/180 2024-05-15T13:23:03.383 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:03.385 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:03.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:03.395 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-05-15T13:23:03.818 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:03.822 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:03.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:03.985 INFO:teuthology.orchestra.run.smithi077.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:23:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/181 2024-05-15T13:23:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/181 2024-05-15T13:23:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:03.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:04.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:04.000 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-05-15T13:23:04.425 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:04.429 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:04.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:04.593 INFO:teuthology.orchestra.run.smithi077.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:23:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/182 2024-05-15T13:23:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/182 2024-05-15T13:23:04.597 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:04.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:04.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:04.609 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-05-15T13:23:05.033 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:05.037 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:05.037 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:05.157 INFO:teuthology.orchestra.run.smithi077.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:05.161 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/183 2024-05-15T13:23:05.161 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/183 2024-05-15T13:23:05.161 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:05.163 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:05.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:05.185 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-05-15T13:23:05.362 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:05.367 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:05.532 INFO:teuthology.orchestra.run.smithi077.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/184.out.bad) 2024-05-15T13:23:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/184.out 2024-05-15 12:10:37.807389282 +0000 2024-05-15T13:23:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/184.out.bad 2024-05-15 13:23:05.531777483 +0000 2024-05-15T13:23:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1 +1,2 @@ 2024-05-15T13:23:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 184 2024-05-15T13:23:05.534 INFO:teuthology.orchestra.run.smithi077.stdout: +/tmp/tmp.DmRtshrLxIxfstests-dev/tests/generic/184: line 23: /tmp/tmp.BgAiu3pKHAtest/null: Permission denied 2024-05-15T13:23:05.536 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/184 2024-05-15T13:23:05.537 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/184 2024-05-15T13:23:05.537 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:23:05.539 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:05.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:23:05.547 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:23:05.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:23:05.548 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-05-15T13:23:05.725 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:05.729 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:05.847 INFO:teuthology.orchestra.run.smithi077.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:05.851 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/185 2024-05-15T13:23:05.851 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/185 2024-05-15T13:23:05.851 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:05.853 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:05.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:05.862 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-05-15T13:23:06.051 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:06.055 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:06.056 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:06.185 INFO:teuthology.orchestra.run.smithi077.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:06.188 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/186 2024-05-15T13:23:06.188 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/186 2024-05-15T13:23:06.189 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:06.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:06.200 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-05-15T13:23:06.379 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:06.384 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:06.384 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:06.508 INFO:teuthology.orchestra.run.smithi077.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:06.512 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/187 2024-05-15T13:23:06.512 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/187 2024-05-15T13:23:06.512 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:06.515 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:06.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:06.524 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-05-15T13:23:06.702 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:06.707 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:06.707 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:06.834 INFO:teuthology.orchestra.run.smithi077.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:06.838 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/188 2024-05-15T13:23:06.838 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/188 2024-05-15T13:23:06.838 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:06.840 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:06.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:06.849 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-05-15T13:23:07.032 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:07.036 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:07.036 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:07.160 INFO:teuthology.orchestra.run.smithi077.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:07.164 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/189 2024-05-15T13:23:07.164 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/189 2024-05-15T13:23:07.164 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:07.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:07.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:07.176 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-05-15T13:23:07.352 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:07.356 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:07.356 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:07.483 INFO:teuthology.orchestra.run.smithi077.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:07.486 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/190 2024-05-15T13:23:07.486 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/190 2024-05-15T13:23:07.486 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:07.489 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:07.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:07.498 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-05-15T13:23:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:07.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:07.802 INFO:teuthology.orchestra.run.smithi077.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:07.805 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/191 2024-05-15T13:23:07.805 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/191 2024-05-15T13:23:07.805 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:07.808 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:07.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:07.816 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-05-15T13:23:07.997 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:08.001 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:08.001 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:08.129 INFO:teuthology.orchestra.run.smithi077.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-05-15T13:23:08.133 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/192 2024-05-15T13:23:08.133 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/192 2024-05-15T13:23:08.133 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:08.136 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:08.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:08.145 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-05-15T13:23:08.330 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:08.334 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:08.334 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:09.385 INFO:teuthology.orchestra.run.smithi077.stdout:generic/193 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/193.out.bad) 2024-05-15T13:23:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/193.out 2024-05-15 12:10:37.808389263 +0000 2024-05-15T13:23:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/193.out.bad 2024-05-15 13:23:09.384701891 +0000 2024-05-15T13:23:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -24,7 +24,6 @@ 2024-05-15T13:23:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-05-15T13:23:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: user: chmod a+r on root owned file (should fail) 2024-05-15T13:23:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-05-15T13:23:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: check that the sgid bit is cleared 2024-05-15T13:23:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: -rw-rw-rw- 2024-05-15T13:23:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: check that suid bit is not cleared 2024-05-15T13:23:09.389 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/193 2024-05-15T13:23:09.390 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/193 2024-05-15T13:23:09.390 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:23:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:09.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:23:09.402 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:23:09.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:23:09.402 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-05-15T13:23:09.838 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:09.842 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:09.984 INFO:teuthology.orchestra.run.smithi077.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:09.988 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/194 2024-05-15T13:23:09.988 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/194 2024-05-15T13:23:09.988 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:10.004 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-05-15T13:23:10.186 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:10.190 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.311 INFO:teuthology.orchestra.run.smithi077.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:10.314 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/195 2024-05-15T13:23:10.315 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/195 2024-05-15T13:23:10.315 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:10.326 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-05-15T13:23:10.504 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:10.508 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:10.508 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.636 INFO:teuthology.orchestra.run.smithi077.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:10.639 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/196 2024-05-15T13:23:10.639 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/196 2024-05-15T13:23:10.639 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:10.642 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:10.651 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-05-15T13:23:10.829 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:10.833 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:10.833 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.955 INFO:teuthology.orchestra.run.smithi077.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:10.959 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/197 2024-05-15T13:23:10.959 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/197 2024-05-15T13:23:10.959 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:10.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:10.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:10.970 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-05-15T13:23:11.147 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:11.151 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:11.955 INFO:teuthology.orchestra.run.smithi077.stdout:generic/198 0s 2024-05-15T13:23:11.960 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/198 2024-05-15T13:23:11.960 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:11.963 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:11.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:11.972 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-05-15T13:23:12.428 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:12.433 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:12.434 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:12.585 INFO:teuthology.orchestra.run.smithi077.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:12.589 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/199 2024-05-15T13:23:12.589 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/199 2024-05-15T13:23:12.589 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:12.591 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:12.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:12.601 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-05-15T13:23:12.778 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:12.782 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:12.782 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:12.900 INFO:teuthology.orchestra.run.smithi077.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:12.903 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/200 2024-05-15T13:23:12.903 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/200 2024-05-15T13:23:12.904 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:12.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:12.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:12.915 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-05-15T13:23:13.104 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:13.108 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:13.108 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:13.235 INFO:teuthology.orchestra.run.smithi077.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:13.239 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/201 2024-05-15T13:23:13.239 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/201 2024-05-15T13:23:13.239 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:13.241 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:13.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:13.250 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-05-15T13:23:13.436 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:13.440 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:13.564 INFO:teuthology.orchestra.run.smithi077.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:13.567 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/202 2024-05-15T13:23:13.567 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/202 2024-05-15T13:23:13.567 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:13.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:13.578 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-05-15T13:23:13.760 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:13.764 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:13.894 INFO:teuthology.orchestra.run.smithi077.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:13.897 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/203 2024-05-15T13:23:13.897 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/203 2024-05-15T13:23:13.897 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:13.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:13.909 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-05-15T13:23:14.092 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:14.096 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:14.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:15.858 INFO:teuthology.orchestra.run.smithi077.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:15.862 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/204 2024-05-15T13:23:15.862 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/204 2024-05-15T13:23:15.862 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:15.865 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:15.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:15.888 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-05-15T13:23:16.071 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:16.075 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:16.219 INFO:teuthology.orchestra.run.smithi077.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:16.222 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/205 2024-05-15T13:23:16.222 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/205 2024-05-15T13:23:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:16.224 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:16.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:16.234 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-05-15T13:23:16.424 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:16.428 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:16.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:16.556 INFO:teuthology.orchestra.run.smithi077.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:23:16.559 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/206 2024-05-15T13:23:16.559 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/206 2024-05-15T13:23:16.559 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:16.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:16.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:16.570 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-05-15T13:23:16.752 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:16.757 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:16.757 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:19.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:23:19.270 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:23:33.286 INFO:teuthology.orchestra.run.smithi077.stdout:generic/207 17s 2024-05-15T13:23:33.291 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/207 2024-05-15T13:23:33.291 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:23:33.294 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:33.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:23:33.303 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-05-15T13:23:33.737 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:23:33.741 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:23:33.741 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:23:49.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:23:49.392 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:24:19.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:24:19.681 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:24:49.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:24:49.756 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:25:20.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:25:20.086 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:25:50.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:25:50.601 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:26:20.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:26:20.666 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:26:50.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:26:50.788 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:26:54.060 INFO:teuthology.orchestra.run.smithi077.stdout:generic/208 200s 2024-05-15T13:26:54.065 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/208 2024-05-15T13:26:54.066 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:26:54.068 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:26:54.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:26:54.078 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-05-15T13:26:54.516 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:26:54.520 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:26:54.520 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:04.626 INFO:teuthology.orchestra.run.smithi077.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/209.out.bad) 2024-05-15T13:27:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/209.out 2024-05-15 12:10:37.809389244 +0000 2024-05-15T13:27:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/209.out.bad 2024-05-15 13:27:04.624098811 +0000 2024-05-15T13:27:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,2 +1,2 @@ 2024-05-15T13:27:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 209 2024-05-15T13:27:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: -test ran for 30 seconds without error 2024-05-15T13:27:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: +reader found old byte at pos 4096 2024-05-15T13:27:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: \ No newline at end of file 2024-05-15T13:27:04.640 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/209 2024-05-15T13:27:04.641 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/209 2024-05-15T13:27:04.641 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:27:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:04.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:27:04.661 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:27:04.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:27:04.661 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-05-15T13:27:05.023 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:05.027 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:05.027 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:05.273 INFO:teuthology.orchestra.run.smithi077.stdout:generic/210 0s 2024-05-15T13:27:05.278 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/210 2024-05-15T13:27:05.279 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:05.281 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:05.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:05.323 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-05-15T13:27:05.693 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:05.697 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:06.056 INFO:teuthology.orchestra.run.smithi077.stdout:generic/211 1s 2024-05-15T13:27:06.062 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/211 2024-05-15T13:27:06.062 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:06.064 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:06.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:06.074 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-05-15T13:27:06.255 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:06.259 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:06.259 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:06.464 INFO:teuthology.orchestra.run.smithi077.stdout:generic/212 0s 2024-05-15T13:27:06.469 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/212 2024-05-15T13:27:06.469 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:06.472 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:06.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:06.481 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-05-15T13:27:06.659 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:06.663 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:06.663 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:07.069 INFO:teuthology.orchestra.run.smithi077.stdout:generic/213 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/213.out.bad) 2024-05-15T13:27:07.071 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/213.out 2024-05-15 12:10:37.809389244 +0000 2024-05-15T13:27:07.071 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/213.out.bad 2024-05-15 13:27:07.067051244 +0000 2024-05-15T13:27:07.071 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,4 +1,3 @@ 2024-05-15T13:27:07.071 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 213 2024-05-15T13:27:07.071 INFO:teuthology.orchestra.run.smithi077.stdout: We should get: fallocate: No space left on device 2024-05-15T13:27:07.071 INFO:teuthology.orchestra.run.smithi077.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-05-15T13:27:07.072 INFO:teuthology.orchestra.run.smithi077.stdout: -fallocate: No space left on device 2024-05-15T13:27:07.074 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/213 2024-05-15T13:27:07.074 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/213 2024-05-15T13:27:07.074 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:27:07.076 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:07.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:27:07.085 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:27:07.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:27:07.086 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-05-15T13:27:07.542 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:07.547 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:07.547 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:08.036 INFO:teuthology.orchestra.run.smithi077.stdout:generic/214 1s 2024-05-15T13:27:08.044 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/214 2024-05-15T13:27:08.045 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:08.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:08.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:08.063 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-05-15T13:27:08.543 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:08.549 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:08.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:11.543 INFO:teuthology.orchestra.run.smithi077.stdout:generic/215 3s 2024-05-15T13:27:11.549 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/215 2024-05-15T13:27:11.550 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:11.553 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:11.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:11.566 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-05-15T13:27:11.830 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:11.836 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:11.836 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:11.996 INFO:teuthology.orchestra.run.smithi077.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:12.001 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/216 2024-05-15T13:27:12.001 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/216 2024-05-15T13:27:12.001 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:12.004 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:12.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:12.017 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-05-15T13:27:12.256 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:12.260 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:12.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:12.432 INFO:teuthology.orchestra.run.smithi077.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:12.436 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/217 2024-05-15T13:27:12.436 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/217 2024-05-15T13:27:12.436 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:12.439 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:12.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:12.450 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-05-15T13:27:12.706 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:12.713 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:12.713 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:12.873 INFO:teuthology.orchestra.run.smithi077.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:12.875 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/218 2024-05-15T13:27:12.875 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/218 2024-05-15T13:27:12.875 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:12.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:12.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:12.889 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-05-15T13:27:13.141 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:13.148 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:13.148 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:13.312 INFO:teuthology.orchestra.run.smithi077.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:13.316 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/219 2024-05-15T13:27:13.316 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/219 2024-05-15T13:27:13.316 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:13.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:13.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:13.333 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-05-15T13:27:13.578 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:13.583 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:13.749 INFO:teuthology.orchestra.run.smithi077.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:13.753 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/220 2024-05-15T13:27:13.754 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/220 2024-05-15T13:27:13.754 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:13.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:13.768 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-05-15T13:27:14.025 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:14.030 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:14.030 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:15.242 INFO:teuthology.orchestra.run.smithi077.stdout:generic/221 1s 2024-05-15T13:27:15.248 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/221 2024-05-15T13:27:15.248 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:15.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:15.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:15.267 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-05-15T13:27:15.515 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:15.520 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:15.520 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:15.680 INFO:teuthology.orchestra.run.smithi077.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:15.684 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/222 2024-05-15T13:27:15.684 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/222 2024-05-15T13:27:15.684 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:15.687 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:15.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:15.704 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-05-15T13:27:15.951 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:15.956 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:15.956 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:16.114 INFO:teuthology.orchestra.run.smithi077.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:16.119 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/223 2024-05-15T13:27:16.119 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/223 2024-05-15T13:27:16.119 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:16.123 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:16.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:16.136 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-05-15T13:27:16.387 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:16.392 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:16.392 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:16.564 INFO:teuthology.orchestra.run.smithi077.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:16.568 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/224 2024-05-15T13:27:16.568 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/224 2024-05-15T13:27:16.568 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:16.571 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:16.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:16.585 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-05-15T13:27:16.838 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:16.846 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:16.846 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:17.007 INFO:teuthology.orchestra.run.smithi077.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/225 2024-05-15T13:27:17.011 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/225 2024-05-15T13:27:17.012 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:17.014 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:17.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:17.027 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-05-15T13:27:17.274 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:17.279 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:17.448 INFO:teuthology.orchestra.run.smithi077.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/226 2024-05-15T13:27:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/226 2024-05-15T13:27:17.452 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:17.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:17.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:17.469 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-05-15T13:27:17.725 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:17.731 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:17.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:17.891 INFO:teuthology.orchestra.run.smithi077.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/227 2024-05-15T13:27:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/227 2024-05-15T13:27:17.896 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:17.900 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:17.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:17.912 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-05-15T13:27:18.174 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:18.183 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:18.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:18.481 INFO:teuthology.orchestra.run.smithi077.stdout:generic/228 0s 2024-05-15T13:27:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/228 2024-05-15T13:27:18.489 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:18.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:18.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:18.519 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-05-15T13:27:18.973 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:18.981 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:18.981 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/229 2024-05-15T13:27:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/229 2024-05-15T13:27:19.154 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:19.157 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:19.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:19.172 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-05-15T13:27:19.420 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:19.428 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/230 2024-05-15T13:27:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/230 2024-05-15T13:27:19.610 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:19.612 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:19.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:19.628 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-05-15T13:27:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:19.885 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/231 2024-05-15T13:27:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/231 2024-05-15T13:27:20.054 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:20.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:20.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:20.068 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-05-15T13:27:20.324 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:20.329 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:20.329 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/232 2024-05-15T13:27:20.492 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/232 2024-05-15T13:27:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:20.495 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:20.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:20.509 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-05-15T13:27:20.744 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:20.751 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:20.751 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:20.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:27:20.872 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:27:20.917 INFO:teuthology.orchestra.run.smithi077.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/233 2024-05-15T13:27:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/233 2024-05-15T13:27:20.922 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:20.926 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:20.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:20.937 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-05-15T13:27:21.188 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:21.194 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:21.194 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/234 2024-05-15T13:27:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/234 2024-05-15T13:27:21.352 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:21.355 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:21.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:21.367 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-05-15T13:27:21.628 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:21.633 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:21.633 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:21.786 INFO:teuthology.orchestra.run.smithi077.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/235 2024-05-15T13:27:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/235 2024-05-15T13:27:21.790 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:21.793 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:21.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:21.804 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-05-15T13:27:22.038 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:22.044 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:22.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:23.324 INFO:teuthology.orchestra.run.smithi077.stdout:generic/236 1s 2024-05-15T13:27:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/236 2024-05-15T13:27:23.331 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:23.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:23.351 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-05-15T13:27:23.821 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:23.826 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:24.065 INFO:teuthology.orchestra.run.smithi077.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T13:27:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/237 2024-05-15T13:27:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/237 2024-05-15T13:27:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:24.076 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:24.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:24.089 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-05-15T13:27:24.350 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:24.355 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:24.355 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:24.521 INFO:teuthology.orchestra.run.smithi077.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:27:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/238 2024-05-15T13:27:24.525 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/238 2024-05-15T13:27:24.526 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:24.528 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:24.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:24.541 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-05-15T13:27:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:24.819 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:24.819 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:25.059 INFO:teuthology.orchestra.run.smithi077.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-05-15T13:27:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/239 2024-05-15T13:27:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/239 2024-05-15T13:27:25.066 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:25.070 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:25.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:25.085 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-05-15T13:27:25.337 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:25.548 INFO:teuthology.orchestra.run.smithi077.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-05-15T13:27:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/240 2024-05-15T13:27:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/240 2024-05-15T13:27:25.552 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:27:25.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:25.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:27:25.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-05-15T13:27:25.822 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:27:25.826 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:27:25.826 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:27:50.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:27:50.977 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:28:21.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:28:21.070 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:28:39.608 INFO:teuthology.orchestra.run.smithi077.stdout:generic/241 74s 2024-05-15T13:28:39.614 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/241 2024-05-15T13:28:39.615 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:28:39.617 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:39.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:28:39.630 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-05-15T13:28:40.099 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:28:40.103 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:28:40.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:40.260 INFO:teuthology.orchestra.run.smithi077.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:28:40.265 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/242 2024-05-15T13:28:40.265 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/242 2024-05-15T13:28:40.266 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:28:40.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:40.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:28:40.283 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-05-15T13:28:40.538 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:28:40.542 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:28:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:40.714 INFO:teuthology.orchestra.run.smithi077.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:28:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/243 2024-05-15T13:28:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/243 2024-05-15T13:28:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:28:40.720 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:40.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:28:40.738 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-05-15T13:28:40.980 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:28:40.986 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:28:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:41.149 INFO:teuthology.orchestra.run.smithi077.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T13:28:41.154 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/244 2024-05-15T13:28:41.155 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/244 2024-05-15T13:28:41.155 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:28:41.157 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:41.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:28:41.168 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-05-15T13:28:41.427 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:28:41.433 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:28:41.433 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:41.740 INFO:teuthology.orchestra.run.smithi077.stdout:generic/245 0s 2024-05-15T13:28:41.747 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/245 2024-05-15T13:28:41.747 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:28:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:41.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:28:41.773 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-05-15T13:28:42.215 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:28:42.222 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:28:42.222 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:42.463 INFO:teuthology.orchestra.run.smithi077.stdout:generic/246 0s 2024-05-15T13:28:42.470 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/246 2024-05-15T13:28:42.470 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:28:42.473 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:42.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:28:42.486 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-05-15T13:28:42.949 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:28:42.957 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:28:42.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:28:51.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:28:51.227 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:29:21.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:29:21.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:29:30.136 INFO:teuthology.orchestra.run.smithi077.stdout:generic/247 48s 2024-05-15T13:29:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/247 2024-05-15T13:29:30.143 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:30.147 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:30.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:30.157 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-05-15T13:29:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:30.402 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:30.638 INFO:teuthology.orchestra.run.smithi077.stdout:generic/248 0s 2024-05-15T13:29:30.645 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/248 2024-05-15T13:29:30.645 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:30.648 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:30.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:30.662 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-05-15T13:29:30.912 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:30.917 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:30.917 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:33.003 INFO:teuthology.orchestra.run.smithi077.stdout:generic/249 2s 2024-05-15T13:29:33.009 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/249 2024-05-15T13:29:33.009 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:33.012 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:33.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:33.025 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-05-15T13:29:33.485 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:33.490 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:33.682 INFO:teuthology.orchestra.run.smithi077.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:33.687 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/250 2024-05-15T13:29:33.687 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/250 2024-05-15T13:29:33.687 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:33.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:33.704 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-05-15T13:29:33.966 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:33.971 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:34.145 INFO:teuthology.orchestra.run.smithi077.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:34.149 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/251 2024-05-15T13:29:34.149 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/251 2024-05-15T13:29:34.149 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:34.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:34.164 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-05-15T13:29:34.411 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:34.415 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:34.415 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:34.593 INFO:teuthology.orchestra.run.smithi077.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:34.597 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/252 2024-05-15T13:29:34.598 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/252 2024-05-15T13:29:34.598 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:34.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:34.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:34.614 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-05-15T13:29:34.856 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:34.861 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:34.861 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:35.018 INFO:teuthology.orchestra.run.smithi077.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:35.023 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/253 2024-05-15T13:29:35.023 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/253 2024-05-15T13:29:35.023 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:35.025 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:35.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:35.036 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-05-15T13:29:35.278 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:35.284 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:35.284 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:35.445 INFO:teuthology.orchestra.run.smithi077.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:35.449 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/254 2024-05-15T13:29:35.450 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/254 2024-05-15T13:29:35.450 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:35.453 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:35.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:35.465 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-05-15T13:29:35.705 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:35.711 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:35.711 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:37.024 INFO:teuthology.orchestra.run.smithi077.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T13:29:37.030 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/255 2024-05-15T13:29:37.030 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/255 2024-05-15T13:29:37.030 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:37.033 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:37.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:37.045 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-05-15T13:29:37.492 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:37.497 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:37.498 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:38.766 INFO:teuthology.orchestra.run.smithi077.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:38.770 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/256 2024-05-15T13:29:38.770 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/256 2024-05-15T13:29:38.770 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:38.773 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:38.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:38.791 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-05-15T13:29:39.039 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:39.044 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:40.842 INFO:teuthology.orchestra.run.smithi077.stdout:generic/257 1s 2024-05-15T13:29:40.849 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/257 2024-05-15T13:29:40.849 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:40.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:40.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:40.867 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-05-15T13:29:41.353 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:41.358 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:41.358 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:41.592 INFO:teuthology.orchestra.run.smithi077.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/258.out.bad) 2024-05-15T13:29:41.594 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/258.out 2024-05-15 12:10:37.812389187 +0000 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/258.out.bad 2024-05-15 13:29:41.588045263 +0000 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,5 +1,6 @@ 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 258 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: Creating file with timestamp of Jan 1, 1960 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: Testing for negative seconds since epoch 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: -Remounting to flush cache 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: -Testing for negative seconds since epoch 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: +Timestamp wrapped: 3979351756 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: +Timestamp wrapped 2024-05-15T13:29:41.595 INFO:teuthology.orchestra.run.smithi077.stdout: +(see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/258.full for details) 2024-05-15T13:29:41.598 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/258 2024-05-15T13:29:41.598 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/258 2024-05-15T13:29:41.598 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:29:41.601 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:41.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:29:41.613 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:29:41.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:29:41.614 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-05-15T13:29:41.856 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:41.861 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:41.861 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:42.030 INFO:teuthology.orchestra.run.smithi077.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:42.035 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/259 2024-05-15T13:29:42.035 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/259 2024-05-15T13:29:42.035 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:42.040 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:42.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:42.051 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-05-15T13:29:42.304 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:42.311 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:42.311 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:42.475 INFO:teuthology.orchestra.run.smithi077.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:42.479 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/260 2024-05-15T13:29:42.480 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/260 2024-05-15T13:29:42.480 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:42.483 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:42.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:42.493 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-05-15T13:29:42.760 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:42.765 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:42.917 INFO:teuthology.orchestra.run.smithi077.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/261 2024-05-15T13:29:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/261 2024-05-15T13:29:42.922 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:42.926 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:42.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:42.937 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-05-15T13:29:43.201 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:43.206 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:43.207 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:43.371 INFO:teuthology.orchestra.run.smithi077.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:29:43.375 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/262 2024-05-15T13:29:43.375 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/262 2024-05-15T13:29:43.375 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:29:43.378 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:43.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:29:43.389 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-05-15T13:29:43.628 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:29:43.636 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:29:43.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:29:51.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:29:51.920 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:29:51.959 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T13:29:51.957+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 248434) UID: 0 2024-05-15T13:29:51.959 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T13:29:51.957+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 248434) UID: 0 2024-05-15T13:29:51.959 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T13:29:51.957+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 248434) UID: 0 2024-05-15T13:29:51.959 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T13:29:51.957+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 248434) UID: 0 2024-05-15T13:31:01.816 INFO:teuthology.orchestra.run.smithi077.stdout:generic/263 78s 2024-05-15T13:31:01.821 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/263 2024-05-15T13:31:01.821 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:01.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:01.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-05-15T13:31:02.305 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:02.310 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:02.310 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:02.529 INFO:teuthology.orchestra.run.smithi077.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:02.533 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/264 2024-05-15T13:31:02.533 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/264 2024-05-15T13:31:02.533 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:02.536 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:02.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:02.545 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-05-15T13:31:02.725 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:02.729 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:02.729 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:02.905 INFO:teuthology.orchestra.run.smithi077.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:02.909 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/265 2024-05-15T13:31:02.909 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/265 2024-05-15T13:31:02.909 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:02.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:02.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:02.920 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-05-15T13:31:03.100 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:03.104 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:03.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:03.247 INFO:teuthology.orchestra.run.smithi077.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:03.250 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/266 2024-05-15T13:31:03.251 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/266 2024-05-15T13:31:03.251 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:03.253 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:03.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:03.262 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-05-15T13:31:03.439 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:03.443 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:03.443 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:03.612 INFO:teuthology.orchestra.run.smithi077.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:03.616 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/267 2024-05-15T13:31:03.616 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/267 2024-05-15T13:31:03.616 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:03.618 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:03.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:03.627 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-05-15T13:31:03.811 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:03.815 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:03.815 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:03.963 INFO:teuthology.orchestra.run.smithi077.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:03.967 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/268 2024-05-15T13:31:03.967 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/268 2024-05-15T13:31:03.967 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:03.969 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:03.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:03.979 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-05-15T13:31:04.158 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:04.162 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:04.163 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:04.278 INFO:teuthology.orchestra.run.smithi077.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:04.282 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/269 2024-05-15T13:31:04.282 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/269 2024-05-15T13:31:04.282 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:04.285 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:04.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:04.295 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-05-15T13:31:04.476 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:04.480 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:04.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:04.675 INFO:teuthology.orchestra.run.smithi077.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T13:31:04.678 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/270 2024-05-15T13:31:04.678 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/270 2024-05-15T13:31:04.678 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:04.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:04.689 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-05-15T13:31:04.868 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:04.872 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:04.872 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:05.012 INFO:teuthology.orchestra.run.smithi077.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:05.015 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/271 2024-05-15T13:31:05.016 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/271 2024-05-15T13:31:05.016 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:05.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:05.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:05.027 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-05-15T13:31:05.208 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:05.212 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:05.351 INFO:teuthology.orchestra.run.smithi077.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:05.355 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/272 2024-05-15T13:31:05.355 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/272 2024-05-15T13:31:05.355 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:05.357 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:05.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:05.367 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-05-15T13:31:05.553 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:05.557 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:05.557 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:05.680 INFO:teuthology.orchestra.run.smithi077.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:05.683 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/273 2024-05-15T13:31:05.683 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/273 2024-05-15T13:31:05.684 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:05.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:05.694 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-05-15T13:31:05.870 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:05.874 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:05.874 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:06.002 INFO:teuthology.orchestra.run.smithi077.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:06.006 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/274 2024-05-15T13:31:06.006 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/274 2024-05-15T13:31:06.006 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:06.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:06.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:06.017 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-05-15T13:31:06.201 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:06.205 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:06.205 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:06.338 INFO:teuthology.orchestra.run.smithi077.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:06.341 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/275 2024-05-15T13:31:06.342 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/275 2024-05-15T13:31:06.342 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:06.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:06.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:06.353 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-05-15T13:31:06.531 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:06.535 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:06.536 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:06.669 INFO:teuthology.orchestra.run.smithi077.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:06.673 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/276 2024-05-15T13:31:06.673 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/276 2024-05-15T13:31:06.673 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:06.675 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:06.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:06.684 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-05-15T13:31:06.865 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:06.870 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:06.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:07.018 INFO:teuthology.orchestra.run.smithi077.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:07.022 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/277 2024-05-15T13:31:07.022 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/277 2024-05-15T13:31:07.022 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:07.024 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:07.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:07.047 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-05-15T13:31:07.227 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:07.231 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:07.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:07.369 INFO:teuthology.orchestra.run.smithi077.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/278 2024-05-15T13:31:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/278 2024-05-15T13:31:07.373 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:07.375 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:07.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:07.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-05-15T13:31:07.562 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:07.569 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:07.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/279 2024-05-15T13:31:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/279 2024-05-15T13:31:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:07.709 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:07.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:07.718 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-05-15T13:31:07.895 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:07.899 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:07.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:08.062 INFO:teuthology.orchestra.run.smithi077.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/280 2024-05-15T13:31:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/280 2024-05-15T13:31:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:08.068 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:08.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:08.077 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-05-15T13:31:08.265 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:08.269 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:08.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:08.423 INFO:teuthology.orchestra.run.smithi077.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:08.427 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/281 2024-05-15T13:31:08.427 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/281 2024-05-15T13:31:08.427 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:08.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:08.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:08.438 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-05-15T13:31:08.617 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:08.622 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:08.623 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:08.765 INFO:teuthology.orchestra.run.smithi077.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:08.769 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/282 2024-05-15T13:31:08.770 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/282 2024-05-15T13:31:08.770 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:08.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:08.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:08.783 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-05-15T13:31:08.961 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:08.965 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:09.100 INFO:teuthology.orchestra.run.smithi077.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:09.104 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/283 2024-05-15T13:31:09.104 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/283 2024-05-15T13:31:09.104 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:09.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:09.130 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-05-15T13:31:09.320 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:09.324 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:09.453 INFO:teuthology.orchestra.run.smithi077.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:09.456 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/284 2024-05-15T13:31:09.456 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/284 2024-05-15T13:31:09.456 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:09.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:09.468 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-05-15T13:31:09.646 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:09.650 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:11.370 INFO:teuthology.orchestra.run.smithi077.stdout:generic/285 2s 2024-05-15T13:31:11.376 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/285 2024-05-15T13:31:11.376 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:11.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:11.388 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-05-15T13:31:11.872 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:11.877 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:11.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:41.996 INFO:teuthology.orchestra.run.smithi077.stdout:generic/286 30s 2024-05-15T13:31:42.001 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/286 2024-05-15T13:31:42.001 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:42.003 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:42.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:42.012 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-05-15T13:31:42.514 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:42.521 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:42.521 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:42.757 INFO:teuthology.orchestra.run.smithi077.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:42.762 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/287 2024-05-15T13:31:42.762 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/287 2024-05-15T13:31:42.764 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:42.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:42.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-05-15T13:31:42.970 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:42.975 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:42.975 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:43.522 INFO:teuthology.orchestra.run.smithi077.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:43.526 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/288 2024-05-15T13:31:43.526 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/288 2024-05-15T13:31:43.526 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:43.529 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:43.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:43.539 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-05-15T13:31:43.720 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:43.725 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:43.969 INFO:teuthology.orchestra.run.smithi077.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:43.973 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/289 2024-05-15T13:31:43.973 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/289 2024-05-15T13:31:43.973 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:43.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:43.984 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-05-15T13:31:44.158 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:44.162 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:44.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:44.352 INFO:teuthology.orchestra.run.smithi077.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:44.355 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/290 2024-05-15T13:31:44.355 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/290 2024-05-15T13:31:44.355 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:44.357 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:44.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:44.366 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-05-15T13:31:44.543 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:44.547 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:44.547 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:44.750 INFO:teuthology.orchestra.run.smithi077.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/291 2024-05-15T13:31:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/291 2024-05-15T13:31:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:44.756 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:44.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:44.764 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-05-15T13:31:44.940 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:44.944 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:44.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:45.061 INFO:teuthology.orchestra.run.smithi077.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:45.064 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/292 2024-05-15T13:31:45.065 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/292 2024-05-15T13:31:45.065 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:45.067 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:45.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:45.075 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-05-15T13:31:45.252 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:45.256 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:45.534 INFO:teuthology.orchestra.run.smithi077.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:45.538 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/293 2024-05-15T13:31:45.538 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/293 2024-05-15T13:31:45.538 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:45.540 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:45.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:45.550 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-05-15T13:31:45.726 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:45.731 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:45.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:45.996 INFO:teuthology.orchestra.run.smithi077.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:46.000 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/294 2024-05-15T13:31:46.000 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/294 2024-05-15T13:31:46.000 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:46.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:46.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:46.011 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-05-15T13:31:46.188 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:46.192 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:46.192 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:46.331 INFO:teuthology.orchestra.run.smithi077.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:46.335 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/295 2024-05-15T13:31:46.335 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/295 2024-05-15T13:31:46.335 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:46.338 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:46.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:46.346 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-05-15T13:31:46.521 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:46.525 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:46.525 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:46.669 INFO:teuthology.orchestra.run.smithi077.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:46.673 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/296 2024-05-15T13:31:46.673 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/296 2024-05-15T13:31:46.673 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:46.675 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:46.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:46.684 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-05-15T13:31:46.858 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:46.862 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:46.862 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:47.164 INFO:teuthology.orchestra.run.smithi077.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:47.168 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/297 2024-05-15T13:31:47.168 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/297 2024-05-15T13:31:47.168 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:47.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:47.179 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-05-15T13:31:47.365 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:47.369 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:47.370 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:47.495 INFO:teuthology.orchestra.run.smithi077.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:47.498 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/298 2024-05-15T13:31:47.498 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/298 2024-05-15T13:31:47.499 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:47.501 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:47.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:47.510 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-05-15T13:31:47.685 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:47.689 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:47.832 INFO:teuthology.orchestra.run.smithi077.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:47.836 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/299 2024-05-15T13:31:47.836 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/299 2024-05-15T13:31:47.836 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:47.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:47.847 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-05-15T13:31:48.022 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:48.026 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:48.026 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:48.151 INFO:teuthology.orchestra.run.smithi077.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:48.154 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/300 2024-05-15T13:31:48.154 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/300 2024-05-15T13:31:48.154 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:48.157 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:48.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:48.165 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-05-15T13:31:48.340 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:48.344 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:48.344 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:48.491 INFO:teuthology.orchestra.run.smithi077.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:48.494 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/301 2024-05-15T13:31:48.495 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/301 2024-05-15T13:31:48.495 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:48.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:48.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:48.506 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-05-15T13:31:48.681 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:48.685 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:48.685 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:48.810 INFO:teuthology.orchestra.run.smithi077.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:48.814 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/302 2024-05-15T13:31:48.814 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/302 2024-05-15T13:31:48.814 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:48.816 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:48.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:48.825 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-05-15T13:31:49.004 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:49.008 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:49.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:49.205 INFO:teuthology.orchestra.run.smithi077.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:31:49.208 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/303 2024-05-15T13:31:49.209 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/303 2024-05-15T13:31:49.209 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:49.211 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:49.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:49.219 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-05-15T13:31:49.646 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:49.651 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:49.651 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:49.816 INFO:teuthology.orchestra.run.smithi077.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:31:49.820 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/304 2024-05-15T13:31:49.820 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/304 2024-05-15T13:31:49.820 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:49.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:49.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:49.831 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-05-15T13:31:50.292 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:50.296 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:50.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:50.449 INFO:teuthology.orchestra.run.smithi077.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:50.453 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/305 2024-05-15T13:31:50.453 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/305 2024-05-15T13:31:50.453 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:50.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:50.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:50.465 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-05-15T13:31:50.647 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:50.651 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:50.651 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:50.777 INFO:teuthology.orchestra.run.smithi077.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:50.781 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/306 2024-05-15T13:31:50.781 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/306 2024-05-15T13:31:50.781 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:50.783 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:50.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:50.792 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-05-15T13:31:50.969 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:50.973 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:50.973 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:51.112 INFO:teuthology.orchestra.run.smithi077.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:31:51.116 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/307 2024-05-15T13:31:51.116 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/307 2024-05-15T13:31:51.116 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:51.118 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:51.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:51.135 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-05-15T13:31:51.314 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:51.318 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:51.318 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:51.479 INFO:teuthology.orchestra.run.smithi077.stdout:generic/308 0s 2024-05-15T13:31:51.484 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/308 2024-05-15T13:31:51.484 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:51.487 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:51.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:51.496 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-05-15T13:31:51.673 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:51.677 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:51.677 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:52.882 INFO:teuthology.orchestra.run.smithi077.stdout:generic/309 1s 2024-05-15T13:31:52.887 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/309 2024-05-15T13:31:52.887 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:31:52.890 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:31:52.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:31:52.899 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-05-15T13:31:53.386 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:31:53.393 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:31:53.394 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:32:47.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:32:47.446 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:32:47.480 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T13:32:47.477+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46385) UID: 0 2024-05-15T13:32:47.481 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T13:32:47.477+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46385) UID: 0 2024-05-15T13:32:47.481 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T13:32:47.477+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46385) UID: 0 2024-05-15T13:32:47.481 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T13:32:47.477+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46385) UID: 0 2024-05-15T13:33:14.337 INFO:teuthology.orchestra.run.smithi077.stdout:generic/310 80s 2024-05-15T13:33:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/310 2024-05-15T13:33:14.354 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:14.356 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:14.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:14.379 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-05-15T13:33:14.748 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:14.754 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:15.399 INFO:teuthology.orchestra.run.smithi077.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:15.399 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/311 2024-05-15T13:33:15.399 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/311 2024-05-15T13:33:15.399 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:15.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:15.411 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-05-15T13:33:15.750 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:15.760 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:15.760 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:16.023 INFO:teuthology.orchestra.run.smithi077.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:16.026 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/312 2024-05-15T13:33:16.026 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/312 2024-05-15T13:33:16.027 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:16.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:16.038 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-05-15T13:33:16.218 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:16.220 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:16.220 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:20.509 INFO:teuthology.orchestra.run.smithi077.stdout:generic/313 4s 2024-05-15T13:33:20.515 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/313 2024-05-15T13:33:20.516 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:20.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:20.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:20.529 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-05-15T13:33:20.711 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:20.715 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:20.716 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:21.236 INFO:teuthology.orchestra.run.smithi077.stdout:generic/314 1s 2024-05-15T13:33:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/314 2024-05-15T13:33:21.241 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:21.244 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:21.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:21.253 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-05-15T13:33:21.437 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:21.442 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:21.442 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:22.449 INFO:teuthology.orchestra.run.smithi077.stdout:generic/315 1s 2024-05-15T13:33:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/315 2024-05-15T13:33:22.455 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:22.458 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:22.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:22.469 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-05-15T13:33:22.900 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:22.904 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:22.904 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:23.728 INFO:teuthology.orchestra.run.smithi077.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T13:33:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/316 2024-05-15T13:33:23.731 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/316 2024-05-15T13:33:23.732 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:23.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:23.743 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-05-15T13:33:24.160 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:24.164 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:24.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:24.300 INFO:teuthology.orchestra.run.smithi077.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/317 2024-05-15T13:33:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/317 2024-05-15T13:33:24.304 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:24.307 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:24.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:24.316 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-05-15T13:33:24.497 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:24.501 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:24.501 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:24.633 INFO:teuthology.orchestra.run.smithi077.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/318 2024-05-15T13:33:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/318 2024-05-15T13:33:24.637 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:24.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:24.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:24.648 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-05-15T13:33:24.822 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:24.826 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:24.826 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:24.990 INFO:teuthology.orchestra.run.smithi077.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T13:33:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/319 2024-05-15T13:33:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/319 2024-05-15T13:33:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:24.997 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:25.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:25.005 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-05-15T13:33:25.184 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:25.188 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:25.188 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:25.325 INFO:teuthology.orchestra.run.smithi077.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/320 2024-05-15T13:33:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/320 2024-05-15T13:33:25.328 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:25.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:25.340 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-05-15T13:33:25.519 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:25.524 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:25.524 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:25.682 INFO:teuthology.orchestra.run.smithi077.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/321 2024-05-15T13:33:25.685 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/321 2024-05-15T13:33:25.686 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:25.688 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:25.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:25.697 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-05-15T13:33:25.876 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:25.880 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:25.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:26.014 INFO:teuthology.orchestra.run.smithi077.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:33:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/322 2024-05-15T13:33:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/322 2024-05-15T13:33:26.015 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:33:26.016 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:33:26.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:33:26.025 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-05-15T13:33:26.206 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:33:26.210 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:33:26.210 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:generic/323 120s 2024-05-15T13:35:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/323 2024-05-15T13:35:26.867 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:26.869 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:26.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:26.887 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-05-15T13:35:27.302 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:27.306 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:27.434 INFO:teuthology.orchestra.run.smithi077.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/324 2024-05-15T13:35:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/324 2024-05-15T13:35:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:27.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:27.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:27.449 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-05-15T13:35:27.636 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:27.640 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:27.778 INFO:teuthology.orchestra.run.smithi077.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/325 2024-05-15T13:35:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/325 2024-05-15T13:35:27.781 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:27.783 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:27.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:27.793 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-05-15T13:35:27.979 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:27.983 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:27.983 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/326 2024-05-15T13:35:28.126 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/326 2024-05-15T13:35:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:28.129 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:28.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:28.138 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-05-15T13:35:28.318 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:28.322 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:28.323 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:28.449 INFO:teuthology.orchestra.run.smithi077.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:28.452 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/327 2024-05-15T13:35:28.452 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/327 2024-05-15T13:35:28.453 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:28.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:28.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:28.464 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-05-15T13:35:28.643 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:28.647 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:28.647 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:28.772 INFO:teuthology.orchestra.run.smithi077.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/328 2024-05-15T13:35:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/328 2024-05-15T13:35:28.776 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:28.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:28.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:28.787 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-05-15T13:35:28.967 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:28.971 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:28.971 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:29.109 INFO:teuthology.orchestra.run.smithi077.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/329 2024-05-15T13:35:29.112 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/329 2024-05-15T13:35:29.113 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:29.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:29.124 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-05-15T13:35:29.322 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:29.326 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:29.326 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:29.463 INFO:teuthology.orchestra.run.smithi077.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/330 2024-05-15T13:35:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/330 2024-05-15T13:35:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:29.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:29.479 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-05-15T13:35:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:29.661 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:29.794 INFO:teuthology.orchestra.run.smithi077.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/331 2024-05-15T13:35:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/331 2024-05-15T13:35:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:29.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:29.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:29.810 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-05-15T13:35:29.993 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:29.997 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:29.997 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:30.118 INFO:teuthology.orchestra.run.smithi077.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:30.122 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/332 2024-05-15T13:35:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/332 2024-05-15T13:35:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:30.124 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:30.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:30.133 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-05-15T13:35:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:30.315 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:30.446 INFO:teuthology.orchestra.run.smithi077.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/333 2024-05-15T13:35:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/333 2024-05-15T13:35:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:30.452 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:30.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:30.461 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-05-15T13:35:30.637 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:30.641 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:30.641 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:30.765 INFO:teuthology.orchestra.run.smithi077.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:30.769 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/334 2024-05-15T13:35:30.769 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/334 2024-05-15T13:35:30.769 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:30.771 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:30.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:30.780 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-05-15T13:35:30.962 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:30.966 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:30.966 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:31.101 INFO:teuthology.orchestra.run.smithi077.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:31.105 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/335 2024-05-15T13:35:31.105 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/335 2024-05-15T13:35:31.105 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:31.107 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:31.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:31.117 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-05-15T13:35:31.295 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:31.299 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:31.299 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:31.437 INFO:teuthology.orchestra.run.smithi077.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:31.441 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/336 2024-05-15T13:35:31.441 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/336 2024-05-15T13:35:31.441 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:31.443 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:31.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:31.453 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-05-15T13:35:31.627 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:31.630 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:31.631 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:31.759 INFO:teuthology.orchestra.run.smithi077.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:31.763 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/337 2024-05-15T13:35:31.763 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/337 2024-05-15T13:35:31.763 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:31.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:31.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:31.775 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-05-15T13:35:31.958 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:31.962 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:31.963 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:32.098 INFO:teuthology.orchestra.run.smithi077.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/338 2024-05-15T13:35:32.101 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/338 2024-05-15T13:35:32.102 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:32.102 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:32.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:32.111 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-05-15T13:35:32.298 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:32.302 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:32.302 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:32.433 INFO:teuthology.orchestra.run.smithi077.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:32.436 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/339 2024-05-15T13:35:32.437 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/339 2024-05-15T13:35:32.437 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:32.439 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:32.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:32.447 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-05-15T13:35:32.620 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:32.625 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:32.625 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:32.763 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/340 2024-05-15T13:35:32.763 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/340 2024-05-15T13:35:32.763 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:32.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:32.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:32.774 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-05-15T13:35:32.959 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:32.963 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:32.963 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:33.098 INFO:teuthology.orchestra.run.smithi077.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:33.102 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/341 2024-05-15T13:35:33.102 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/341 2024-05-15T13:35:33.102 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:33.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:33.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:33.113 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-05-15T13:35:33.289 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:33.293 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:33.293 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:33.431 INFO:teuthology.orchestra.run.smithi077.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:33.435 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/342 2024-05-15T13:35:33.435 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/342 2024-05-15T13:35:33.435 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:33.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:33.446 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-05-15T13:35:33.625 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:33.629 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:33.629 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:33.763 INFO:teuthology.orchestra.run.smithi077.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:33.767 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/343 2024-05-15T13:35:33.767 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/343 2024-05-15T13:35:33.767 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:33.769 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:33.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:33.793 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-05-15T13:35:33.984 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:33.988 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:33.988 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:34.108 INFO:teuthology.orchestra.run.smithi077.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:34.111 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/344 2024-05-15T13:35:34.111 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/344 2024-05-15T13:35:34.111 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:34.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:34.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:34.123 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-05-15T13:35:34.299 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:34.303 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:34.303 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:34.422 INFO:teuthology.orchestra.run.smithi077.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:34.426 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/345 2024-05-15T13:35:34.427 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/345 2024-05-15T13:35:34.427 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:34.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:34.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:34.437 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-05-15T13:35:34.611 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:34.615 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:34.615 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:34.739 INFO:teuthology.orchestra.run.smithi077.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:34.743 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/346 2024-05-15T13:35:34.743 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/346 2024-05-15T13:35:34.743 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:34.745 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:34.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:34.772 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-05-15T13:35:34.955 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:34.959 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:34.959 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:35.127 INFO:teuthology.orchestra.run.smithi077.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:35.131 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/347 2024-05-15T13:35:35.131 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/347 2024-05-15T13:35:35.131 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:35.132 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:35.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:35.141 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-05-15T13:35:35.323 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:35.327 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:35.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:35.469 INFO:teuthology.orchestra.run.smithi077.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:35.473 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/348 2024-05-15T13:35:35.473 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/348 2024-05-15T13:35:35.473 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:35.475 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:35.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:35.484 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-05-15T13:35:35.660 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:35.665 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:35.665 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:36.522 INFO:teuthology.orchestra.run.smithi077.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-15T13:35:36.526 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/349 2024-05-15T13:35:36.526 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/349 2024-05-15T13:35:36.526 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:36.528 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:36.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:36.548 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-05-15T13:35:36.733 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:36.737 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:36.737 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:37.952 INFO:teuthology.orchestra.run.smithi077.stdout:generic/350 1s 2024-05-15T13:35:37.958 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/350 2024-05-15T13:35:37.958 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:37.960 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:37.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:37.969 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-05-15T13:35:38.144 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:38.148 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:38.148 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:38.989 INFO:teuthology.orchestra.run.smithi077.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-15T13:35:38.993 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/351 2024-05-15T13:35:38.993 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/351 2024-05-15T13:35:38.993 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:38.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:39.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:39.038 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-05-15T13:35:39.445 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:39.449 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:39.449 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:39.572 INFO:teuthology.orchestra.run.smithi077.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:39.576 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/352 2024-05-15T13:35:39.576 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/352 2024-05-15T13:35:39.576 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:39.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:39.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:39.594 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-05-15T13:35:39.766 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:39.770 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:39.770 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:39.903 INFO:teuthology.orchestra.run.smithi077.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:39.906 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/353 2024-05-15T13:35:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/353 2024-05-15T13:35:39.907 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:39.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:39.931 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-05-15T13:35:40.111 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:40.115 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:40.234 INFO:teuthology.orchestra.run.smithi077.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:40.238 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/354 2024-05-15T13:35:40.238 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/354 2024-05-15T13:35:40.238 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:40.240 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:40.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:40.249 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-05-15T13:35:40.424 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:40.428 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:40.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:40.930 INFO:teuthology.orchestra.run.smithi077.stdout:generic/355 0s 2024-05-15T13:35:40.935 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/355 2024-05-15T13:35:40.935 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:40.938 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:40.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:40.947 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-05-15T13:35:41.369 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:41.373 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:41.373 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:41.500 INFO:teuthology.orchestra.run.smithi077.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:41.504 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/356 2024-05-15T13:35:41.504 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/356 2024-05-15T13:35:41.504 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:41.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:41.515 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-05-15T13:35:41.694 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:41.698 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:41.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:41.825 INFO:teuthology.orchestra.run.smithi077.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:41.829 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/357 2024-05-15T13:35:41.829 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/357 2024-05-15T13:35:41.829 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:41.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:41.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:41.840 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-05-15T13:35:42.024 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:42.028 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:42.028 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:42.150 INFO:teuthology.orchestra.run.smithi077.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:42.153 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/358 2024-05-15T13:35:42.153 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/358 2024-05-15T13:35:42.153 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:42.156 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:42.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:42.165 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-05-15T13:35:42.352 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:42.357 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:42.357 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:42.494 INFO:teuthology.orchestra.run.smithi077.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:42.497 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/359 2024-05-15T13:35:42.497 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/359 2024-05-15T13:35:42.498 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:42.500 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:42.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:42.509 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-05-15T13:35:42.687 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:42.691 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:42.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:42.862 INFO:teuthology.orchestra.run.smithi077.stdout:generic/360 0s 2024-05-15T13:35:42.867 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/360 2024-05-15T13:35:42.867 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:42.869 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:42.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:42.878 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-05-15T13:35:43.053 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:43.057 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:43.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:43.192 INFO:teuthology.orchestra.run.smithi077.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:43.196 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/361 2024-05-15T13:35:43.196 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/361 2024-05-15T13:35:43.196 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:43.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:43.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:43.208 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-05-15T13:35:43.388 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:43.392 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:43.392 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:43.524 INFO:teuthology.orchestra.run.smithi077.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:43.528 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/362 2024-05-15T13:35:43.528 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/362 2024-05-15T13:35:43.528 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:43.530 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:43.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:43.551 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-05-15T13:35:43.731 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:43.735 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:43.866 INFO:teuthology.orchestra.run.smithi077.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:43.869 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/363 2024-05-15T13:35:43.869 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/363 2024-05-15T13:35:43.870 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:43.872 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:43.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:43.881 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-05-15T13:35:44.059 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:44.064 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:44.064 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:44.194 INFO:teuthology.orchestra.run.smithi077.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:44.196 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/364 2024-05-15T13:35:44.196 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/364 2024-05-15T13:35:44.196 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:44.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:44.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:44.207 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-05-15T13:35:44.392 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:44.396 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:44.396 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:44.524 INFO:teuthology.orchestra.run.smithi077.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:44.528 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/365 2024-05-15T13:35:44.528 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/365 2024-05-15T13:35:44.528 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:44.530 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:44.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:44.539 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-05-15T13:35:44.715 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:44.719 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:44.719 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:44.844 INFO:teuthology.orchestra.run.smithi077.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:44.847 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/366 2024-05-15T13:35:44.848 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/366 2024-05-15T13:35:44.848 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:44.850 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:44.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:44.859 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-05-15T13:35:45.037 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:45.041 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:45.041 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:45.206 INFO:teuthology.orchestra.run.smithi077.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:45.209 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/367 2024-05-15T13:35:45.209 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/367 2024-05-15T13:35:45.210 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:45.212 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:45.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:45.221 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-05-15T13:35:45.397 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:45.401 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:45.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:45.579 INFO:teuthology.orchestra.run.smithi077.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:45.582 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/368 2024-05-15T13:35:45.582 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/368 2024-05-15T13:35:45.582 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:45.585 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:45.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:45.613 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-05-15T13:35:45.783 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:45.787 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:45.787 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:45.917 INFO:teuthology.orchestra.run.smithi077.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:45.921 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/369 2024-05-15T13:35:45.921 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/369 2024-05-15T13:35:45.921 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:45.923 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:45.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:45.932 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-05-15T13:35:46.121 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:46.125 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:46.125 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:46.289 INFO:teuthology.orchestra.run.smithi077.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:46.293 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/370 2024-05-15T13:35:46.293 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/370 2024-05-15T13:35:46.293 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:46.295 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:46.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:46.304 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-05-15T13:35:46.481 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:46.485 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:46.837 INFO:teuthology.orchestra.run.smithi077.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:46.841 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/371 2024-05-15T13:35:46.841 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/371 2024-05-15T13:35:46.841 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:46.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:46.864 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-05-15T13:35:47.047 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:47.051 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:47.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:47.176 INFO:teuthology.orchestra.run.smithi077.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:47.180 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/372 2024-05-15T13:35:47.180 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/372 2024-05-15T13:35:47.180 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:47.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:47.192 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-05-15T13:35:47.367 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:47.371 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:47.371 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:47.494 INFO:teuthology.orchestra.run.smithi077.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:47.498 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/373 2024-05-15T13:35:47.498 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/373 2024-05-15T13:35:47.499 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:47.500 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:47.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:47.508 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-05-15T13:35:47.687 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:47.691 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:47.815 INFO:teuthology.orchestra.run.smithi077.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:47.819 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/374 2024-05-15T13:35:47.819 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/374 2024-05-15T13:35:47.819 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:47.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:47.830 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-05-15T13:35:48.018 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:48.023 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:48.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:48.176 INFO:teuthology.orchestra.run.smithi077.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T13:35:48.179 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/375 2024-05-15T13:35:48.179 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/375 2024-05-15T13:35:48.179 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:48.182 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:48.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:48.190 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-05-15T13:35:48.364 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:48.368 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:48.368 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:48.512 INFO:teuthology.orchestra.run.smithi077.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:48.516 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/376 2024-05-15T13:35:48.516 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/376 2024-05-15T13:35:48.516 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:48.522 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:48.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:48.527 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-05-15T13:35:48.707 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:48.711 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:48.711 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:48.836 INFO:teuthology.orchestra.run.smithi077.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:48.840 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/377 2024-05-15T13:35:48.840 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/377 2024-05-15T13:35:48.840 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:48.842 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:48.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:48.851 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-05-15T13:35:49.028 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:49.032 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:49.032 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:49.282 INFO:teuthology.orchestra.run.smithi077.stdout:generic/378 0s 2024-05-15T13:35:49.287 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/378 2024-05-15T13:35:49.287 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:49.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:49.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:49.299 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-05-15T13:35:49.729 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:49.734 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:49.734 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:49.883 INFO:teuthology.orchestra.run.smithi077.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:49.887 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/379 2024-05-15T13:35:49.887 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/379 2024-05-15T13:35:49.887 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:49.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:49.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:49.898 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-05-15T13:35:50.079 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:50.083 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:50.083 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:50.208 INFO:teuthology.orchestra.run.smithi077.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:50.212 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/380 2024-05-15T13:35:50.212 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/380 2024-05-15T13:35:50.212 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:50.214 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:50.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:50.240 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-05-15T13:35:50.424 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:50.428 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:50.549 INFO:teuthology.orchestra.run.smithi077.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:50.553 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/381 2024-05-15T13:35:50.553 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/381 2024-05-15T13:35:50.553 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:50.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:50.564 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-05-15T13:35:50.743 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:50.747 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:50.748 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:50.871 INFO:teuthology.orchestra.run.smithi077.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:50.875 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/382 2024-05-15T13:35:50.875 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/382 2024-05-15T13:35:50.875 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:50.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:50.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:50.886 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-05-15T13:35:51.061 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:51.065 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:51.066 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:51.190 INFO:teuthology.orchestra.run.smithi077.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:51.194 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/383 2024-05-15T13:35:51.194 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/383 2024-05-15T13:35:51.194 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:51.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:51.217 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-05-15T13:35:51.403 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:51.407 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:51.407 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:51.542 INFO:teuthology.orchestra.run.smithi077.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T13:35:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/384 2024-05-15T13:35:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/384 2024-05-15T13:35:51.546 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:51.548 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:51.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:51.557 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-05-15T13:35:51.740 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:51.743 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:51.744 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:51.864 INFO:teuthology.orchestra.run.smithi077.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:51.868 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/385 2024-05-15T13:35:51.868 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/385 2024-05-15T13:35:51.868 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:51.870 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:51.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:51.879 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-05-15T13:35:52.055 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:52.059 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:52.187 INFO:teuthology.orchestra.run.smithi077.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T13:35:52.190 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/386 2024-05-15T13:35:52.190 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/386 2024-05-15T13:35:52.191 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:52.193 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:52.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:52.215 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-05-15T13:35:52.388 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:52.393 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:52.393 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:52.515 INFO:teuthology.orchestra.run.smithi077.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:52.518 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/387 2024-05-15T13:35:52.519 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/387 2024-05-15T13:35:52.519 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:52.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:52.530 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-05-15T13:35:52.713 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:52.717 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:52.717 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:52.851 INFO:teuthology.orchestra.run.smithi077.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:52.855 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/388 2024-05-15T13:35:52.855 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/388 2024-05-15T13:35:52.855 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:52.858 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:52.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:52.866 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-05-15T13:35:53.052 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:53.057 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:53.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:53.190 INFO:teuthology.orchestra.run.smithi077.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-05-15T13:35:53.194 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/389 2024-05-15T13:35:53.194 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/389 2024-05-15T13:35:53.194 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:53.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:53.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:53.218 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-05-15T13:35:53.394 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:53.399 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:53.399 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:53.541 INFO:teuthology.orchestra.run.smithi077.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:35:53.544 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/390 2024-05-15T13:35:53.544 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/390 2024-05-15T13:35:53.544 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:35:53.547 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:35:53.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:35:53.556 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-05-15T13:35:53.738 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:35:53.742 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:35:53.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:05.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:36:05.502 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:36:05.531 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T13:36:05.527+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2024-05-15T13:36:05.531 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T13:36:05.527+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2024-05-15T13:36:05.531 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T13:36:05.527+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2024-05-15T13:36:05.532 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T13:36:05.527+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46412) UID: 0 2024-05-15T13:36:12.240 INFO:teuthology.orchestra.run.smithi077.stdout:generic/391 19s 2024-05-15T13:36:12.294 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/391 2024-05-15T13:36:12.294 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:12.297 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:12.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:12.347 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-05-15T13:36:12.954 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:12.958 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:12.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:13.132 INFO:teuthology.orchestra.run.smithi077.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:13.136 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/392 2024-05-15T13:36:13.136 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/392 2024-05-15T13:36:13.136 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:13.139 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:13.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:13.152 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-05-15T13:36:13.404 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:13.409 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:13.565 INFO:teuthology.orchestra.run.smithi077.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:13.569 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/393 2024-05-15T13:36:13.570 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/393 2024-05-15T13:36:13.570 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:13.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:13.582 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-05-15T13:36:13.844 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:13.855 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:14.100 INFO:teuthology.orchestra.run.smithi077.stdout:generic/394 1s 2024-05-15T13:36:14.111 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/394 2024-05-15T13:36:14.111 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:14.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:14.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:14.124 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-05-15T13:36:14.602 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:14.607 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:14.805 INFO:teuthology.orchestra.run.smithi077.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:14.809 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/395 2024-05-15T13:36:14.809 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/395 2024-05-15T13:36:14.809 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:14.812 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:14.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:14.823 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-05-15T13:36:15.064 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:15.069 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:15.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:15.253 INFO:teuthology.orchestra.run.smithi077.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/396 2024-05-15T13:36:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/396 2024-05-15T13:36:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:15.261 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:15.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:15.272 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-05-15T13:36:15.526 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:15.532 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:15.532 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:15.746 INFO:teuthology.orchestra.run.smithi077.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:15.751 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/397 2024-05-15T13:36:15.752 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/397 2024-05-15T13:36:15.752 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:15.755 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:15.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:15.765 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-05-15T13:36:16.021 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:16.025 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:16.218 INFO:teuthology.orchestra.run.smithi077.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/398 2024-05-15T13:36:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/398 2024-05-15T13:36:16.223 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:16.226 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:16.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:16.237 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-05-15T13:36:16.499 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:16.508 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:16.508 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:16.714 INFO:teuthology.orchestra.run.smithi077.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:16.719 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/399 2024-05-15T13:36:16.719 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/399 2024-05-15T13:36:16.719 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:16.723 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:16.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:16.737 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-05-15T13:36:16.992 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:16.998 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:16.998 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:17.152 INFO:teuthology.orchestra.run.smithi077.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T13:36:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/400 2024-05-15T13:36:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/400 2024-05-15T13:36:17.162 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:17.165 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:17.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:17.177 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-05-15T13:36:17.427 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:17.432 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:17.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:17.581 INFO:teuthology.orchestra.run.smithi077.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:17.586 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/401 2024-05-15T13:36:17.587 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/401 2024-05-15T13:36:17.587 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:17.588 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:17.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:17.600 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-05-15T13:36:17.796 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:17.800 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:17.801 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:17.926 INFO:teuthology.orchestra.run.smithi077.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/402 2024-05-15T13:36:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/402 2024-05-15T13:36:17.930 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:17.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:17.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:17.941 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-05-15T13:36:18.124 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:18.128 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:18.259 INFO:teuthology.orchestra.run.smithi077.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/403 2024-05-15T13:36:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/403 2024-05-15T13:36:18.262 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:18.265 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:18.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:18.274 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-05-15T13:36:18.460 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:18.464 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:18.464 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:19.294 INFO:teuthology.orchestra.run.smithi077.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-15T13:36:19.297 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/404 2024-05-15T13:36:19.298 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/404 2024-05-15T13:36:19.298 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:19.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:19.343 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-05-15T13:36:19.751 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:19.755 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:19.755 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:19.954 INFO:teuthology.orchestra.run.smithi077.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/405 2024-05-15T13:36:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/405 2024-05-15T13:36:19.958 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:19.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:19.979 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-05-15T13:36:20.163 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:20.167 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:20.167 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:20.294 INFO:teuthology.orchestra.run.smithi077.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/406 2024-05-15T13:36:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/406 2024-05-15T13:36:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:20.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:20.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:20.320 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-05-15T13:36:20.498 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:20.501 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:20.501 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:36:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/407 2024-05-15T13:36:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/407 2024-05-15T13:36:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:20.679 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:20.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:20.688 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-05-15T13:36:21.141 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:21.145 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:21.145 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:21.321 INFO:teuthology.orchestra.run.smithi077.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:36:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/408 2024-05-15T13:36:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/408 2024-05-15T13:36:21.325 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:21.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:21.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:21.370 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-05-15T13:36:21.749 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:21.754 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:21.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:21.876 INFO:teuthology.orchestra.run.smithi077.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/409 2024-05-15T13:36:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/409 2024-05-15T13:36:21.880 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:21.882 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:21.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:21.904 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-05-15T13:36:22.086 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:22.091 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:22.213 INFO:teuthology.orchestra.run.smithi077.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/410 2024-05-15T13:36:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/410 2024-05-15T13:36:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:22.218 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:22.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:22.227 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-05-15T13:36:22.403 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:22.408 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:22.408 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:22.543 INFO:teuthology.orchestra.run.smithi077.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/411 2024-05-15T13:36:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/411 2024-05-15T13:36:22.547 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:22.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:22.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:22.558 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-05-15T13:36:22.740 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:22.744 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:22.744 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:22.867 INFO:teuthology.orchestra.run.smithi077.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/412 2024-05-15T13:36:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/412 2024-05-15T13:36:22.870 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:22.873 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:22.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:22.894 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-05-15T13:36:23.070 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:23.074 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:23.074 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:23.202 INFO:teuthology.orchestra.run.smithi077.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/413 2024-05-15T13:36:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/413 2024-05-15T13:36:23.206 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:23.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:23.217 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-05-15T13:36:23.399 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:23.403 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:23.403 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:23.525 INFO:teuthology.orchestra.run.smithi077.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/414 2024-05-15T13:36:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/414 2024-05-15T13:36:23.529 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:23.531 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:23.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:23.540 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-05-15T13:36:23.719 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:23.723 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:23.848 INFO:teuthology.orchestra.run.smithi077.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/415 2024-05-15T13:36:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/415 2024-05-15T13:36:23.852 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:23.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:23.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:23.863 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-05-15T13:36:24.041 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:24.045 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:24.045 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:24.178 INFO:teuthology.orchestra.run.smithi077.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:24.181 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/416 2024-05-15T13:36:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/416 2024-05-15T13:36:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:24.184 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:24.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:24.193 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-05-15T13:36:24.369 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:24.373 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/417 2024-05-15T13:36:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/417 2024-05-15T13:36:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:24.502 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:24.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:24.511 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-05-15T13:36:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:24.689 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:24.689 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:24.853 INFO:teuthology.orchestra.run.smithi077.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-05-15T13:36:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/418 2024-05-15T13:36:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/418 2024-05-15T13:36:24.857 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:24.859 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:24.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:24.868 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-05-15T13:36:25.045 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:25.049 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:25.049 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:25.266 INFO:teuthology.orchestra.run.smithi077.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/419 2024-05-15T13:36:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/419 2024-05-15T13:36:25.269 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:25.272 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:25.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:25.281 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-05-15T13:36:25.460 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:25.464 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:25.465 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:26.468 INFO:teuthology.orchestra.run.smithi077.stdout:generic/420 1s 2024-05-15T13:36:26.478 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/420 2024-05-15T13:36:26.478 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:26.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:26.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:26.489 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-05-15T13:36:26.945 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:26.949 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:26.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:27.380 INFO:teuthology.orchestra.run.smithi077.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/421 2024-05-15T13:36:27.383 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/421 2024-05-15T13:36:27.384 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:27.386 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:27.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:27.406 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-05-15T13:36:27.579 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:27.583 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:27.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:27.705 INFO:teuthology.orchestra.run.smithi077.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/422 2024-05-15T13:36:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/422 2024-05-15T13:36:27.709 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:27.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:27.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:27.721 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-05-15T13:36:27.901 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:27.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:generic/423 1s 2024-05-15T13:36:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/423 2024-05-15T13:36:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:28.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:28.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:28.207 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-05-15T13:36:28.638 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:28.642 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:28.824 INFO:teuthology.orchestra.run.smithi077.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-05-15T13:36:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/424 2024-05-15T13:36:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/424 2024-05-15T13:36:28.828 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:28.830 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:28.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:28.839 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-05-15T13:36:29.021 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:29.025 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:29.025 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:29.161 INFO:teuthology.orchestra.run.smithi077.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:36:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/425 2024-05-15T13:36:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/425 2024-05-15T13:36:29.165 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:36:29.167 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:36:29.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:36:29.176 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-05-15T13:36:29.355 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:36:29.359 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:36:29.359 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:03.155 INFO:teuthology.orchestra.run.smithi077.stdout:generic/426 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/426.out.bad) 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/426.out 2024-05-15 12:10:37.823388975 +0000 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/426.out.bad 2024-05-15 13:37:03.123345713 +0000 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,5 +1,263 @@ 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 426 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/426-dir -d 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000000) opened an unlinked file! 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000001) opened an unlinked file! 2024-05-15T13:37:03.170 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000002) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000003) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000004) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000005) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000006) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000007) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000008) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000009) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000010) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000011) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000012) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000013) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000014) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000015) opened an unlinked file! 2024-05-15T13:37:03.171 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000016) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000017) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000018) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000019) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000020) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000021) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000022) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000023) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000024) opened an unlinked file! 2024-05-15T13:37:03.172 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000025) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000026) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000027) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000028) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000029) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000030) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000031) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000032) opened an unlinked file! 2024-05-15T13:37:03.173 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000033) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000034) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000035) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000036) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000037) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000038) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000039) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000040) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000041) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000042) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000043) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000044) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000045) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000046) opened an unlinked file! 2024-05-15T13:37:03.174 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000047) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000048) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000049) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000050) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000051) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000052) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000053) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000054) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000055) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000056) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000057) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000058) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000059) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000060) opened an unlinked file! 2024-05-15T13:37:03.175 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000061) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000062) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000063) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000064) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000065) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000066) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000067) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000068) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000069) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000070) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000071) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000072) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000073) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000074) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000075) opened an unlinked file! 2024-05-15T13:37:03.176 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000076) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000077) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000078) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000079) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000080) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000081) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000082) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000083) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000084) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000085) opened an unlinked file! 2024-05-15T13:37:03.177 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000086) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000087) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000088) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000089) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000090) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000091) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000092) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000093) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000094) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000095) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000096) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000097) opened an unlinked file! 2024-05-15T13:37:03.178 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000098) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000099) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000100) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000101) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000102) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000103) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000104) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000105) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000106) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000107) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000108) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000109) opened an unlinked file! 2024-05-15T13:37:03.179 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000110) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000111) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000112) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000113) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000114) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000115) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000116) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000117) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000118) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000119) opened an unlinked file! 2024-05-15T13:37:03.180 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000120) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000121) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000122) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000123) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000124) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000125) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000126) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000127) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000128) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000129) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000130) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000131) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000132) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000133) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000134) opened an unlinked file! 2024-05-15T13:37:03.181 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000135) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000136) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000137) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000138) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000139) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000140) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000141) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000142) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000143) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000144) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000145) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000146) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000147) opened an unlinked file! 2024-05-15T13:37:03.182 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000148) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000149) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000150) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000151) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000152) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000153) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000154) opened an unlinked file! 2024-05-15T13:37:03.183 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000155) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000156) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000157) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000158) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000159) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000160) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000161) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000162) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000163) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000164) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000165) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000166) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000167) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000168) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000169) opened an unlinked file! 2024-05-15T13:37:03.184 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000170) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000171) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000172) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000173) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000174) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000175) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000176) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000177) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000178) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000179) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000180) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000181) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000182) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000183) opened an unlinked file! 2024-05-15T13:37:03.185 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000184) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000185) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000186) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000187) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000188) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000189) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000190) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000191) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000192) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000193) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000194) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000195) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000196) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000197) opened an unlinked file! 2024-05-15T13:37:03.186 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000198) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000199) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000200) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000201) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000202) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000203) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000204) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000205) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000206) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000207) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000208) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000209) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000210) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000211) opened an unlinked file! 2024-05-15T13:37:03.187 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000212) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000213) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000214) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000215) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000216) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000217) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000218) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000219) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000220) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000221) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000222) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000223) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000224) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000225) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000226) opened an unlinked file! 2024-05-15T13:37:03.188 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000227) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000228) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000229) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000230) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000231) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000232) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000233) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file000234) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001001) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001002) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001003) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001004) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001005) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001006) opened an unlinked file! 2024-05-15T13:37:03.189 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001007) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001008) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001009) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001010) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001011) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001012) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001013) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001014) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001015) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001016) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001017) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001018) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001019) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001020) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001021) opened an unlinked file! 2024-05-15T13:37:03.190 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001022) opened an unlinked file! 2024-05-15T13:37:03.191 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/426-dir/file001023) opened an unlinked file! 2024-05-15T13:37:03.191 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/426-dir 2024-05-15T13:37:03.191 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/426-dir -l 2024-05-15T13:37:03.191 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/426-dir -u 2024-05-15T13:37:03.200 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/426 2024-05-15T13:37:03.200 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/426 2024-05-15T13:37:03.200 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:37:03.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:03.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:37:03.421 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:37:03.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:37:03.421 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-05-15T13:37:04.504 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:04.508 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:04.508 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:04.700 INFO:teuthology.orchestra.run.smithi077.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:37:04.703 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/427 2024-05-15T13:37:04.703 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/427 2024-05-15T13:37:04.704 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:04.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:04.716 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-05-15T13:37:04.916 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:04.920 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:04.920 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:05.135 INFO:teuthology.orchestra.run.smithi077.stdout:generic/428 1s 2024-05-15T13:37:05.141 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/428 2024-05-15T13:37:05.141 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:05.143 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:05.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:05.153 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-05-15T13:37:05.350 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:05.354 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:05.354 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:05.516 INFO:teuthology.orchestra.run.smithi077.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:37:05.520 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/429 2024-05-15T13:37:05.520 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/429 2024-05-15T13:37:05.520 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:05.523 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:05.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:05.532 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-05-15T13:37:05.718 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:05.722 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:06.008 INFO:teuthology.orchestra.run.smithi077.stdout:generic/430 1s 2024-05-15T13:37:06.014 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/430 2024-05-15T13:37:06.014 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:06.016 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:06.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:06.025 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-05-15T13:37:06.475 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:06.479 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:06.479 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:06.730 INFO:teuthology.orchestra.run.smithi077.stdout:generic/431 0s 2024-05-15T13:37:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/431 2024-05-15T13:37:06.736 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:06.738 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:06.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:06.747 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-05-15T13:37:07.191 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:07.196 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:07.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:07.459 INFO:teuthology.orchestra.run.smithi077.stdout:generic/432 0s 2024-05-15T13:37:07.464 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/432 2024-05-15T13:37:07.464 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:07.466 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:07.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:07.476 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-05-15T13:37:07.902 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:07.907 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:07.907 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:08.131 INFO:teuthology.orchestra.run.smithi077.stdout:generic/433 1s 2024-05-15T13:37:08.136 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/433 2024-05-15T13:37:08.136 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:08.138 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:08.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:08.147 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-05-15T13:37:08.590 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:08.594 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:08.594 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:08.817 INFO:teuthology.orchestra.run.smithi077.stdout:generic/434 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/434.out.bad) 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/434.out 2024-05-15 12:10:37.823388975 +0000 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/434.out.bad 2024-05-15 13:37:08.812232961 +0000 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -9,6 +9,6 @@ 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: copy_range: Bad file descriptor 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: Try to copy to a device 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: -copy_range: Invalid argument 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: +/tmp/tmp.BgAiu3pKHAtest/test-434/dev1: Permission denied 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: Try to copy to a fifo 2024-05-15T13:37:08.819 INFO:teuthology.orchestra.run.smithi077.stdout: copy_range: Invalid argument 2024-05-15T13:37:08.821 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/434 2024-05-15T13:37:08.821 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/434 2024-05-15T13:37:08.821 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:37:08.823 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:08.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:37:08.833 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:37:08.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:37:08.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-05-15T13:37:09.263 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:09.267 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:09.421 INFO:teuthology.orchestra.run.smithi077.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:37:09.424 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/435 2024-05-15T13:37:09.424 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/435 2024-05-15T13:37:09.424 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:09.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:09.435 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-05-15T13:37:09.612 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:09.616 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:10.580 INFO:teuthology.orchestra.run.smithi077.stdout:generic/436 1s 2024-05-15T13:37:10.585 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/436 2024-05-15T13:37:10.585 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:10.588 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:10.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:10.597 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-05-15T13:37:11.047 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:11.051 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:11.051 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:11.893 INFO:teuthology.orchestra.run.smithi077.stdout:generic/437 0s 2024-05-15T13:37:11.898 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/437 2024-05-15T13:37:11.899 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:11.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:11.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:11.910 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-05-15T13:37:12.091 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:12.095 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:12.095 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:59.632 INFO:teuthology.orchestra.run.smithi077.stdout:generic/438 47s 2024-05-15T13:37:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/438 2024-05-15T13:37:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:59.640 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:59.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:59.650 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-05-15T13:37:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:37:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:37:59.832 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:37:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/439 2024-05-15T13:37:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/439 2024-05-15T13:37:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:37:59.966 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:37:59.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:37:59.976 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-05-15T13:38:00.156 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:00.160 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:00.160 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/440 2024-05-15T13:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/440 2024-05-15T13:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:00.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:00.333 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-05-15T13:38:00.529 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:00.533 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:00.533 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:00.712 INFO:teuthology.orchestra.run.smithi077.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:00.715 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/441 2024-05-15T13:38:00.715 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/441 2024-05-15T13:38:00.716 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:00.718 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:00.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:00.727 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-05-15T13:38:00.907 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:00.911 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:00.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:01.061 INFO:teuthology.orchestra.run.smithi077.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:01.064 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/442 2024-05-15T13:38:01.065 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/442 2024-05-15T13:38:01.065 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:01.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:01.076 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-05-15T13:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:generic/443 0s 2024-05-15T13:38:01.427 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/443 2024-05-15T13:38:01.428 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:01.430 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:01.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:01.439 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-05-15T13:38:01.619 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:01.623 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T13:38:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/444 2024-05-15T13:38:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/444 2024-05-15T13:38:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:01.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:01.809 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-05-15T13:38:01.991 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:01.995 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:01.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:02.984 INFO:teuthology.orchestra.run.smithi077.stdout:generic/445 1s 2024-05-15T13:38:02.990 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/445 2024-05-15T13:38:02.990 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:02.992 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:03.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:03.001 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-05-15T13:38:03.453 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:03.457 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:03.457 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:03.580 INFO:teuthology.orchestra.run.smithi077.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:03.584 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/446 2024-05-15T13:38:03.584 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/446 2024-05-15T13:38:03.584 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:03.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:03.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:03.596 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-05-15T13:38:03.778 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:03.783 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:03.783 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:03.920 INFO:teuthology.orchestra.run.smithi077.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:03.924 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/447 2024-05-15T13:38:03.924 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/447 2024-05-15T13:38:03.924 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:03.926 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:03.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:03.935 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-05-15T13:38:04.117 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:04.121 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:04.121 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:05.121 INFO:teuthology.orchestra.run.smithi077.stdout:generic/448 1s 2024-05-15T13:38:05.126 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/448 2024-05-15T13:38:05.126 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:05.129 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:05.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:05.138 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-05-15T13:38:05.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:38:05.223 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:38:05.602 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:05.606 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:05.606 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:05.736 INFO:teuthology.orchestra.run.smithi077.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:05.740 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/449 2024-05-15T13:38:05.740 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/449 2024-05-15T13:38:05.740 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:05.742 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:05.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:05.751 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-05-15T13:38:05.929 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:05.933 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:05.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:06.764 INFO:teuthology.orchestra.run.smithi077.stdout:generic/450 1s 2024-05-15T13:38:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/450 2024-05-15T13:38:06.769 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:06.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:06.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:06.781 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-05-15T13:38:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:07.245 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:07.245 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:07.558 INFO:teuthology.orchestra.run.smithi077.stdout:generic/451 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/451.out.bad) 2024-05-15T13:38:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/451.out 2024-05-15 12:10:37.824388956 +0000 2024-05-15T13:38:07.559 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/451.out.bad 2024-05-15 13:38:07.552069704 +0000 2024-05-15T13:38:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,2 +1,5 @@ 2024-05-15T13:38:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 451 2024-05-15T13:38:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: +get stale data from buffer read 2024-05-15T13:38:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2024-05-15T13:38:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: +000a0000 2024-05-15T13:38:07.560 INFO:teuthology.orchestra.run.smithi077.stdout: Silence is golden 2024-05-15T13:38:07.562 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/451 2024-05-15T13:38:07.562 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/451 2024-05-15T13:38:07.562 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:38:07.565 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:07.573 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:38:07.573 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:38:07.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:38:07.574 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-05-15T13:38:07.904 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:07.910 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:07.911 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:08.110 INFO:teuthology.orchestra.run.smithi077.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:08.114 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/452 2024-05-15T13:38:08.114 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/452 2024-05-15T13:38:08.114 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:08.116 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:08.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:08.128 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-05-15T13:38:08.311 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:08.316 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:08.316 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:08.436 INFO:teuthology.orchestra.run.smithi077.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:08.440 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/453 2024-05-15T13:38:08.440 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/453 2024-05-15T13:38:08.440 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:08.442 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:08.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:08.451 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-05-15T13:38:08.632 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:08.636 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:08.637 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:08.770 INFO:teuthology.orchestra.run.smithi077.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:08.774 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/454 2024-05-15T13:38:08.774 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/454 2024-05-15T13:38:08.774 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:08.776 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:08.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:08.785 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-05-15T13:38:08.972 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:08.975 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:09.147 INFO:teuthology.orchestra.run.smithi077.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:09.151 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/455 2024-05-15T13:38:09.151 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/455 2024-05-15T13:38:09.151 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:09.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:09.162 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-05-15T13:38:09.342 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:09.346 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:09.489 INFO:teuthology.orchestra.run.smithi077.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/456 2024-05-15T13:38:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/456 2024-05-15T13:38:09.492 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:09.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:09.514 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-05-15T13:38:09.693 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:09.697 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:09.875 INFO:teuthology.orchestra.run.smithi077.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:09.878 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/457 2024-05-15T13:38:09.879 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/457 2024-05-15T13:38:09.879 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:09.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:09.890 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-05-15T13:38:10.069 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:10.073 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:10.198 INFO:teuthology.orchestra.run.smithi077.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:10.201 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/458 2024-05-15T13:38:10.202 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/458 2024-05-15T13:38:10.202 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:10.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:10.213 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-05-15T13:38:10.391 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:10.395 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:10.637 INFO:teuthology.orchestra.run.smithi077.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:10.640 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/459 2024-05-15T13:38:10.640 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/459 2024-05-15T13:38:10.640 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:10.643 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:10.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:10.652 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-05-15T13:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:10.961 INFO:teuthology.orchestra.run.smithi077.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:10.964 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/460 2024-05-15T13:38:10.965 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/460 2024-05-15T13:38:10.965 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:10.967 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:10.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:10.990 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-05-15T13:38:11.179 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:11.183 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:11.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:11.305 INFO:teuthology.orchestra.run.smithi077.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:11.308 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/461 2024-05-15T13:38:11.309 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/461 2024-05-15T13:38:11.309 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:11.311 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:11.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:11.320 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-05-15T13:38:11.499 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:11.503 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:11.503 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:11.635 INFO:teuthology.orchestra.run.smithi077.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:11.639 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/462 2024-05-15T13:38:11.639 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/462 2024-05-15T13:38:11.639 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:11.641 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:11.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:11.650 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-05-15T13:38:11.836 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:11.840 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:11.840 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:12.017 INFO:teuthology.orchestra.run.smithi077.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T13:38:12.021 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/463 2024-05-15T13:38:12.021 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/463 2024-05-15T13:38:12.021 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:12.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:12.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:12.032 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-05-15T13:38:12.486 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:12.490 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:12.490 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:12.621 INFO:teuthology.orchestra.run.smithi077.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:12.624 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/464 2024-05-15T13:38:12.624 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/464 2024-05-15T13:38:12.624 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:12.627 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:12.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:12.636 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-05-15T13:38:12.814 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:12.818 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:27.210 INFO:teuthology.orchestra.run.smithi077.stdout:generic/465 15s 2024-05-15T13:38:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/465 2024-05-15T13:38:27.237 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:27.237 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:27.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:27.253 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-05-15T13:38:27.667 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:27.672 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:27.672 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:27.797 INFO:teuthology.orchestra.run.smithi077.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/466 2024-05-15T13:38:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/466 2024-05-15T13:38:27.801 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:27.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:27.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:27.813 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-05-15T13:38:27.999 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:28.003 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:28.003 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:34.043 INFO:teuthology.orchestra.run.smithi077.stdout:generic/467 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/467.out.bad) 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/467.out 2024-05-15 12:10:37.825388937 +0000 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/467.out.bad 2024-05-15 13:38:34.019545792 +0000 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,5 +1,15 @@ 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 467 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000000) opened an unlinked file! 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000001) opened an unlinked file! 2024-05-15T13:38:34.050 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000002) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000003) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000004) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000005) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000006) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000007) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000008) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: +open_by_handle(/tmp/tmp.BgAiu3pKHAtest/467-dir/file000009) opened an unlinked file! 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-05-15T13:38:34.051 INFO:teuthology.orchestra.run.smithi077.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-05-15T13:38:34.066 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/467 2024-05-15T13:38:34.066 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/467 2024-05-15T13:38:34.066 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:38:34.097 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:34.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:38:34.250 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:38:34.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:38:34.251 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-05-15T13:38:35.239 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:35.243 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:35.243 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:35.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:38:35.375 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:38:35.464 INFO:teuthology.orchestra.run.smithi077.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:35.467 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/468 2024-05-15T13:38:35.467 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/468 2024-05-15T13:38:35.467 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:35.470 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:35.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:35.479 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-05-15T13:38:35.701 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:35.705 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:35.705 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:37.224 INFO:teuthology.orchestra.run.smithi077.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-15T13:38:37.227 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/469 2024-05-15T13:38:37.227 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/469 2024-05-15T13:38:37.228 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:37.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:37.239 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-05-15T13:38:37.706 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:37.710 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:37.710 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/470 2024-05-15T13:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/470 2024-05-15T13:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:38:37.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:38:37.904 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-05-15T13:38:38.101 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:38:38.105 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:38:38.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:05.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:39:05.470 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:39:35.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:39:35.829 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:39:35.857 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T13:39:35.853+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46488) UID: 0 2024-05-15T13:39:35.857 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T13:39:35.853+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46488) UID: 0 2024-05-15T13:39:35.858 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T13:39:35.853+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46488) UID: 0 2024-05-15T13:39:35.858 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T13:39:35.853+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46488) UID: 0 2024-05-15T13:39:36.163 INFO:teuthology.orchestra.run.smithi077.stdout:generic/471 58s 2024-05-15T13:39:36.164 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T13:39:36.159+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 415501) UID: 0 2024-05-15T13:39:36.164 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T13:39:36.159+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 415501) UID: 0 2024-05-15T13:39:36.179 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/471 2024-05-15T13:39:36.179 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:36.182 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:36.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:36.193 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-05-15T13:39:36.664 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:36.669 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:36.669 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:36.944 INFO:teuthology.orchestra.run.smithi077.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:39:36.955 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/472 2024-05-15T13:39:36.955 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/472 2024-05-15T13:39:36.955 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:36.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:36.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:36.973 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-05-15T13:39:37.432 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:37.445 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:37.445 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:37.891 INFO:teuthology.orchestra.run.smithi077.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T13:39:37.896 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/473 2024-05-15T13:39:37.896 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/473 2024-05-15T13:39:37.897 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:37.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:37.921 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-05-15T13:39:38.409 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:38.422 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:38.423 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:38.594 INFO:teuthology.orchestra.run.smithi077.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:39:38.597 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/474 2024-05-15T13:39:38.598 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/474 2024-05-15T13:39:38.598 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:38.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:38.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:38.609 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-05-15T13:39:38.796 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:38.800 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:38.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:38.979 INFO:teuthology.orchestra.run.smithi077.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:39:38.982 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/475 2024-05-15T13:39:38.982 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/475 2024-05-15T13:39:38.982 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:38.984 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:38.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:38.994 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-05-15T13:39:39.176 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:39.180 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:39.180 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:39.313 INFO:teuthology.orchestra.run.smithi077.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:39:39.316 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/476 2024-05-15T13:39:39.316 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/476 2024-05-15T13:39:39.316 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:39.319 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:39.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:39.327 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-05-15T13:39:39.506 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:39.509 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:39.510 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:55.323 INFO:teuthology.orchestra.run.smithi077.stdout:generic/477 16s 2024-05-15T13:39:55.599 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/477 2024-05-15T13:39:55.599 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:39:55.602 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:39:55.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:39:55.724 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-05-15T13:39:57.766 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:39:57.770 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:39:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:generic/478 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/478.out.bad) 2024-05-15T13:40:07.726 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/478.out 2024-05-15 12:10:37.826388918 +0000 2024-05-15T13:40:07.726 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/478.out.bad 2024-05-15 13:40:07.682700896 +0000 2024-05-15T13:40:07.726 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -10,7 +10,7 @@ 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: get wrlck 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: -lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: +get wrlck 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -25,7 +25,7 @@ 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: get wrlck 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.727 INFO:teuthology.orchestra.run.smithi077.stdout: -lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: +get wrlck 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -37,7 +37,7 @@ 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: get rdlck 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: get rdlck 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: -lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: +get rdlck 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: get rdlck 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.728 INFO:teuthology.orchestra.run.smithi077.stdout: get rdlck 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -46,7 +46,7 @@ 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: get rdlck 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: get rdlck 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: -lock could be placed 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: +get rdlck 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.729 INFO:teuthology.orchestra.run.smithi077.stdout: lock could be placed 2024-05-15T13:40:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/478 2024-05-15T13:40:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/478 2024-05-15T13:40:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:40:07.731 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:07.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:40:07.740 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:40:07.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:40:07.741 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-05-15T13:40:07.940 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:07.944 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:07.944 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:08.173 INFO:teuthology.orchestra.run.smithi077.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:08.177 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/479 2024-05-15T13:40:08.177 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/479 2024-05-15T13:40:08.177 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:08.179 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:08.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:08.200 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-05-15T13:40:08.393 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:08.397 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:08.397 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:08.536 INFO:teuthology.orchestra.run.smithi077.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:08.539 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/480 2024-05-15T13:40:08.540 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/480 2024-05-15T13:40:08.540 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:08.542 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:08.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:08.551 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-05-15T13:40:08.733 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:08.737 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:08.737 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:08.881 INFO:teuthology.orchestra.run.smithi077.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:08.884 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/481 2024-05-15T13:40:08.884 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/481 2024-05-15T13:40:08.884 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:08.887 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:08.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:08.896 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-05-15T13:40:09.075 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:09.079 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:09.307 INFO:teuthology.orchestra.run.smithi077.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:09.311 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/482 2024-05-15T13:40:09.311 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/482 2024-05-15T13:40:09.311 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:09.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:09.323 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-05-15T13:40:09.503 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:09.507 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/483 2024-05-15T13:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/483 2024-05-15T13:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:09.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:09.677 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-05-15T13:40:09.852 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:09.857 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:09.993 INFO:teuthology.orchestra.run.smithi077.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:09.997 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/484 2024-05-15T13:40:09.997 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/484 2024-05-15T13:40:09.997 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:10.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:10.009 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-05-15T13:40:10.198 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:10.200 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:11.094 INFO:teuthology.orchestra.run.smithi077.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-15T13:40:11.098 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/485 2024-05-15T13:40:11.098 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/485 2024-05-15T13:40:11.098 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:11.100 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:11.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:11.110 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-05-15T13:40:11.629 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:11.633 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:11.633 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:11.797 INFO:teuthology.orchestra.run.smithi077.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:11.801 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/486 2024-05-15T13:40:11.801 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/486 2024-05-15T13:40:11.801 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:11.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:11.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:11.813 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-05-15T13:40:11.991 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:11.995 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:11.995 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:12.138 INFO:teuthology.orchestra.run.smithi077.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:12.141 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/487 2024-05-15T13:40:12.141 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/487 2024-05-15T13:40:12.141 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:12.144 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:12.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:12.153 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-05-15T13:40:12.335 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:12.338 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:12.339 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:12.467 INFO:teuthology.orchestra.run.smithi077.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:12.471 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/488 2024-05-15T13:40:12.471 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/488 2024-05-15T13:40:12.471 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:12.473 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:12.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:12.482 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-05-15T13:40:12.672 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:12.676 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:12.676 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:12.816 INFO:teuthology.orchestra.run.smithi077.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:12.820 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/489 2024-05-15T13:40:12.820 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/489 2024-05-15T13:40:12.820 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:12.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:12.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:12.832 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-05-15T13:40:13.010 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:13.014 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:13.014 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:14.013 INFO:teuthology.orchestra.run.smithi077.stdout:generic/490 1s 2024-05-15T13:40:14.019 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/490 2024-05-15T13:40:14.019 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:14.021 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:14.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:14.072 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-05-15T13:40:14.501 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:14.505 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:14.506 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:14.687 INFO:teuthology.orchestra.run.smithi077.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:14.691 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/491 2024-05-15T13:40:14.691 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/491 2024-05-15T13:40:14.691 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:14.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:14.703 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-05-15T13:40:14.876 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:14.880 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:14.880 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.002 INFO:teuthology.orchestra.run.smithi077.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:15.006 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/492 2024-05-15T13:40:15.006 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/492 2024-05-15T13:40:15.006 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:15.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:15.017 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-05-15T13:40:15.194 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:15.198 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:15.198 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.329 INFO:teuthology.orchestra.run.smithi077.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:15.333 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/493 2024-05-15T13:40:15.333 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/493 2024-05-15T13:40:15.333 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:15.335 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:15.355 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-05-15T13:40:15.532 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:15.536 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:15.536 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.658 INFO:teuthology.orchestra.run.smithi077.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:15.661 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/494 2024-05-15T13:40:15.661 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/494 2024-05-15T13:40:15.661 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:15.664 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:15.673 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-05-15T13:40:15.849 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:15.853 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:15.853 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.984 INFO:teuthology.orchestra.run.smithi077.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:15.987 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/495 2024-05-15T13:40:15.987 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/495 2024-05-15T13:40:15.987 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:15.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:15.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:15.999 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-05-15T13:40:16.179 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:16.183 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:16.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:16.315 INFO:teuthology.orchestra.run.smithi077.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:16.319 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/496 2024-05-15T13:40:16.319 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/496 2024-05-15T13:40:16.319 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:16.321 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:16.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:16.331 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-05-15T13:40:16.511 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:16.515 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:16.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:16.640 INFO:teuthology.orchestra.run.smithi077.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:16.644 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/497 2024-05-15T13:40:16.644 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/497 2024-05-15T13:40:16.644 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:16.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:16.656 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-05-15T13:40:16.832 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:16.836 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:16.836 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:16.968 INFO:teuthology.orchestra.run.smithi077.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:16.971 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/498 2024-05-15T13:40:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/498 2024-05-15T13:40:16.972 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:16.974 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:16.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:16.996 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-05-15T13:40:17.172 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:17.176 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:17.299 INFO:teuthology.orchestra.run.smithi077.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/499 2024-05-15T13:40:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/499 2024-05-15T13:40:17.303 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:17.305 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:17.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:17.315 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-05-15T13:40:17.492 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:17.497 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:17.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:17.663 INFO:teuthology.orchestra.run.smithi077.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/500 2024-05-15T13:40:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/500 2024-05-15T13:40:17.667 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:17.669 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:17.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:17.679 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-05-15T13:40:17.860 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:17.865 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:18.008 INFO:teuthology.orchestra.run.smithi077.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/501 2024-05-15T13:40:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/501 2024-05-15T13:40:18.012 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:18.014 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:18.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:18.042 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-05-15T13:40:18.225 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:18.229 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/502 2024-05-15T13:40:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/502 2024-05-15T13:40:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:18.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:18.381 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-05-15T13:40:18.565 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:18.569 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:18.690 INFO:teuthology.orchestra.run.smithi077.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/503 2024-05-15T13:40:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/503 2024-05-15T13:40:18.693 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:18.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:18.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:18.705 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-05-15T13:40:18.883 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:18.888 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:18.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:19.075 INFO:teuthology.orchestra.run.smithi077.stdout:generic/504 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/504.out.bad) 2024-05-15T13:40:19.077 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/504.out 2024-05-15 12:10:37.828388879 +0000 2024-05-15T13:40:19.077 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/504.out.bad 2024-05-15 13:40:19.069476695 +0000 2024-05-15T13:40:19.077 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,2 +1,3 @@ 2024-05-15T13:40:19.077 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 504 2024-05-15T13:40:19.077 INFO:teuthology.orchestra.run.smithi077.stdout: +lock info not found 2024-05-15T13:40:19.077 INFO:teuthology.orchestra.run.smithi077.stdout: Silence is golden 2024-05-15T13:40:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/504 2024-05-15T13:40:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/504 2024-05-15T13:40:19.079 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T13:40:19.082 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:19.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T13:40:19.091 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T13:40:19.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T13:40:19.092 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-05-15T13:40:19.269 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:19.273 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/505 2024-05-15T13:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/505 2024-05-15T13:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:19.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:19.409 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-05-15T13:40:19.598 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:19.602 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:19.602 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:19.737 INFO:teuthology.orchestra.run.smithi077.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/506 2024-05-15T13:40:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/506 2024-05-15T13:40:19.741 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:19.743 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:19.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:19.752 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-05-15T13:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:20.135 INFO:teuthology.orchestra.run.smithi077.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-05-15T13:40:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/507 2024-05-15T13:40:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/507 2024-05-15T13:40:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:20.141 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:20.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:20.150 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-05-15T13:40:20.323 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:20.327 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:20.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-05-15T13:40:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/508 2024-05-15T13:40:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/508 2024-05-15T13:40:20.480 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:20.482 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:20.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:20.499 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-05-15T13:40:20.677 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:20.681 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:20.682 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:20.814 INFO:teuthology.orchestra.run.smithi077.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/509 2024-05-15T13:40:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/509 2024-05-15T13:40:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:20.820 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:20.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:20.829 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-05-15T13:40:21.004 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:21.008 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:21.008 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:21.151 INFO:teuthology.orchestra.run.smithi077.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/510 2024-05-15T13:40:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/510 2024-05-15T13:40:21.155 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:21.157 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:21.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:21.167 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-05-15T13:40:21.343 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:21.347 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:21.473 INFO:teuthology.orchestra.run.smithi077.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/511 2024-05-15T13:40:21.476 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/511 2024-05-15T13:40:21.477 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:21.479 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:21.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:21.498 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-05-15T13:40:21.683 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:21.687 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:21.688 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:21.821 INFO:teuthology.orchestra.run.smithi077.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/512 2024-05-15T13:40:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/512 2024-05-15T13:40:21.825 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:21.828 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:21.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:21.837 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-05-15T13:40:22.014 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:22.018 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:22.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:22.144 INFO:teuthology.orchestra.run.smithi077.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/513 2024-05-15T13:40:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/513 2024-05-15T13:40:22.148 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:22.150 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:22.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:22.159 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-05-15T13:40:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:22.344 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:22.344 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:22.478 INFO:teuthology.orchestra.run.smithi077.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/514 2024-05-15T13:40:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/514 2024-05-15T13:40:22.482 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:22.484 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:22.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:22.494 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-05-15T13:40:22.670 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:22.674 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:22.675 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:22.808 INFO:teuthology.orchestra.run.smithi077.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/515 2024-05-15T13:40:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/515 2024-05-15T13:40:22.811 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:22.814 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:22.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:22.823 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-05-15T13:40:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:23.018 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:23.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-05-15T13:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/516 2024-05-15T13:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/516 2024-05-15T13:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:23.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:23.206 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-05-15T13:40:23.684 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:23.822 INFO:teuthology.orchestra.run.smithi077.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/517 2024-05-15T13:40:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/517 2024-05-15T13:40:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:23.828 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:23.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:23.838 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-05-15T13:40:24.018 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:24.022 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:24.022 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:24.148 INFO:teuthology.orchestra.run.smithi077.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/518 2024-05-15T13:40:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/518 2024-05-15T13:40:24.152 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:24.154 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:24.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:24.164 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-05-15T13:40:24.341 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:24.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:24.476 INFO:teuthology.orchestra.run.smithi077.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/519 2024-05-15T13:40:24.479 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/519 2024-05-15T13:40:24.480 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:24.482 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:24.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:24.492 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-05-15T13:40:24.670 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:24.674 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:24.674 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T13:40:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/520 2024-05-15T13:40:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/520 2024-05-15T13:40:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T13:40:24.814 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:40:24.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T13:40:24.823 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-05-15T13:40:24.998 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T13:40:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T13:40:25.002 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T13:42:55.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:42:55.858 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:43:25.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:43:25.999 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:43:56.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:43:56.151 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:44:26.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:44:26.290 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:44:26.321 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T13:44:26.316+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 438487) UID: 0 2024-05-15T13:44:26.321 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T13:44:26.316+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 438487) UID: 0 2024-05-15T13:44:26.322 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T13:44:26.316+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 438487) UID: 0 2024-05-15T13:44:26.322 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T13:44:26.316+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 438487) UID: 0 2024-05-15T13:47:07.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:47:07.979 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:47:38.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:47:38.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:48:08.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:48:08.243 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:48:38.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:48:38.298 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:49:08.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:49:08.363 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:49:38.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:49:38.493 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:50:08.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:50:08.633 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:50:38.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:50:38.755 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:51:08.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:51:08.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:51:38.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:51:38.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:52:09.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:52:09.005 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:52:39.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:52:39.259 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:53:09.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:53:09.395 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:53:39.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:53:39.531 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:54:09.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:54:09.654 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:54:39.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:54:39.729 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:55:09.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:55:09.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:55:39.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:55:39.973 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:56:10.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:56:10.052 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:56:40.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:56:40.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:57:10.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:57:10.491 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:57:40.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:57:40.622 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:58:10.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:58:10.729 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:58:41.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:58:41.004 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:59:11.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:59:11.118 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:59:41.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T13:59:41.286 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:00:11.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:00:11.400 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:00:41.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:00:41.474 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:01:11.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:01:11.606 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:01:42.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:01:42.013 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:02:12.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:02:12.092 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:02:42.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:02:42.511 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:03:12.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:03:12.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:03:42.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:03:42.684 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:04:12.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:04:12.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:04:42.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:04:42.932 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:05:12.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:05:12.997 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:05:43.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:05:43.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:06:13.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:06:13.263 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:06:43.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:06:43.354 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:07:13.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:07:13.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:07:43.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:07:43.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:08:14.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:08:14.104 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:08:44.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:08:44.169 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:09:14.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:09:14.422 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:09:14.451 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T14:09:14.449+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439344) UID: 0 2024-05-15T14:09:14.452 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T14:09:14.449+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439344) UID: 0 2024-05-15T14:09:14.452 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T14:09:14.449+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439344) UID: 0 2024-05-15T14:09:14.452 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T14:09:14.449+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439344) UID: 0 2024-05-15T14:11:34.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:11:34.131 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:12:04.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:12:04.244 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:12:34.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:12:34.316 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:13:04.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:13:04.456 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:13:34.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:13:34.599 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:14:04.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:14:04.726 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:14:35.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:14:35.072 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:15:05.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:15:05.130 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:15:35.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:15:35.306 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:16:05.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:16:05.644 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:16:35.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:16:35.701 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:17:05.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:17:05.845 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:17:36.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:17:36.101 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:18:06.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:18:06.158 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:18:36.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:18:36.280 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:19:06.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:19:06.406 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:19:36.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:19:36.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:20:06.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:20:06.647 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:20:36.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:20:36.719 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:21:06.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:21:06.784 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:21:37.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:21:37.055 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:22:07.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:22:07.128 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:22:37.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:22:37.192 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:23:07.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:23:07.437 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:23:37.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:23:37.497 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:24:07.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:24:07.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:24:37.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:24:37.975 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:25:08.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:25:08.139 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:25:38.258 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:25:38.261 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:25:52.132 INFO:teuthology.orchestra.run.smithi077.stdout:generic/521 2727s 2024-05-15T14:25:52.151 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/521 2024-05-15T14:25:52.151 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:25:52.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:25:52.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:25:52.164 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-05-15T14:25:52.606 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:25:52.610 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:25:52.610 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:26:08.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:26:08.409 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:26:38.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:26:38.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:27:08.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:27:08.570 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:27:38.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:27:38.660 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:28:08.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:28:08.782 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:28:38.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:28:38.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:29:09.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:29:09.152 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:29:39.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:29:39.617 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:30:09.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:30:09.673 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:30:39.736 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:30:39.739 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:31:09.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:31:09.876 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:31:40.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:31:40.007 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:32:10.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:32:10.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:32:40.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:32:40.270 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:33:10.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:33:10.325 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:33:40.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:33:40.390 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:34:10.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:34:10.504 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:34:40.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:34:40.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:35:10.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:35:10.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:35:40.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:35:40.971 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:36:11.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:36:11.029 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:36:41.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:36:41.300 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:37:11.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:37:11.586 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:37:41.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:37:41.663 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:38:11.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:38:11.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:38:11.827 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T14:38:11.826+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 440809) UID: 0 2024-05-15T14:38:11.827 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T14:38:11.826+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 440809) UID: 0 2024-05-15T14:40:53.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:40:53.832 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:41:23.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:41:23.901 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:41:54.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:41:54.217 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:42:24.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:42:24.279 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:42:54.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:42:54.343 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:43:24.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:43:24.408 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:43:54.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:43:54.528 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:44:24.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:44:24.627 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:44:54.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:44:54.736 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:45:24.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:45:24.840 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:45:54.925 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:45:54.928 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:46:25.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:46:25.131 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:46:55.195 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:46:55.199 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:47:25.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:47:25.613 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:47:25.642 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T14:47:25.641+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48677) UID: 0 2024-05-15T14:47:25.643 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T14:47:25.641+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48677) UID: 0 2024-05-15T14:47:25.643 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T14:47:25.641+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48677) UID: 0 2024-05-15T14:47:25.644 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T14:47:25.641+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48677) UID: 0 2024-05-15T14:49:38.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:49:38.441 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:50:08.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:50:08.569 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:50:38.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:50:38.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:51:08.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:51:08.747 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:51:38.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:51:38.841 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:52:08.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:52:08.902 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:52:39.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:52:39.032 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:53:09.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:53:09.121 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:53:39.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:53:39.178 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:54:09.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:54:09.285 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:54:39.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:54:39.418 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:55:09.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:55:09.482 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:55:39.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:55:39.634 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:56:09.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:56:09.866 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:56:15.046 INFO:teuthology.orchestra.run.smithi077.stdout:generic/522 1823s 2024-05-15T14:56:15.051 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/522 2024-05-15T14:56:15.051 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:15.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:15.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:15.063 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-05-15T14:56:15.241 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:15.245 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:15.245 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:15.394 INFO:teuthology.orchestra.run.smithi077.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:15.398 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/523 2024-05-15T14:56:15.398 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/523 2024-05-15T14:56:15.398 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:15.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:15.409 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-05-15T14:56:15.582 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:15.586 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:15.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:15.715 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/524 2024-05-15T14:56:15.716 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/524 2024-05-15T14:56:15.716 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:15.718 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:15.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:15.727 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-05-15T14:56:15.910 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:15.915 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:16.043 INFO:teuthology.orchestra.run.smithi077.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:16.046 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/525 2024-05-15T14:56:16.047 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/525 2024-05-15T14:56:16.047 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:16.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:16.058 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-05-15T14:56:16.237 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:16.241 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:16.241 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:16.406 INFO:teuthology.orchestra.run.smithi077.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:16.410 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/526 2024-05-15T14:56:16.410 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/526 2024-05-15T14:56:16.410 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:16.412 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:16.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:16.421 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-05-15T14:56:16.598 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:16.603 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:16.733 INFO:teuthology.orchestra.run.smithi077.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:16.736 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/527 2024-05-15T14:56:16.737 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/527 2024-05-15T14:56:16.737 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:16.739 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:16.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:16.748 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-05-15T14:56:16.928 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:16.932 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:16.932 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:17.081 INFO:teuthology.orchestra.run.smithi077.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-05-15T14:56:17.084 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/528 2024-05-15T14:56:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/528 2024-05-15T14:56:17.085 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:17.087 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:17.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:17.096 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-05-15T14:56:17.275 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:17.279 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:17.279 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:17.439 INFO:teuthology.orchestra.run.smithi077.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T14:56:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/529 2024-05-15T14:56:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/529 2024-05-15T14:56:17.443 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:17.445 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:17.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:17.454 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-05-15T14:56:17.641 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:17.645 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:17.645 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:17.765 INFO:teuthology.orchestra.run.smithi077.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/530 2024-05-15T14:56:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/530 2024-05-15T14:56:17.768 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:17.771 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:17.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:17.779 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-05-15T14:56:17.957 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:17.961 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:17.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:18.084 INFO:teuthology.orchestra.run.smithi077.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:18.087 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/531 2024-05-15T14:56:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/531 2024-05-15T14:56:18.088 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:18.090 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:18.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:18.099 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-05-15T14:56:18.284 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:18.288 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:18.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:18.469 INFO:teuthology.orchestra.run.smithi077.stdout:generic/532 0s 2024-05-15T14:56:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/532 2024-05-15T14:56:18.474 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:18.477 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:18.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:18.486 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-05-15T14:56:18.669 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:18.673 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:18.673 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:19.045 INFO:teuthology.orchestra.run.smithi077.stdout:generic/533 1s 2024-05-15T14:56:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/533 2024-05-15T14:56:19.051 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:19.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:19.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:19.062 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-05-15T14:56:19.243 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:19.247 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:19.247 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:19.383 INFO:teuthology.orchestra.run.smithi077.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/534 2024-05-15T14:56:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/534 2024-05-15T14:56:19.387 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:19.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:19.398 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-05-15T14:56:19.579 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:19.584 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:19.584 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/535 2024-05-15T14:56:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/535 2024-05-15T14:56:19.723 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:19.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:19.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:19.734 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-05-15T14:56:19.918 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:19.922 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:20.043 INFO:teuthology.orchestra.run.smithi077.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/536 2024-05-15T14:56:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/536 2024-05-15T14:56:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:20.049 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:20.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:20.058 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-05-15T14:56:20.242 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:20.246 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:20.246 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:20.371 INFO:teuthology.orchestra.run.smithi077.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T14:56:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/537 2024-05-15T14:56:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/537 2024-05-15T14:56:20.375 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T14:56:20.378 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:20.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T14:56:20.399 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-05-15T14:56:20.573 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T14:56:20.578 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T14:56:20.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T14:56:39.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:56:39.921 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:57:10.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:57:10.048 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:57:40.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:57:40.161 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:58:10.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:58:10.220 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:58:40.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:58:40.362 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:59:10.485 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:59:10.488 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:59:40.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T14:59:40.542 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:00:10.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:00:10.657 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:00:40.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:00:40.824 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:01:10.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:01:10.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:01:40.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:01:40.989 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:02:11.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:02:11.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:02:41.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:02:41.301 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:03:11.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:03:11.379 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:03:41.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:03:41.485 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:04:11.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:04:11.627 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:04:41.719 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:04:41.723 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:05:11.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:05:11.830 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:05:41.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:05:41.994 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:06:12.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:06:12.075 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:06:42.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:06:42.222 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:07:12.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:07:12.362 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:07:42.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:07:42.617 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:08:12.762 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:08:12.766 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:08:43.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:08:43.129 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:09:13.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:09:13.184 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:09:43.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:09:43.275 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:10:13.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:10:13.406 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:10:43.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:10:43.473 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:11:13.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:11:13.593 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:11:43.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:11:43.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:12:13.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:12:13.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:12:43.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:12:43.852 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:13:13.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:13:13.917 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:13:44.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:13:44.057 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:14:14.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:14:14.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:14:44.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:14:44.300 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:15:14.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:15:14.380 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:15:44.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:15:44.468 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:16:14.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:16:14.587 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:16:44.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:16:44.744 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:17:15.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:17:15.211 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:17:45.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:17:45.447 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:18:15.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:18:15.569 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:18:45.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:18:45.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:19:15.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:19:15.797 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:19:45.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:19:45.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:20:15.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:20:15.986 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:20:46.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:20:46.276 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:21:16.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:21:16.338 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:21:46.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:21:46.422 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:22:16.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:22:16.589 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:22:46.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:22:46.706 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:23:16.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:23:16.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:23:47.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:23:47.035 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:24:17.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:24:17.325 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:24:47.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:24:47.405 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:25:17.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:25:17.464 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:25:47.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:25:47.542 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:26:17.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:26:17.656 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:26:47.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:26:47.787 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:27:17.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:27:18.000 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:27:48.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:27:48.116 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:28:18.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:28:18.180 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:28:48.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:28:48.286 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:29:18.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:29:18.350 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:29:48.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:29:48.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:30:18.548 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:30:18.552 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:30:48.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:30:48.615 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:31:18.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:31:18.767 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:31:48.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:31:48.873 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:32:18.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:32:18.996 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:32:49.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:32:49.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:33:19.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:33:19.133 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:33:49.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:33:49.207 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:34:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:generic/538 2267s 2024-05-15T15:34:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/538 2024-05-15T15:34:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:07.741 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:07.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:07.750 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-05-15T15:34:08.175 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:08.179 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:08.180 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:09.844 INFO:teuthology.orchestra.run.smithi077.stdout:generic/539 1s 2024-05-15T15:34:09.849 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/539 2024-05-15T15:34:09.849 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:09.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:09.862 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-05-15T15:34:10.306 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:10.310 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:10.444 INFO:teuthology.orchestra.run.smithi077.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:10.448 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/540 2024-05-15T15:34:10.448 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/540 2024-05-15T15:34:10.449 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:10.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:10.460 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-05-15T15:34:10.641 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:10.645 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:10.767 INFO:teuthology.orchestra.run.smithi077.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:10.770 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/541 2024-05-15T15:34:10.771 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/541 2024-05-15T15:34:10.771 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:10.773 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:10.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:10.782 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-05-15T15:34:10.961 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:10.965 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:10.965 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:11.090 INFO:teuthology.orchestra.run.smithi077.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:11.094 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/542 2024-05-15T15:34:11.095 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/542 2024-05-15T15:34:11.095 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:11.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:11.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:11.105 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-05-15T15:34:11.289 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:11.293 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:11.293 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:11.422 INFO:teuthology.orchestra.run.smithi077.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:11.426 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/543 2024-05-15T15:34:11.426 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/543 2024-05-15T15:34:11.426 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:11.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:11.437 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-05-15T15:34:11.617 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:11.621 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:11.621 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:11.748 INFO:teuthology.orchestra.run.smithi077.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:11.751 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/544 2024-05-15T15:34:11.751 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/544 2024-05-15T15:34:11.751 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:11.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:11.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:11.762 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-05-15T15:34:11.943 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:11.947 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:11.947 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:12.153 INFO:teuthology.orchestra.run.smithi077.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-05-15T15:34:12.156 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/545 2024-05-15T15:34:12.157 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/545 2024-05-15T15:34:12.157 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:12.159 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:12.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:12.168 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-05-15T15:34:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:12.356 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:12.356 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:12.539 INFO:teuthology.orchestra.run.smithi077.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:12.542 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/546 2024-05-15T15:34:12.542 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/546 2024-05-15T15:34:12.542 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:12.545 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:12.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:12.554 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-05-15T15:34:12.731 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:12.735 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:12.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:12.878 INFO:teuthology.orchestra.run.smithi077.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:12.881 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/547 2024-05-15T15:34:12.881 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/547 2024-05-15T15:34:12.882 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:12.884 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:12.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:12.893 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-05-15T15:34:13.074 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:13.078 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:13.078 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:13.244 INFO:teuthology.orchestra.run.smithi077.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:13.248 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/548 2024-05-15T15:34:13.248 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/548 2024-05-15T15:34:13.248 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:13.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:13.260 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-05-15T15:34:13.440 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:13.444 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:13.594 INFO:teuthology.orchestra.run.smithi077.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:13.598 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/549 2024-05-15T15:34:13.598 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/549 2024-05-15T15:34:13.598 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:13.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:13.623 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-05-15T15:34:13.814 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:13.818 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:13.964 INFO:teuthology.orchestra.run.smithi077.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:13.968 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/550 2024-05-15T15:34:13.968 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/550 2024-05-15T15:34:13.968 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:13.970 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:13.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:13.980 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-05-15T15:34:14.157 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:14.161 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:14.161 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:14.282 INFO:teuthology.orchestra.run.smithi077.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/551 2024-05-15T15:34:14.286 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/551 2024-05-15T15:34:14.286 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:14.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:14.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:14.297 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-05-15T15:34:14.481 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:14.485 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:14.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:14.625 INFO:teuthology.orchestra.run.smithi077.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:14.628 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/552 2024-05-15T15:34:14.629 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/552 2024-05-15T15:34:14.629 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:14.631 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:14.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:14.640 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-05-15T15:34:14.824 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:14.828 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:14.828 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:15.018 INFO:teuthology.orchestra.run.smithi077.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-05-15T15:34:15.022 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/553 2024-05-15T15:34:15.022 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/553 2024-05-15T15:34:15.022 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:15.025 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:15.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:15.033 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-05-15T15:34:15.480 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:15.484 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:15.485 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:15.609 INFO:teuthology.orchestra.run.smithi077.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:15.612 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/554 2024-05-15T15:34:15.612 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/554 2024-05-15T15:34:15.613 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:15.615 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:15.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:15.624 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-05-15T15:34:15.801 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:15.805 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:15.805 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:15.970 INFO:teuthology.orchestra.run.smithi077.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-05-15T15:34:15.973 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/555 2024-05-15T15:34:15.973 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/555 2024-05-15T15:34:15.973 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:15.976 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:15.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:15.985 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-05-15T15:34:16.424 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:16.429 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:16.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:16.550 INFO:teuthology.orchestra.run.smithi077.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:16.554 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/556 2024-05-15T15:34:16.554 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/556 2024-05-15T15:34:16.554 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:16.556 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:16.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:16.565 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-05-15T15:34:16.757 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:16.762 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:16.762 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:16.897 INFO:teuthology.orchestra.run.smithi077.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:16.900 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/557 2024-05-15T15:34:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/557 2024-05-15T15:34:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:16.903 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:16.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:16.912 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-05-15T15:34:17.099 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:17.103 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:17.103 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:17.247 INFO:teuthology.orchestra.run.smithi077.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/558 2024-05-15T15:34:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/558 2024-05-15T15:34:17.251 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:17.253 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:17.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:17.262 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-05-15T15:34:17.438 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:17.442 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:17.443 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:17.565 INFO:teuthology.orchestra.run.smithi077.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:17.568 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/559 2024-05-15T15:34:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/559 2024-05-15T15:34:17.569 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:17.571 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:17.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:17.580 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-05-15T15:34:17.763 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:17.767 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:17.767 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:17.914 INFO:teuthology.orchestra.run.smithi077.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/560 2024-05-15T15:34:17.917 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/560 2024-05-15T15:34:17.918 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:17.920 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:17.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:17.929 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-05-15T15:34:18.108 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:18.229 INFO:teuthology.orchestra.run.smithi077.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/561 2024-05-15T15:34:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/561 2024-05-15T15:34:18.233 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:18.235 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:18.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:18.264 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-05-15T15:34:18.446 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:18.450 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:18.450 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:18.569 INFO:teuthology.orchestra.run.smithi077.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/562 2024-05-15T15:34:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/562 2024-05-15T15:34:18.573 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:18.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:18.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:18.584 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-05-15T15:34:18.774 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:18.778 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:18.941 INFO:teuthology.orchestra.run.smithi077.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/563 2024-05-15T15:34:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/563 2024-05-15T15:34:18.945 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:18.947 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:18.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:18.956 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-05-15T15:34:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:19.153 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:19.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:19.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:34:19.368 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:34:19.628 INFO:teuthology.orchestra.run.smithi077.stdout:generic/564 0s 2024-05-15T15:34:19.633 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/564 2024-05-15T15:34:19.634 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:19.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:19.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:19.646 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-05-15T15:34:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:20.123 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/565 2024-05-15T15:34:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/565 2024-05-15T15:34:20.261 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:20.264 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:20.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:20.282 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-05-15T15:34:20.484 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:20.488 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:20.488 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:20.632 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/566 2024-05-15T15:34:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/566 2024-05-15T15:34:20.633 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:20.635 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:20.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:20.644 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-05-15T15:34:20.823 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:20.827 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:20.827 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:20.956 INFO:teuthology.orchestra.run.smithi077.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/567 2024-05-15T15:34:20.959 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/567 2024-05-15T15:34:20.960 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:20.962 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:20.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:20.971 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-05-15T15:34:21.146 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:21.150 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:21.151 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:21.347 INFO:teuthology.orchestra.run.smithi077.stdout:generic/568 0s 2024-05-15T15:34:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/568 2024-05-15T15:34:21.367 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:21.370 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:21.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:21.386 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-05-15T15:34:21.785 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:21.789 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:21.789 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:21.948 INFO:teuthology.orchestra.run.smithi077.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/569 2024-05-15T15:34:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/569 2024-05-15T15:34:21.952 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:21.954 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:21.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:21.963 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-05-15T15:34:22.147 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:22.151 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:22.151 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:22.287 INFO:teuthology.orchestra.run.smithi077.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/570 2024-05-15T15:34:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/570 2024-05-15T15:34:22.291 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:22.294 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:22.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:22.315 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-05-15T15:34:22.492 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:22.496 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:22.496 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:28.749 INFO:teuthology.orchestra.run.smithi077.stdout:generic/571 6s 2024-05-15T15:34:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/571 2024-05-15T15:34:28.755 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:28.758 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:28.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:28.768 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-05-15T15:34:29.205 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:29.210 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:29.331 INFO:teuthology.orchestra.run.smithi077.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/572 2024-05-15T15:34:29.334 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/572 2024-05-15T15:34:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:29.337 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:29.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:29.346 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-05-15T15:34:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:29.533 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:29.653 INFO:teuthology.orchestra.run.smithi077.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/573 2024-05-15T15:34:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/573 2024-05-15T15:34:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:29.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:29.668 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-05-15T15:34:29.850 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:29.854 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:29.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:29.983 INFO:teuthology.orchestra.run.smithi077.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/574 2024-05-15T15:34:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/574 2024-05-15T15:34:29.987 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:29.990 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:29.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:29.999 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-05-15T15:34:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:30.177 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:30.177 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:30.309 INFO:teuthology.orchestra.run.smithi077.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/575 2024-05-15T15:34:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/575 2024-05-15T15:34:30.313 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:30.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:30.324 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-05-15T15:34:30.508 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:30.512 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:30.512 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:30.668 INFO:teuthology.orchestra.run.smithi077.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:30.672 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/576 2024-05-15T15:34:30.672 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/576 2024-05-15T15:34:30.672 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:30.674 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:30.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:30.683 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-05-15T15:34:30.856 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:30.860 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:30.860 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:30.993 INFO:teuthology.orchestra.run.smithi077.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:30.996 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/577 2024-05-15T15:34:30.997 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/577 2024-05-15T15:34:30.997 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:30.999 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:31.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:31.008 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-05-15T15:34:31.192 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:31.196 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:31.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:31.449 INFO:teuthology.orchestra.run.smithi077.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-15T15:34:31.452 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/578 2024-05-15T15:34:31.452 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/578 2024-05-15T15:34:31.453 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:31.455 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:31.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:31.463 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-05-15T15:34:31.639 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:31.643 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:31.643 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:31.783 INFO:teuthology.orchestra.run.smithi077.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:31.787 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/579 2024-05-15T15:34:31.787 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/579 2024-05-15T15:34:31.787 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:31.789 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:31.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:31.798 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-05-15T15:34:31.976 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:31.980 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:31.980 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:32.128 INFO:teuthology.orchestra.run.smithi077.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:32.132 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/580 2024-05-15T15:34:32.132 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/580 2024-05-15T15:34:32.132 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:32.134 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:32.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:32.143 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-05-15T15:34:32.325 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:32.329 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:32.329 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:33.042 INFO:teuthology.orchestra.run.smithi077.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:33.045 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/581 2024-05-15T15:34:33.045 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/581 2024-05-15T15:34:33.045 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:33.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:33.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:33.057 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-05-15T15:34:33.235 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:33.239 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:33.240 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:33.394 INFO:teuthology.orchestra.run.smithi077.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:33.397 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/582 2024-05-15T15:34:33.397 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/582 2024-05-15T15:34:33.398 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:33.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:33.409 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-05-15T15:34:33.582 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:33.586 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:33.586 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:33.737 INFO:teuthology.orchestra.run.smithi077.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:33.741 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/583 2024-05-15T15:34:33.741 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/583 2024-05-15T15:34:33.741 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:33.744 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:33.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:33.752 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-05-15T15:34:33.937 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:33.941 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:34.090 INFO:teuthology.orchestra.run.smithi077.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:34.094 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/584 2024-05-15T15:34:34.094 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/584 2024-05-15T15:34:34.094 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:34.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:34.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:34.106 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-05-15T15:34:34.286 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:34.290 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:34.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:34.426 INFO:teuthology.orchestra.run.smithi077.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:34.429 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/585 2024-05-15T15:34:34.429 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/585 2024-05-15T15:34:34.429 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:34.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:34.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:34.441 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-05-15T15:34:34.631 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:34.635 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:34.635 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:49.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:34:49.525 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:34:55.292 INFO:teuthology.orchestra.run.smithi077.stdout:generic/586 21s 2024-05-15T15:34:55.297 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/586 2024-05-15T15:34:55.297 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:55.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:55.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:55.310 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-05-15T15:34:55.748 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:56.072 INFO:teuthology.orchestra.run.smithi077.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T15:34:56.076 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/587 2024-05-15T15:34:56.076 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/587 2024-05-15T15:34:56.076 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:56.078 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:56.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:56.088 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-05-15T15:34:56.267 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:56.271 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:56.415 INFO:teuthology.orchestra.run.smithi077.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:56.418 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/588 2024-05-15T15:34:56.419 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/588 2024-05-15T15:34:56.419 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:56.421 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:56.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:56.430 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-05-15T15:34:56.607 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:56.611 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:56.611 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:56.761 INFO:teuthology.orchestra.run.smithi077.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:56.765 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/589 2024-05-15T15:34:56.765 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/589 2024-05-15T15:34:56.765 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:56.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:56.776 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-05-15T15:34:56.959 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:56.963 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:56.963 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:57.104 INFO:teuthology.orchestra.run.smithi077.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:57.108 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/590 2024-05-15T15:34:57.108 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/590 2024-05-15T15:34:57.108 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:57.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:57.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:57.119 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-05-15T15:34:57.297 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:57.301 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:57.580 INFO:teuthology.orchestra.run.smithi077.stdout:generic/591 0s 2024-05-15T15:34:57.585 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/591 2024-05-15T15:34:57.586 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:57.588 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:57.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:57.597 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-05-15T15:34:58.024 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:58.028 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:58.028 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:58.176 INFO:teuthology.orchestra.run.smithi077.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:58.179 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/592 2024-05-15T15:34:58.180 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/592 2024-05-15T15:34:58.180 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:58.182 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:58.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:58.191 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-05-15T15:34:58.372 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:58.376 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:58.376 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:58.527 INFO:teuthology.orchestra.run.smithi077.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:58.531 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/593 2024-05-15T15:34:58.531 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/593 2024-05-15T15:34:58.531 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:58.534 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:58.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:58.543 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-05-15T15:34:58.718 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:58.723 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:58.723 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:58.858 INFO:teuthology.orchestra.run.smithi077.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:58.862 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/594 2024-05-15T15:34:58.862 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/594 2024-05-15T15:34:58.862 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:58.864 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:58.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:58.873 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-05-15T15:34:59.058 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:59.062 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:59.062 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:59.216 INFO:teuthology.orchestra.run.smithi077.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:34:59.220 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/595 2024-05-15T15:34:59.220 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/595 2024-05-15T15:34:59.220 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:59.223 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:59.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:59.231 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-05-15T15:34:59.419 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:59.423 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:59.423 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:59.632 INFO:teuthology.orchestra.run.smithi077.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-05-15T15:34:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/596 2024-05-15T15:34:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/596 2024-05-15T15:34:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:34:59.638 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:34:59.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:34:59.647 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-05-15T15:34:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:34:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:34:59.827 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:00.502 INFO:teuthology.orchestra.run.smithi077.stdout:generic/597 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/597.out.bad) 2024-05-15T15:35:00.504 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/597.out 2024-05-15 12:10:37.834388764 +0000 2024-05-15T15:35:00.504 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/597.out.bad 2024-05-15 15:35:00.499573552 +0000 2024-05-15T15:35:00.504 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -4,11 +4,11 @@ 2024-05-15T15:35:00.504 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_symlinks = 0 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: successfully followed symlink 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_symlinks = 1 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: +successfully followed symlink 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: == Test hardlink create protection when 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: == process != target owner and process cannot read target 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_hardlinks = 0 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: -successfully created hardlink 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: +Permission denied 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_hardlinks = 1 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-05-15T15:35:00.505 INFO:teuthology.orchestra.run.smithi077.stdout: +Permission denied 2024-05-15T15:35:00.507 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/597 2024-05-15T15:35:00.507 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/597 2024-05-15T15:35:00.507 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T15:35:00.509 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:00.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:35:00.518 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T15:35:00.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T15:35:00.518 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-05-15T15:35:00.963 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:00.967 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:00.967 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:01.625 INFO:teuthology.orchestra.run.smithi077.stdout:generic/598 - output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/598.out.bad) 2024-05-15T15:35:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/598.out 2024-05-15 12:10:37.834388764 +0000 2024-05-15T15:35:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/598.out.bad 2024-05-15 15:35:01.621551847 +0000 2024-05-15T15:35:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -5,13 +5,10 @@ 2024-05-15T15:35:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: = only group writable dir 2024-05-15T15:35:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_regular = 1 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: = group & world writable dir 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: = only group writable dir 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_regular = 2 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: = group & world writable dir 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: = only group writable dir 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_fifos = 0 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -19,10 +16,7 @@ 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: = only group writable dir 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_fifos = 1 2024-05-15T15:35:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: = group & world writable dir 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: = only group writable dir 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: fs.protected_fifos = 2 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: = group & world writable dir 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: = only group writable dir 2024-05-15T15:35:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: -Permission denied 2024-05-15T15:35:01.630 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/598 2024-05-15T15:35:01.630 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/598 2024-05-15T15:35:01.630 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T15:35:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:01.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:35:01.641 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T15:35:01.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T15:35:01.641 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-05-15T15:35:02.088 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:02.092 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:02.092 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:02.226 INFO:teuthology.orchestra.run.smithi077.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:02.230 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/599 2024-05-15T15:35:02.230 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/599 2024-05-15T15:35:02.230 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:02.232 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:02.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:02.241 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-05-15T15:35:02.422 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:02.426 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:02.562 INFO:teuthology.orchestra.run.smithi077.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:02.565 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/600 2024-05-15T15:35:02.565 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/600 2024-05-15T15:35:02.565 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:02.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:02.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:02.577 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-05-15T15:35:02.758 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:02.762 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:02.762 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:02.891 INFO:teuthology.orchestra.run.smithi077.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:02.895 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/601 2024-05-15T15:35:02.895 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/601 2024-05-15T15:35:02.895 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:02.897 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:02.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:02.906 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-05-15T15:35:03.088 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:03.092 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:03.092 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:03.247 INFO:teuthology.orchestra.run.smithi077.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:03.250 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/602 2024-05-15T15:35:03.251 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/602 2024-05-15T15:35:03.251 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:03.253 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:03.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:03.271 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-05-15T15:35:03.456 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:03.460 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:03.461 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:03.591 INFO:teuthology.orchestra.run.smithi077.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:03.595 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/603 2024-05-15T15:35:03.595 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/603 2024-05-15T15:35:03.595 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:03.598 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:03.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:03.606 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-05-15T15:35:03.782 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:03.786 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:03.786 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:03.908 INFO:teuthology.orchestra.run.smithi077.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:03.911 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/604 2024-05-15T15:35:03.911 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/604 2024-05-15T15:35:03.911 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:03.914 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:03.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:03.923 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-05-15T15:35:04.106 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:04.110 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:04.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:04.236 INFO:teuthology.orchestra.run.smithi077.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:04.239 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/605 2024-05-15T15:35:04.239 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/605 2024-05-15T15:35:04.239 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:04.242 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:04.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:04.251 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-05-15T15:35:04.428 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:04.432 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:04.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:04.554 INFO:teuthology.orchestra.run.smithi077.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:04.558 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/606 2024-05-15T15:35:04.558 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/606 2024-05-15T15:35:04.558 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:04.560 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:04.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:04.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-05-15T15:35:04.757 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:04.883 INFO:teuthology.orchestra.run.smithi077.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:04.887 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/607 2024-05-15T15:35:04.887 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/607 2024-05-15T15:35:04.887 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:04.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:04.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:04.913 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-05-15T15:35:05.100 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:05.104 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:05.104 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:05.240 INFO:teuthology.orchestra.run.smithi077.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:05.244 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/608 2024-05-15T15:35:05.244 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/608 2024-05-15T15:35:05.244 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:05.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:05.255 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-05-15T15:35:05.434 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:05.436 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:05.436 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:05.821 INFO:teuthology.orchestra.run.smithi077.stdout:generic/609 0s 2024-05-15T15:35:05.826 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/609 2024-05-15T15:35:05.826 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:05.828 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:05.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:05.838 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-05-15T15:35:06.262 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:06.267 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:06.267 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:06.400 INFO:teuthology.orchestra.run.smithi077.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:06.404 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/610 2024-05-15T15:35:06.404 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/610 2024-05-15T15:35:06.404 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:06.406 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:06.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:06.416 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-05-15T15:35:06.597 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:06.601 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:06.601 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:06.735 INFO:teuthology.orchestra.run.smithi077.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/611 2024-05-15T15:35:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/611 2024-05-15T15:35:06.738 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:06.741 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:06.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:06.750 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-05-15T15:35:06.930 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:06.934 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:06.934 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:07.107 INFO:teuthology.orchestra.run.smithi077.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T15:35:07.111 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/612 2024-05-15T15:35:07.111 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/612 2024-05-15T15:35:07.111 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:07.113 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:07.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:07.123 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-05-15T15:35:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:07.577 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/613 2024-05-15T15:35:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/613 2024-05-15T15:35:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:07.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:07.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:07.744 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-05-15T15:35:07.924 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:07.928 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:07.928 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:08.054 INFO:teuthology.orchestra.run.smithi077.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:08.058 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/614 2024-05-15T15:35:08.058 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/614 2024-05-15T15:35:08.058 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:08.061 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:08.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:08.070 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-05-15T15:35:08.248 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:08.253 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:08.253 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:08.370 INFO:teuthology.orchestra.run.smithi077.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:08.373 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/615 2024-05-15T15:35:08.373 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/615 2024-05-15T15:35:08.373 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:08.376 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:08.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:08.399 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-05-15T15:35:08.573 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:08.577 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:08.577 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:08.703 INFO:teuthology.orchestra.run.smithi077.stdout:generic/616 [not run] kernel does not support IO_URING 2024-05-15T15:35:08.706 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/616 2024-05-15T15:35:08.706 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/616 2024-05-15T15:35:08.706 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:08.709 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:08.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:08.720 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-05-15T15:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout:generic/617 [not run] kernel does not support IO_URING 2024-05-15T15:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/617 2024-05-15T15:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/617 2024-05-15T15:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:09.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:09.096 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-05-15T15:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/618 2024-05-15T15:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/618 2024-05-15T15:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:09.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:09.422 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-05-15T15:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/619 2024-05-15T15:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/619 2024-05-15T15:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:09.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:09.759 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-05-15T15:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/620 2024-05-15T15:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/620 2024-05-15T15:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:10.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:10.103 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-05-15T15:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/621 2024-05-15T15:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/621 2024-05-15T15:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:10.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:10.464 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-05-15T15:35:10.646 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:10.650 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:10.773 INFO:teuthology.orchestra.run.smithi077.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:10.777 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/622 2024-05-15T15:35:10.777 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/622 2024-05-15T15:35:10.777 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:10.779 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:10.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:10.789 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-05-15T15:35:10.970 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:10.974 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:10.974 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:11.099 INFO:teuthology.orchestra.run.smithi077.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:11.102 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/623 2024-05-15T15:35:11.102 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/623 2024-05-15T15:35:11.103 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:11.105 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:11.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:11.115 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-05-15T15:35:11.296 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:11.300 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:11.300 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:11.420 INFO:teuthology.orchestra.run.smithi077.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:11.423 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/624 2024-05-15T15:35:11.423 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/624 2024-05-15T15:35:11.423 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:11.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:11.434 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-05-15T15:35:11.615 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:11.619 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:11.619 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:11.756 INFO:teuthology.orchestra.run.smithi077.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:11.760 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/625 2024-05-15T15:35:11.760 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/625 2024-05-15T15:35:11.760 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:11.762 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:11.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:11.771 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-05-15T15:35:11.955 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:11.959 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:11.959 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:12.081 INFO:teuthology.orchestra.run.smithi077.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:12.084 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/626 2024-05-15T15:35:12.084 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/626 2024-05-15T15:35:12.084 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:12.087 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:12.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:12.096 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-05-15T15:35:12.273 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:12.277 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:12.277 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:12.417 INFO:teuthology.orchestra.run.smithi077.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:12.420 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/627 2024-05-15T15:35:12.421 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/627 2024-05-15T15:35:12.421 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:12.423 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:12.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:12.432 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-05-15T15:35:12.612 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:12.616 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:12.616 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:12.766 INFO:teuthology.orchestra.run.smithi077.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:12.770 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/628 2024-05-15T15:35:12.770 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/628 2024-05-15T15:35:12.770 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:12.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:12.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:12.781 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-05-15T15:35:12.963 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:12.967 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:12.967 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:13.104 INFO:teuthology.orchestra.run.smithi077.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:13.108 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/629 2024-05-15T15:35:13.108 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/629 2024-05-15T15:35:13.108 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:13.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:13.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:13.132 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-05-15T15:35:13.310 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:13.314 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:13.314 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:13.444 INFO:teuthology.orchestra.run.smithi077.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:13.448 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/630 2024-05-15T15:35:13.448 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/630 2024-05-15T15:35:13.448 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:13.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:13.459 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-05-15T15:35:13.639 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:13.643 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:13.765 INFO:teuthology.orchestra.run.smithi077.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:13.769 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/631 2024-05-15T15:35:13.769 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/631 2024-05-15T15:35:13.769 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:13.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:13.781 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-05-15T15:35:13.956 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:13.961 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:13.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:16.456 INFO:teuthology.orchestra.run.smithi077.stdout:generic/632 3s 2024-05-15T15:35:16.461 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/632 2024-05-15T15:35:16.461 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:16.464 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:16.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:16.473 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-05-15T15:35:16.659 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:16.663 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:16.966 INFO:teuthology.orchestra.run.smithi077.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/633.out.bad) 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/633.out 2024-05-15 12:10:37.836388726 +0000 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/633.out.bad 2024-05-15 15:35:16.963254918 +0000 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,2 +1,5 @@ 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 633 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: Silence is golden 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-05-15T15:35:16.979 INFO:teuthology.orchestra.run.smithi077.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-05-15T15:35:16.983 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/633 2024-05-15T15:35:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/633 2024-05-15T15:35:16.984 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T15:35:16.988 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:17.005 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T15:35:17.005 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T15:35:17.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T15:35:17.006 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-05-15T15:35:17.411 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:17.415 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:17.415 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/634 2024-05-15T15:35:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/634 2024-05-15T15:35:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:17.543 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:17.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:17.552 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-05-15T15:35:17.728 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:17.735 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:17.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:17.862 INFO:teuthology.orchestra.run.smithi077.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/635 2024-05-15T15:35:17.865 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/635 2024-05-15T15:35:17.866 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:17.868 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:17.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:17.877 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-05-15T15:35:18.061 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:18.066 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:18.188 INFO:teuthology.orchestra.run.smithi077.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/636 2024-05-15T15:35:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/636 2024-05-15T15:35:18.191 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:18.194 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:18.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:18.211 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-05-15T15:35:18.391 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:18.395 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:18.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:generic/637 1s 2024-05-15T15:35:19.438 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/637 2024-05-15T15:35:19.438 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:19.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:19.450 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-05-15T15:35:19.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:35:19.648 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:35:19.888 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:19.899 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:20.116 INFO:teuthology.orchestra.run.smithi077.stdout:generic/638 1s 2024-05-15T15:35:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/638 2024-05-15T15:35:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:20.123 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:20.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:20.133 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-05-15T15:35:20.322 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:20.326 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:20.326 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:24.832 INFO:teuthology.orchestra.run.smithi077.stdout:generic/639 4s 2024-05-15T15:35:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/639 2024-05-15T15:35:24.838 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:24.841 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:24.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:24.851 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-05-15T15:35:25.040 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:25.044 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:25.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:25.183 INFO:teuthology.orchestra.run.smithi077.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/640 2024-05-15T15:35:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/640 2024-05-15T15:35:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:25.190 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:25.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:25.198 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-05-15T15:35:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:25.380 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/641 2024-05-15T15:35:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/641 2024-05-15T15:35:25.516 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:25.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:25.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:25.527 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-05-15T15:35:25.707 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:25.711 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:25.711 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:25.832 INFO:teuthology.orchestra.run.smithi077.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/642 2024-05-15T15:35:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/642 2024-05-15T15:35:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:25.838 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:25.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:25.859 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-05-15T15:35:26.037 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:26.041 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:26.041 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:26.162 INFO:teuthology.orchestra.run.smithi077.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:26.165 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/643 2024-05-15T15:35:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/643 2024-05-15T15:35:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:26.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:26.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:26.177 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-05-15T15:35:26.356 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:26.360 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:26.360 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:26.484 INFO:teuthology.orchestra.run.smithi077.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-05-15T15:35:26.487 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/644 2024-05-15T15:35:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/644 2024-05-15T15:35:26.488 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:26.490 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:26.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:26.499 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-05-15T15:35:26.682 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:26.686 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:26.687 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:26.809 INFO:teuthology.orchestra.run.smithi077.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-05-15T15:35:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/645 2024-05-15T15:35:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/645 2024-05-15T15:35:26.812 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:26.815 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:26.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:26.824 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-05-15T15:35:27.002 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:27.006 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:27.007 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:27.128 INFO:teuthology.orchestra.run.smithi077.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:27.131 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/646 2024-05-15T15:35:27.132 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/646 2024-05-15T15:35:27.132 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:27.134 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:27.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:27.143 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-05-15T15:35:27.328 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:27.332 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:27.674 INFO:teuthology.orchestra.run.smithi077.stdout:generic/647 0s 2024-05-15T15:35:27.679 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/647 2024-05-15T15:35:27.680 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:27.682 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:27.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:27.691 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-05-15T15:35:28.123 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:28.127 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:28.128 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:28.272 INFO:teuthology.orchestra.run.smithi077.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T15:35:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/648 2024-05-15T15:35:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/648 2024-05-15T15:35:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:28.278 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:28.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:28.287 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-05-15T15:35:28.471 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:28.475 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:28.475 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:28.784 INFO:teuthology.orchestra.run.smithi077.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T15:35:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/649 2024-05-15T15:35:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/649 2024-05-15T15:35:28.788 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T15:35:28.790 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:28.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T15:35:28.799 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-05-15T15:35:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T15:35:29.232 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T15:35:29.232 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T15:35:49.739 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:35:49.742 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:36:19.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:36:19.950 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:36:50.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:36:50.167 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:36:50.286 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T15:36:50.285+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506321) UID: 0 2024-05-15T15:36:50.288 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T15:36:50.286+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506321) UID: 0 2024-05-15T15:36:50.289 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T15:36:50.288+0000 7f646d36f640 -1 Fail to open '/proc/506321/cmdline' error = (2) No such file or directory 2024-05-15T15:36:50.289 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T15:36:50.288+0000 7f646d36f640 -1 received signal: Hangup from (PID: 506321) UID: 0 2024-05-15T15:36:50.290 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T15:36:50.288+0000 7fc28b3f4640 -1 Fail to open '/proc/506321/cmdline' error = (2) No such file or directory 2024-05-15T15:36:50.290 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T15:36:50.288+0000 7fc28b3f4640 -1 received signal: Hangup from (PID: 506321) UID: 0 2024-05-15T15:40:50.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:40:50.067 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:20.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:20.298 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:50.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:41:50.416 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:20.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:20.595 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:50.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:42:50.710 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:20.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:20.829 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:51.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:43:51.077 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:21.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:21.436 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:51.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:44:51.669 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:21.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:21.870 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:52.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:45:52.297 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:22.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:22.445 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:52.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:46:52.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:22.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:22.877 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:47:23.014 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T15:47:23.012+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508461) UID: 0 2024-05-15T15:47:23.015 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T15:47:23.012+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508461) UID: 0 2024-05-15T15:47:23.021 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T15:47:23.012+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508461) UID: 0 2024-05-15T15:47:23.057 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T15:47:23.019+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 508461) UID: 0 2024-05-15T15:51:40.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:40.690 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:51:40.760 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T15:51:40.758+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 509173) UID: 0 2024-05-15T15:51:40.762 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T15:51:40.760+0000 7fbed1bfa640 -1 received signal: Hangup from (PID: 509173) UID: 0 2024-05-15T15:57:05.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:05.568 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:35.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:57:35.747 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:05.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:05.888 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:36.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:58:36.103 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:06.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:06.238 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:36.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T15:59:36.389 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:07.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:07.010 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:37.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:00:37.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:07.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:07.364 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:37.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:01:37.547 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:07.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:07.645 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:37.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:02:37.821 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:07.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:07.981 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:38.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:03:38.093 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:08.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:08.247 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:38.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:04:38.394 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:08.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:08.540 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:38.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:05:38.779 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:08.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:08.985 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:39.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:06:39.438 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:09.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:09.543 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:40.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:07:40.023 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:10.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:10.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:40.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:08:40.498 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:10.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:10.752 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:40.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:09:40.838 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:11.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:11.183 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:41.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:10:41.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:11.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:11.495 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:41.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:11:41.892 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:12.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:12.123 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:42.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:12:42.221 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:12.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:12.358 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:42.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:13:42.479 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:12.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:12.643 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:43.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:14:43.005 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:13.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:13.426 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:43.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:15:43.834 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:13.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:13.964 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:44.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:16:44.076 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:14.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:14.483 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:44.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:44.579 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:17:44.609 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T16:17:44.608+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51559) UID: 0 2024-05-15T16:17:44.609 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T16:17:44.608+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51559) UID: 0 2024-05-15T16:17:44.609 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T16:17:44.608+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51559) UID: 0 2024-05-15T16:17:44.610 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T16:17:44.608+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51559) UID: 0 2024-05-15T16:20:14.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:14.332 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:20:14.509 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T16:20:14.508+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 514780) UID: 0 2024-05-15T16:20:14.509 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T16:20:14.508+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 514780) UID: 0 2024-05-15T16:25:50.346 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T16:25:50.344+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515658) UID: 0 2024-05-15T16:25:50.347 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T16:25:50.344+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515658) UID: 0 2024-05-15T16:25:50.347 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T16:25:50.344+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515658) UID: 0 2024-05-15T16:25:50.347 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T16:25:50.344+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 515658) UID: 0 2024-05-15T16:30:45.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:45.212 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:30:45.241 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T16:30:45.240+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51618) UID: 0 2024-05-15T16:30:45.241 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T16:30:45.240+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51618) UID: 0 2024-05-15T16:30:45.241 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T16:30:45.240+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51618) UID: 0 2024-05-15T16:30:45.242 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T16:30:45.240+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51618) UID: 0 2024-05-15T16:30:45.319 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T16:30:45.319+0000 7f169fdb5640 -1 Fail to open '/proc/516453/cmdline' error = (2) No such file or directory 2024-05-15T16:30:45.319 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T16:30:45.319+0000 7f169fdb5640 -1 received signal: Hangup from (PID: 516453) UID: 0 2024-05-15T16:30:45.320 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T16:30:45.317+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 516453) UID: 0 2024-05-15T16:30:45.325 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T16:30:45.317+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 516453) UID: 0 2024-05-15T16:30:45.327 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T16:30:45.317+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 516453) UID: 0 2024-05-15T16:35:07.677 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:07.683 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:37.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:35:37.827 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:07.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:07.969 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:38.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:36:38.127 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:08.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:08.259 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:38.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:37:38.414 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:08.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:08.522 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:38:08.559 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T16:38:08.558+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51776) UID: 0 2024-05-15T16:38:08.560 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T16:38:08.558+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51776) UID: 0 2024-05-15T16:38:08.560 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T16:38:08.558+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51776) UID: 0 2024-05-15T16:38:08.561 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T16:38:08.558+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51776) UID: 0 2024-05-15T16:40:40.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:40:40.597 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:10.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:10.908 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:41.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:41:41.025 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:11.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:11.302 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:41.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:42:41.418 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:43:11.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:43:11.530 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:43:41.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:43:41.694 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:44:11.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:44:11.797 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:44:41.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:44:41.936 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:45:12.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:45:12.087 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:45:42.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:45:42.176 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:46:12.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:46:12.332 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:46:42.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:46:42.457 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:47:12.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:47:12.597 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:47:42.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:47:42.721 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:47:42.886 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T16:47:42.886+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 519781) UID: 0 2024-05-15T16:47:42.887 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T16:47:42.886+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 519781) UID: 0 2024-05-15T16:53:26.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:53:26.483 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:53:26.512 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T16:53:26.511+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52096) UID: 0 2024-05-15T16:53:26.512 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T16:53:26.511+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52096) UID: 0 2024-05-15T16:53:26.513 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T16:53:26.511+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52096) UID: 0 2024-05-15T16:53:26.513 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T16:53:26.511+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52096) UID: 0 2024-05-15T16:55:58.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:55:58.521 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T16:55:58.613 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T16:55:58.611+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520906) UID: 0 2024-05-15T16:55:58.613 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T16:55:58.611+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520906) UID: 0 2024-05-15T16:55:58.618 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T16:55:58.611+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520906) UID: 0 2024-05-15T16:55:58.621 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T16:55:58.611+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 520906) UID: 0 2024-05-15T16:59:55.835 INFO:teuthology.orchestra.run.smithi077.stdout:generic/650 5066s 2024-05-15T16:59:55.869 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/650 2024-05-15T16:59:55.869 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T16:59:55.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:55.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T16:59:55.904 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-05-15T16:59:56.513 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T16:59:56.530 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T16:59:56.530 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:56.957 INFO:teuthology.orchestra.run.smithi077.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T16:59:56.967 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/651 2024-05-15T16:59:56.967 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/651 2024-05-15T16:59:56.967 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T16:59:56.971 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:57.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T16:59:57.000 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-05-15T16:59:57.620 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T16:59:57.633 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T16:59:57.633 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:58.023 INFO:teuthology.orchestra.run.smithi077.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T16:59:58.034 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/652 2024-05-15T16:59:58.034 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/652 2024-05-15T16:59:58.035 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T16:59:58.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:58.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T16:59:58.070 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-05-15T16:59:58.728 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T16:59:58.741 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T16:59:58.741 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:59.133 INFO:teuthology.orchestra.run.smithi077.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T16:59:59.145 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/653 2024-05-15T16:59:59.145 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/653 2024-05-15T16:59:59.145 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T16:59:59.155 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T16:59:59.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T16:59:59.196 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-05-15T16:59:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T16:59:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T16:59:59.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:00.195 INFO:teuthology.orchestra.run.smithi077.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:00.206 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/654 2024-05-15T17:00:00.206 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/654 2024-05-15T17:00:00.207 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:00.212 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:00.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:00.243 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-05-15T17:00:00.940 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:00.952 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:00.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:01.375 INFO:teuthology.orchestra.run.smithi077.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:01.379 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/655 2024-05-15T17:00:01.380 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/655 2024-05-15T17:00:01.380 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:01.387 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:01.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:01.408 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-05-15T17:00:01.966 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:01.980 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:01.980 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:02.439 INFO:teuthology.orchestra.run.smithi077.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-05-15T17:00:02.452 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/656 2024-05-15T17:00:02.452 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/656 2024-05-15T17:00:02.452 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:02.461 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:02.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:02.490 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-05-15T17:00:03.123 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:03.138 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:03.139 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:03.485 INFO:teuthology.orchestra.run.smithi077.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:03.499 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/657 2024-05-15T17:00:03.500 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/657 2024-05-15T17:00:03.500 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:03.510 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:03.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:03.540 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-05-15T17:00:04.179 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:04.197 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:04.197 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:04.594 INFO:teuthology.orchestra.run.smithi077.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:04.601 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/658 2024-05-15T17:00:04.601 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/658 2024-05-15T17:00:04.601 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:04.609 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:04.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:04.641 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-05-15T17:00:05.221 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:05.614 INFO:teuthology.orchestra.run.smithi077.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:05.619 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/659 2024-05-15T17:00:05.619 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/659 2024-05-15T17:00:05.619 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:05.631 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:05.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:05.663 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-05-15T17:00:06.247 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:06.260 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:06.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:06.752 INFO:teuthology.orchestra.run.smithi077.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/660 2024-05-15T17:00:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/660 2024-05-15T17:00:06.761 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:06.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:06.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:06.799 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-05-15T17:00:07.445 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:07.458 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:07.458 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:07.828 INFO:teuthology.orchestra.run.smithi077.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:07.845 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/661 2024-05-15T17:00:07.845 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/661 2024-05-15T17:00:07.845 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:07.855 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:07.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:07.878 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-05-15T17:00:08.412 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:08.429 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:08.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:08.850 INFO:teuthology.orchestra.run.smithi077.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:08.859 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/662 2024-05-15T17:00:08.860 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/662 2024-05-15T17:00:08.860 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:08.868 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:08.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:08.893 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-05-15T17:00:09.558 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:09.576 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:10.001 INFO:teuthology.orchestra.run.smithi077.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:10.014 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/663 2024-05-15T17:00:10.014 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/663 2024-05-15T17:00:10.015 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:10.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:10.049 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-05-15T17:00:10.593 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:10.608 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:10.608 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:11.055 INFO:teuthology.orchestra.run.smithi077.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:11.069 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/664 2024-05-15T17:00:11.069 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/664 2024-05-15T17:00:11.069 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:11.080 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:11.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:11.114 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-05-15T17:00:11.745 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:11.759 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:11.759 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:12.404 INFO:teuthology.orchestra.run.smithi077.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:12.413 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/665 2024-05-15T17:00:12.413 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/665 2024-05-15T17:00:12.413 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:12.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:12.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:12.452 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-05-15T17:00:13.072 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:13.086 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:13.087 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:13.536 INFO:teuthology.orchestra.run.smithi077.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:13.549 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/666 2024-05-15T17:00:13.549 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/666 2024-05-15T17:00:13.549 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:13.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:13.562 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-05-15T17:00:14.180 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:14.195 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:14.532 INFO:teuthology.orchestra.run.smithi077.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:14.546 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/667 2024-05-15T17:00:14.547 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/667 2024-05-15T17:00:14.547 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:14.554 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:14.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:14.575 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-05-15T17:00:15.258 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:15.274 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:15.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:15.703 INFO:teuthology.orchestra.run.smithi077.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:15.716 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/668 2024-05-15T17:00:15.717 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/668 2024-05-15T17:00:15.717 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:15.723 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:15.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:15.751 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-05-15T17:00:16.438 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:16.449 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:16.449 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/669 2024-05-15T17:00:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/669 2024-05-15T17:00:16.874 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:16.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:16.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:16.913 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-05-15T17:00:17.535 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:17.547 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:17.547 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:17.913 INFO:teuthology.orchestra.run.smithi077.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:17.920 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/670 2024-05-15T17:00:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/670 2024-05-15T17:00:17.921 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:17.927 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:17.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:17.941 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-05-15T17:00:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:18.514 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:18.515 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:19.062 INFO:teuthology.orchestra.run.smithi077.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/671 2024-05-15T17:00:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/671 2024-05-15T17:00:19.069 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:19.070 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:19.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:19.093 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-05-15T17:00:19.718 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:19.725 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:19.725 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:20.148 INFO:teuthology.orchestra.run.smithi077.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/672 2024-05-15T17:00:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/672 2024-05-15T17:00:20.162 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:20.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:20.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:20.210 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-05-15T17:00:20.858 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:20.867 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:20.867 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:22.091 INFO:teuthology.orchestra.run.smithi077.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/673 2024-05-15T17:00:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/673 2024-05-15T17:00:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:22.101 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:22.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:22.117 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-05-15T17:00:22.794 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:22.813 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:22.814 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:23.282 INFO:teuthology.orchestra.run.smithi077.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/674 2024-05-15T17:00:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/674 2024-05-15T17:00:23.289 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:23.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:23.328 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-05-15T17:00:23.888 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:23.902 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:23.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:00:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/675 2024-05-15T17:00:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/675 2024-05-15T17:00:24.307 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:00:24.318 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:00:24.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:00:24.356 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-05-15T17:00:24.885 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:00:24.901 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:00:24.901 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:04:01.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:04:01.054 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:04:01.124 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T17:04:01.124+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532070) UID: 0 2024-05-15T17:04:01.125 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T17:04:01.124+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532070) UID: 0 2024-05-15T17:12:40.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:12:40.147 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:13:10.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:13:10.254 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:13:40.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:13:40.360 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:14:10.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:14:10.768 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:14:40.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:14:40.906 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:15:11.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:15:11.085 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:15:41.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:15:41.211 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:16:11.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:16:11.676 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:16:41.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:16:41.818 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:17:11.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:17:11.930 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:17:42.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:17:42.479 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:18:12.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:18:12.623 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:18:12.711 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T17:18:12.720+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532294) UID: 0 2024-05-15T17:18:12.711 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T17:18:12.721+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532294) UID: 0 2024-05-15T17:25:29.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:25:29.633 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:25:59.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:25:59.853 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:26:30.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:26:30.230 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:27:00.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:27:00.322 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:27:30.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:27:30.765 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:28:00.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:28:00.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:28:31.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:28:31.074 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:29:01.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:29:01.168 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:29:31.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:29:31.345 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:30:01.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:30:01.734 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:30:31.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:30:31.894 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:31:02.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:31:02.391 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:31:32.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:31:32.514 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:32:02.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:32:02.714 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:32:02.796 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T17:32:02.811+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532559) UID: 0 2024-05-15T17:32:02.797 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T17:32:02.811+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532559) UID: 0 2024-05-15T17:39:29.344 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T17:39:29.360+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532563) UID: 0 2024-05-15T17:39:29.344 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T17:39:29.360+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532563) UID: 0 2024-05-15T17:39:29.345 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T17:39:29.361+0000 7f09a89fc640 -1 Fail to open '/proc/532563/cmdline' error = (2) No such file or directory 2024-05-15T17:39:29.345 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T17:39:29.361+0000 7f09a89fc640 -1 received signal: Hangup from (PID: 532563) UID: 0 2024-05-15T17:39:29.345 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T17:39:29.360+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532563) UID: 0 2024-05-15T17:47:35.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:47:35.689 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T17:47:35.721 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T17:47:35.740+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52674) UID: 0 2024-05-15T17:47:35.721 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T17:47:35.740+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52674) UID: 0 2024-05-15T17:47:35.722 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T17:47:35.740+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52674) UID: 0 2024-05-15T17:47:35.722 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T17:47:35.740+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52674) UID: 0 2024-05-15T17:47:35.837 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T17:47:35.855+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532588) UID: 0 2024-05-15T17:47:35.837 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T17:47:35.855+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 532588) UID: 0 2024-05-15T17:55:08.784 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T17:55:08.803+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532596) UID: 0 2024-05-15T17:55:08.814 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T17:55:08.803+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532596) UID: 0 2024-05-15T17:55:08.814 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T17:55:08.803+0000 7fc28b3f4640 -1 received signal: Hangup from (PID: 532596) UID: 0 2024-05-15T17:55:08.815 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T17:55:08.803+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 532596) UID: 0 2024-05-15T17:59:01.105 INFO:teuthology.orchestra.run.smithi077.stdout:generic/676 3517s 2024-05-15T17:59:01.141 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/676 2024-05-15T17:59:01.141 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:01.152 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:01.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:01.190 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-05-15T17:59:02.290 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:02.304 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:02.304 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:02.830 INFO:teuthology.orchestra.run.smithi077.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:02.834 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/677 2024-05-15T17:59:02.834 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/677 2024-05-15T17:59:02.834 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:02.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:02.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:02.864 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-05-15T17:59:03.461 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:03.475 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:03.475 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:04.146 INFO:teuthology.orchestra.run.smithi077.stdout:generic/678 [not run] kernel does not support IO_URING 2024-05-15T17:59:04.154 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/678 2024-05-15T17:59:04.154 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/678 2024-05-15T17:59:04.154 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:04.162 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:04.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:04.179 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-05-15T17:59:04.671 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:04.691 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:05.116 INFO:teuthology.orchestra.run.smithi077.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:05.121 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/679 2024-05-15T17:59:05.122 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/679 2024-05-15T17:59:05.122 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:05.124 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:05.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:05.152 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-05-15T17:59:05.721 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:05.730 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:10.377 INFO:teuthology.orchestra.run.smithi077.stdout:generic/680 5s 2024-05-15T17:59:10.403 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/680 2024-05-15T17:59:10.403 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:10.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:10.468 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-05-15T17:59:11.365 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:11.384 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:11.830 INFO:teuthology.orchestra.run.smithi077.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T17:59:11.843 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/681 2024-05-15T17:59:11.844 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/681 2024-05-15T17:59:11.844 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:11.854 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:11.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:11.891 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-05-15T17:59:12.503 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:12.520 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:12.520 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:12.917 INFO:teuthology.orchestra.run.smithi077.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-05-15T17:59:12.929 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/682 2024-05-15T17:59:12.929 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/682 2024-05-15T17:59:12.929 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:12.942 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:12.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:12.972 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-05-15T17:59:13.613 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:13.623 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:14.253 INFO:teuthology.orchestra.run.smithi077.stdout:generic/683 [not run] /tmp/tmp.BgAiu3pKHAtest: file alloc unit 4194304 larger than op length 65536 2024-05-15T17:59:14.261 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/683 2024-05-15T17:59:14.261 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/683 2024-05-15T17:59:14.262 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:14.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:14.298 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-05-15T17:59:15.017 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:15.038 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:15.038 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:17.483 INFO:teuthology.orchestra.run.smithi077.stdout:generic/684 [not run] /tmp/tmp.BgAiu3pKHAtest: file alloc unit 4194304 larger than op length 65536 2024-05-15T17:59:17.496 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/684 2024-05-15T17:59:17.496 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/684 2024-05-15T17:59:17.496 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:17.505 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:17.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:17.543 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-05-15T17:59:18.243 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:18.257 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:18.257 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:20.987 INFO:teuthology.orchestra.run.smithi077.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-15T17:59:20.995 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/685 2024-05-15T17:59:20.995 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/685 2024-05-15T17:59:20.995 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:20.998 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:21.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:21.032 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-05-15T17:59:21.638 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:21.645 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:21.645 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:24.066 INFO:teuthology.orchestra.run.smithi077.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-15T17:59:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/686 2024-05-15T17:59:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/686 2024-05-15T17:59:24.070 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:24.079 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:24.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:24.111 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-05-15T17:59:24.751 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:24.770 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:24.770 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:27.413 INFO:teuthology.orchestra.run.smithi077.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-15T17:59:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/687 2024-05-15T17:59:27.426 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/687 2024-05-15T17:59:27.427 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:27.434 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:27.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:27.459 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-05-15T17:59:28.137 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:28.793 INFO:teuthology.orchestra.run.smithi077.stdout:generic/688 [not run] /tmp/tmp.BgAiu3pKHAtest: file alloc unit 4194304 larger than op length 65536 2024-05-15T17:59:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/688 2024-05-15T17:59:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/688 2024-05-15T17:59:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:28.811 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:28.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:28.833 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-05-15T17:59:29.513 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:29.530 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:29.531 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:29.974 INFO:teuthology.orchestra.run.smithi077.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-05-15T17:59:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/689 2024-05-15T17:59:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/689 2024-05-15T17:59:29.978 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:29.982 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:30.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:30.015 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-05-15T17:59:30.563 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:30.575 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:30.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:31.043 INFO:teuthology.orchestra.run.smithi077.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/690 2024-05-15T17:59:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/690 2024-05-15T17:59:31.047 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:31.055 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:31.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:31.092 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-05-15T17:59:31.695 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:31.719 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:31.719 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:32.125 INFO:teuthology.orchestra.run.smithi077.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:32.138 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/691 2024-05-15T17:59:32.138 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/691 2024-05-15T17:59:32.139 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:32.147 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:32.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:32.169 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-05-15T17:59:32.795 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:32.806 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:32.806 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:33.224 INFO:teuthology.orchestra.run.smithi077.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:33.236 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/692 2024-05-15T17:59:33.236 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/692 2024-05-15T17:59:33.236 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:33.240 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:33.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:33.269 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-05-15T17:59:33.859 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:33.868 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:33.868 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:34.446 INFO:teuthology.orchestra.run.smithi077.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:34.459 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/693 2024-05-15T17:59:34.459 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/693 2024-05-15T17:59:34.459 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:34.463 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:34.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:34.491 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-05-15T17:59:35.300 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:35.322 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:35.322 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:36.691 INFO:teuthology.orchestra.run.smithi077.stdout:generic/694 1s 2024-05-15T17:59:36.741 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/694 2024-05-15T17:59:36.742 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:36.752 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:36.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:36.786 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-05-15T17:59:37.331 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:37.345 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:37.892 INFO:teuthology.orchestra.run.smithi077.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:37.904 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/695 2024-05-15T17:59:37.904 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/695 2024-05-15T17:59:37.904 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:37.914 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:37.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:37.931 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-05-15T17:59:38.543 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:38.552 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:38.552 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:38.966 INFO:teuthology.orchestra.run.smithi077.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:38.979 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/696 2024-05-15T17:59:38.980 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/696 2024-05-15T17:59:38.980 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:38.989 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:39.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:39.013 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-05-15T17:59:39.615 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:39.625 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:40.326 INFO:teuthology.orchestra.run.smithi077.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-05-15T17:59:40.337 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/697 2024-05-15T17:59:40.337 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/697 2024-05-15T17:59:40.338 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:40.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:40.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:40.374 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-05-15T17:59:41.014 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:41.025 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:41.420 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/698 2024-05-15T17:59:41.420 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/698 2024-05-15T17:59:41.421 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:41.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:41.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:41.452 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-05-15T17:59:42.098 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:42.110 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:42.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:42.776 INFO:teuthology.orchestra.run.smithi077.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/699 2024-05-15T17:59:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/699 2024-05-15T17:59:42.793 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:42.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:42.826 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-05-15T17:59:43.604 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:43.620 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:43.620 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:44.106 INFO:teuthology.orchestra.run.smithi077.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:44.119 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/700 2024-05-15T17:59:44.120 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/700 2024-05-15T17:59:44.120 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:44.128 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:44.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:44.159 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-05-15T17:59:44.795 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:44.809 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:44.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:45.799 INFO:teuthology.orchestra.run.smithi077.stdout:generic/701 1s 2024-05-15T17:59:45.822 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/701 2024-05-15T17:59:45.822 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:45.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:45.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:45.867 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-05-15T17:59:46.879 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:46.899 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:46.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:47.390 INFO:teuthology.orchestra.run.smithi077.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:47.402 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/702 2024-05-15T17:59:47.402 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/702 2024-05-15T17:59:47.402 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:47.410 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:47.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:47.429 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-05-15T17:59:48.038 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:48.046 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:48.046 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:48.453 INFO:teuthology.orchestra.run.smithi077.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:48.460 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/703 2024-05-15T17:59:48.460 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/703 2024-05-15T17:59:48.460 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:48.463 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:48.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:48.477 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-05-15T17:59:49.078 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:49.098 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:49.098 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:49.814 INFO:teuthology.orchestra.run.smithi077.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-05-15T17:59:49.827 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/704 2024-05-15T17:59:49.827 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/704 2024-05-15T17:59:49.827 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:49.837 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:49.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:49.868 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-05-15T17:59:50.422 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:50.428 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:50.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:50.773 INFO:teuthology.orchestra.run.smithi077.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:50.784 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/705 2024-05-15T17:59:50.785 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/705 2024-05-15T17:59:50.785 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:50.787 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:50.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:50.819 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-05-15T17:59:51.471 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:51.483 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:51.483 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:54.365 INFO:teuthology.orchestra.run.smithi077.stdout:generic/706 3s 2024-05-15T17:59:54.381 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/706 2024-05-15T17:59:54.382 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:54.393 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:54.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:54.420 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-05-15T17:59:55.298 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:55.314 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:55.314 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:55.663 INFO:teuthology.orchestra.run.smithi077.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T17:59:55.676 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/707 2024-05-15T17:59:55.676 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/707 2024-05-15T17:59:55.677 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:55.687 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:55.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:55.723 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-05-15T17:59:56.335 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:56.351 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:56.351 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:57.727 INFO:teuthology.orchestra.run.smithi077.stdout:generic/708 1s 2024-05-15T17:59:57.756 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/708 2024-05-15T17:59:57.756 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:57.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:57.795 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-05-15T17:59:58.499 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T17:59:58.518 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T17:59:58.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:59.212 INFO:teuthology.orchestra.run.smithi077.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T17:59:59.213 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/709 2024-05-15T17:59:59.214 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/709 2024-05-15T17:59:59.214 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T17:59:59.224 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T17:59:59.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T17:59:59.259 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-05-15T18:00:00.266 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:00.286 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:00.848 INFO:teuthology.orchestra.run.smithi077.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:00.856 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/710 2024-05-15T18:00:00.856 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/710 2024-05-15T18:00:00.857 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:00.866 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:00.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:00.895 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-05-15T18:00:01.917 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:01.932 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:01.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:02.555 INFO:teuthology.orchestra.run.smithi077.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:02.567 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/711 2024-05-15T18:00:02.567 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/711 2024-05-15T18:00:02.567 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:02.573 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:02.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:02.618 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-05-15T18:00:03.613 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:03.623 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:03.623 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:04.226 INFO:teuthology.orchestra.run.smithi077.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:04.233 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/712 2024-05-15T18:00:04.233 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/712 2024-05-15T18:00:04.233 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:04.240 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:04.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:04.265 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-05-15T18:00:05.557 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:05.562 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:05.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:06.206 INFO:teuthology.orchestra.run.smithi077.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-05-15T18:00:06.220 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/713 2024-05-15T18:00:06.221 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/713 2024-05-15T18:00:06.221 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:06.230 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:06.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:06.265 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-05-15T18:00:07.293 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:07.308 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:07.309 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:07.893 INFO:teuthology.orchestra.run.smithi077.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:07.907 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/714 2024-05-15T18:00:07.907 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/714 2024-05-15T18:00:07.907 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:07.918 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:07.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:07.955 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-05-15T18:00:08.804 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:08.821 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:08.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:09.338 INFO:teuthology.orchestra.run.smithi077.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-05-15T18:00:09.349 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/715 2024-05-15T18:00:09.349 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/715 2024-05-15T18:00:09.349 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:09.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:09.384 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-05-15T18:00:10.098 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:10.114 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:10.686 INFO:teuthology.orchestra.run.smithi077.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:10.694 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/716 2024-05-15T18:00:10.695 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/716 2024-05-15T18:00:10.695 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:10.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:10.723 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-05-15T18:00:11.563 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:11.578 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:11.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:12.133 INFO:teuthology.orchestra.run.smithi077.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:12.143 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/717 2024-05-15T18:00:12.143 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/717 2024-05-15T18:00:12.143 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:12.148 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:12.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:12.174 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-05-15T18:00:13.127 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:13.144 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:13.144 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:13.794 INFO:teuthology.orchestra.run.smithi077.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:13.798 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/718 2024-05-15T18:00:13.798 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/718 2024-05-15T18:00:13.799 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:13.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:13.812 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-05-15T18:00:14.747 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:14.764 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:15.401 INFO:teuthology.orchestra.run.smithi077.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:15.414 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/719 2024-05-15T18:00:15.415 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/719 2024-05-15T18:00:15.415 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:15.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:15.461 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-05-15T18:00:16.461 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:16.474 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:16.474 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:17.020 INFO:teuthology.orchestra.run.smithi077.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/720 2024-05-15T18:00:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/720 2024-05-15T18:00:17.036 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:17.044 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:17.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:17.078 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-05-15T18:00:17.861 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:17.886 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:17.886 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:18.421 INFO:teuthology.orchestra.run.smithi077.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-05-15T18:00:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/721 2024-05-15T18:00:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/721 2024-05-15T18:00:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:18.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:18.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:18.469 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-05-15T18:00:19.039 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:19.056 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:19.056 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:19.628 INFO:teuthology.orchestra.run.smithi077.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-15T18:00:19.640 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/722 2024-05-15T18:00:19.641 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/722 2024-05-15T18:00:19.641 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:19.648 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:19.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:19.673 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-05-15T18:00:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:20.662 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:20.662 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:21.289 INFO:teuthology.orchestra.run.smithi077.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-05-15T18:00:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/723 2024-05-15T18:00:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/723 2024-05-15T18:00:21.303 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:21.312 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:21.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:21.341 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-05-15T18:00:22.405 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:22.409 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:22.410 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:22.918 INFO:teuthology.orchestra.run.smithi077.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-15T18:00:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/724 2024-05-15T18:00:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/724 2024-05-15T18:00:22.928 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:22.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:22.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:22.963 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-05-15T18:00:23.977 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:23.986 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:23.986 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:24.520 INFO:teuthology.orchestra.run.smithi077.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-15T18:00:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/725 2024-05-15T18:00:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/725 2024-05-15T18:00:24.540 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:24.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:24.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:24.582 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-05-15T18:00:25.442 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:25.456 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:25.457 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:26.917 INFO:teuthology.orchestra.run.smithi077.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-15T18:00:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/726 2024-05-15T18:00:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/726 2024-05-15T18:00:26.930 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:26.933 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:26.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:26.962 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-05-15T18:00:27.950 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:27.964 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:27.964 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:28.585 INFO:teuthology.orchestra.run.smithi077.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-05-15T18:00:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/727 2024-05-15T18:00:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/727 2024-05-15T18:00:28.593 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:28.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:28.629 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-05-15T18:00:29.679 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:29.699 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:34.396 INFO:teuthology.orchestra.run.smithi077.stdout:generic/728 5s 2024-05-15T18:00:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/728 2024-05-15T18:00:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:34.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:34.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:34.444 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-05-15T18:00:35.146 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:35.163 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:35.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:36.174 INFO:teuthology.orchestra.run.smithi077.stdout:generic/729 1s 2024-05-15T18:00:36.198 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/729 2024-05-15T18:00:36.198 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:36.208 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:36.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:36.224 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-05-15T18:00:37.318 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:37.324 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:37.325 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:37.844 INFO:teuthology.orchestra.run.smithi077.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-05-15T18:00:37.857 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/730 2024-05-15T18:00:37.857 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/730 2024-05-15T18:00:37.857 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:37.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:37.910 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-05-15T18:00:38.575 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:38.591 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:38.591 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:39.075 INFO:teuthology.orchestra.run.smithi077.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-05-15T18:00:39.085 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/731 2024-05-15T18:00:39.085 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/731 2024-05-15T18:00:39.085 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:39.096 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:39.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:39.131 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-05-15T18:00:39.896 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:39.918 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:40.476 INFO:teuthology.orchestra.run.smithi077.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T18:00:40.487 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/732 2024-05-15T18:00:40.487 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/732 2024-05-15T18:00:40.487 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:40.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:40.509 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-05-15T18:00:41.155 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:41.180 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:41.181 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:41.623 INFO:teuthology.orchestra.run.smithi077.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T18:00:41.629 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/733 2024-05-15T18:00:41.629 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/733 2024-05-15T18:00:41.629 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:41.636 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:41.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:41.670 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-05-15T18:00:42.422 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:42.433 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:42.433 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:43.049 INFO:teuthology.orchestra.run.smithi077.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-05-15T18:00:43.058 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/734 2024-05-15T18:00:43.058 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/734 2024-05-15T18:00:43.058 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:43.068 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:43.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:43.095 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-05-15T18:00:44.098 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:44.114 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:44.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:46.812 INFO:teuthology.orchestra.run.smithi077.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-05-15T18:00:46.824 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/735 2024-05-15T18:00:46.824 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/735 2024-05-15T18:00:46.824 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:00:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:00:46.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:00:46.865 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-05-15T18:00:47.776 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:00:47.790 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:00:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:02:09.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:02:09.835 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:02:09.878 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T18:02:09.897+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52729) UID: 0 2024-05-15T18:02:09.878 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T18:02:09.899+0000 7fbba9750640 -1 Fail to open '/proc/52729/cmdline' error = (2) No such file or directory 2024-05-15T18:02:09.878 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T18:02:09.899+0000 7fbba9750640 -1 received signal: Hangup from (PID: 52729) UID: 0 2024-05-15T18:02:09.878 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T18:02:09.897+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52729) UID: 0 2024-05-15T18:02:09.885 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T18:02:09.905+0000 7fba5b258640 -1 Fail to open '/proc/52729/cmdline' error = (2) No such file or directory 2024-05-15T18:02:09.886 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T18:02:09.905+0000 7fba5b258640 -1 received signal: Hangup from (PID: 52729) UID: 0 2024-05-15T18:02:09.927 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T18:02:09.948+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559387) UID: 0 2024-05-15T18:02:09.927 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T18:02:09.948+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559387) UID: 0 2024-05-15T18:02:09.928 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T18:02:09.948+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559387) UID: 0 2024-05-15T18:02:09.928 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T18:02:09.948+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559387) UID: 0 2024-05-15T18:06:40.372 INFO:teuthology.orchestra.run.smithi077.stdout:generic/736 353s 2024-05-15T18:06:40.394 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/736 2024-05-15T18:06:40.395 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:06:40.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:40.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:06:40.444 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-05-15T18:06:41.546 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:06:41.559 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:06:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:41.895 INFO:teuthology.orchestra.run.smithi077.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T18:06:41.908 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/737 2024-05-15T18:06:41.909 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/737 2024-05-15T18:06:41.909 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:06:41.919 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:41.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:06:41.941 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-05-15T18:06:42.638 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:06:42.659 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:06:42.660 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:43.099 INFO:teuthology.orchestra.run.smithi077.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T18:06:43.116 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/738 2024-05-15T18:06:43.117 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/738 2024-05-15T18:06:43.117 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:06:43.126 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:43.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:06:43.159 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-05-15T18:06:43.917 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:06:43.928 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:06:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:44.488 INFO:teuthology.orchestra.run.smithi077.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T18:06:44.502 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/739 2024-05-15T18:06:44.503 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/739 2024-05-15T18:06:44.503 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:06:44.507 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:44.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:06:44.540 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/741) 2024-05-15T18:06:45.259 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:06:45.277 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:06:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:45.808 INFO:teuthology.orchestra.run.smithi077.stdout:generic/741 [not run] this test requires a valid $SCRATCH_DEV 2024-05-15T18:06:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/741 2024-05-15T18:06:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/741 2024-05-15T18:06:45.820 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T18:06:45.826 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:06:45.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T18:06:45.856 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/742) 2024-05-15T18:06:46.454 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T18:06:46.471 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T18:06:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T18:09:29.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:09:29.690 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:09:29.758 INFO:tasks.ceph.mds.a.smithi077.stderr:2024-05-15T18:09:29.781+0000 7f20fed68640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561691) UID: 0 2024-05-15T18:09:29.759 INFO:tasks.ceph.mds.c.smithi077.stderr:2024-05-15T18:09:29.781+0000 7fbed1bfa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561691) UID: 0 2024-05-15T18:17:06.191 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-05-15T18:17:06.213+0000 7f169fdb5640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561722) UID: 0 2024-05-15T18:17:06.191 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-05-15T18:17:06.213+0000 7f646d36f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561722) UID: 0 2024-05-15T18:17:06.192 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-05-15T18:17:06.213+0000 7f09a89fc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561722) UID: 0 2024-05-15T18:17:06.192 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-05-15T18:17:06.213+0000 7fc28b3f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561722) UID: 0 2024-05-15T18:25:11.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:25:11.095 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:25:11.129 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T18:25:11.136+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52862) UID: 0 2024-05-15T18:25:11.129 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T18:25:11.136+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52862) UID: 0 2024-05-15T18:25:11.130 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T18:25:11.136+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52862) UID: 0 2024-05-15T18:25:11.130 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T18:25:11.136+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52862) UID: 0 2024-05-15T18:28:20.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:28:20.273 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:28:50.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:28:50.383 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:29:20.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:29:20.483 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:29:50.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:29:50.612 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:30:20.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:30:20.921 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:30:51.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:30:51.059 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:31:21.368 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:31:21.371 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:31:21.404 INFO:tasks.ceph.osd.4.smithi083.stderr:2024-05-15T18:31:21.404+0000 7fba5b258640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53041) UID: 0 2024-05-15T18:31:21.404 INFO:tasks.ceph.osd.5.smithi083.stderr:2024-05-15T18:31:21.404+0000 7f719cffc640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53041) UID: 0 2024-05-15T18:31:21.405 INFO:tasks.ceph.osd.7.smithi083.stderr:2024-05-15T18:31:21.404+0000 7fc8edfdb640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53041) UID: 0 2024-05-15T18:31:21.405 INFO:tasks.ceph.osd.6.smithi083.stderr:2024-05-15T18:31:21.404+0000 7fbba9750640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53041) UID: 0 2024-05-15T18:34:08.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:34:08.355 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:34:38.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:34:38.542 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:35:08.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:35:08.649 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:35:38.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:35:38.777 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:36:09.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:36:09.124 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:36:39.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:36:39.412 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:37:09.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:37:09.545 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:37:39.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:37:39.684 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:38:09.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:38:09.811 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:38:39.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:38:39.943 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:39:10.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:39:10.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:39:40.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:39:40.550 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:40:10.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:40:10.668 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:40:40.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:40:40.805 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:41:10.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:41:10.946 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:41:41.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:41:41.068 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:42:11.169 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:42:11.174 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:42:41.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:42:41.294 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:43:11.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:43:11.695 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:43:41.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:43:41.790 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:44:11.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:44:11.947 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:44:42.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:44:42.079 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:45:12.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:45:12.296 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:45:42.473 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:45:42.477 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:46:12.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:46:12.568 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:46:42.905 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:46:42.909 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:47:13.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:47:13.120 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:47:43.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:47:43.210 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:48:13.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:48:13.355 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:48:43.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:48:43.514 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:49:13.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:49:13.612 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:49:43.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:49:43.712 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:50:14.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:50:14.122 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:50:44.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:50:44.236 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:51:14.374 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:51:14.379 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:51:44.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:51:44.659 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:52:14.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:52:14.764 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:52:44.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:52:44.865 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:53:14.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:53:14.963 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:53:45.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:53:45.407 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:54:15.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:54:15.522 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:54:45.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:54:45.607 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:55:15.676 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:55:15.680 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:55:45.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:55:45.774 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:56:15.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:56:15.910 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:56:46.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:56:46.154 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:57:16.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:57:16.473 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:57:46.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:57:46.560 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:58:16.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:58:16.650 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:58:46.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:58:46.749 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:59:16.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:59:16.873 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:59:47.034 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T18:59:47.039 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:00:17.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:00:17.128 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:00:47.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:00:47.235 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:01:17.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:01:17.389 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:01:47.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:01:47.546 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:02:17.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:02:17.706 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:02:47.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:02:47.840 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:03:17.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:03:17.946 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:03:48.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:03:48.145 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:04:15.326 INFO:teuthology.orchestra.run.smithi077.stdout:generic/742 [failed, exit status 1]- output mismatch (see /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/742.out.bad) 2024-05-15T19:04:15.333 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/742.out 2024-05-15 12:10:37.842388611 +0000 2024-05-15T19:04:15.333 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.DmRtshrLxIxfstests-dev/results//generic/742.out.bad 2024-05-15 19:04:15.001593839 +0000 2024-05-15T19:04:15.333 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -1,2 +1,3 @@ 2024-05-15T19:04:15.333 INFO:teuthology.orchestra.run.smithi077.stdout: QA output created by 742 2024-05-15T19:04:15.333 INFO:teuthology.orchestra.run.smithi077.stdout: Silence is golden 2024-05-15T19:04:15.334 INFO:teuthology.orchestra.run.smithi077.stdout: +fiemap-fault: fiemap failed 95: Operation not supported 2024-05-15T19:04:15.348 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/742 2024-05-15T19:04:15.348 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/742 2024-05-15T19:04:15.348 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2024-05-15T19:04:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:15.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T19:04:15.390 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-05-15T19:04:15.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-05-15T19:04:15.390 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/743) 2024-05-15T19:04:16.238 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T19:04:16.257 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T19:04:16.257 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:16.726 INFO:teuthology.orchestra.run.smithi077.stdout:generic/743 [not run] xfs_io madvise doesn't support -R 2024-05-15T19:04:16.735 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/743 2024-05-15T19:04:16.735 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/743 2024-05-15T19:04:16.735 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T19:04:16.742 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:16.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T19:04:16.773 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.DmRtshrLxIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/744) 2024-05-15T19:04:17.285 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2024-05-15T19:04:17.296 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-15T19:04:17.296 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:17.707 INFO:teuthology.orchestra.run.smithi077.stdout:generic/744 [not run] ceph-fuse does not support duplicate fsid 2024-05-15T19:04:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/744 2024-05-15T19:04:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/744 2024-05-15T19:04:17.712 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2024-05-15T19:04:17.721 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:17.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-15T19:04:17.752 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 17========================================================= 2024-05-15T19:04:17.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo userdel --force --remove fsgqa 2024-05-15T19:04:18.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:04:18.511 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:04:18.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo userdel --force --remove 123456-fsgqa 2024-05-15T19:04:19.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo groupdel fsgqa 2024-05-15T19:04:19.514 INFO:teuthology.orchestra.run.smithi077.stderr:groupdel: group 'fsgqa' does not exist 2024-05-15T19:04:19.517 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-05-15T19:04:19.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:19.517 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.DmRtshrLxIxfstests-dev/results) 2024-05-15T19:04:19.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T19:04:19.580 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-05-15T19:04:19.580 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.DmRtshrLxIxfstests-dev 2024-05-15T19:04:19.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf /tmp/tmp.DmRtshrLxIxfstests-dev 2024-05-15T19:04:19.999 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-15T19:04:19.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T19:04:20.295 DEBUG:teuthology.orchestra.run.smithi083:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-15T19:04:20.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-15T19:04:20.363 INFO:tasks.cephfs.mount:Terminating background process 2024-05-15T19:04:20.363 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T19:04:20.364 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:20.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1230 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-15T19:04:20.451 INFO:tasks.cephfs.mount:Terminating background process 2024-05-15T19:04:20.451 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T19:04:20.451 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:20.482 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20541 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-15T19:04:20.482 INFO:tasks.cephfs.mount:Terminating background process 2024-05-15T19:04:20.482 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T19:04:20.482 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:20.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1230 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-15T19:04:20.532 INFO:tasks.cephfs.mount:Terminating background process 2024-05-15T19:04:20.533 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T19:04:20.533 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:20.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20541 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-15T19:04:20.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T19:04:21.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.082+0000 7f118bf04640 1 Processor -- start 2024-05-15T19:04:21.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.082+0000 7f118bf04640 1 -- start start 2024-05-15T19:04:21.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.086+0000 7f118bf04640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f118415f970 0x7f118406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.086+0000 7f118bf04640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118406fee0 0x7f11840b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.087+0000 7f118bf04640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f118406ee40 con 0x7f118415fd50 2024-05-15T19:04:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.087+0000 7f118bf04640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f118406f120 con 0x7f118415f970 2024-05-15T19:04:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.087+0000 7f118bf04640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f118406f400 con 0x7f118406fee0 2024-05-15T19:04:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.087+0000 7f118a4a1640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f118415fd50 0x7f11841601a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:57670/0 (socket says 172.21.15.77:57670) 2024-05-15T19:04:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.087+0000 7f118a4a1640 1 -- 172.21.15.77:0/3349462411 learned_addr learned my addr 172.21.15.77:0/3349462411 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:21.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.087+0000 7f118949f640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118406fee0 0x7f11840b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:21.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633363472 0 0) 0x7f118406ee40 con 0x7f118415fd50 2024-05-15T19:04:21.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1170003520 con 0x7f118415fd50 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2954818435 0 0) 0x7f1170003520 con 0x7f118415fd50 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118406fee0 msgr2=0x7f11840b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118406fee0 0x7f11840b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 >> v2:172.21.15.77:3300/0 conn(0x7f118415f970 msgr2=0x7f118406e860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 --2- 172.21.15.77:0/3349462411 >> v2:172.21.15.77:3300/0 conn(0x7f118415f970 0x7f118406e860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 --> v1:172.21.15.83:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f118406f6e0 con 0x7f118415fd50 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 <== mon.1 v1:172.21.15.83:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f11800016f0 con 0x7f118415fd50 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 >> v1:172.21.15.83:6789/0 conn(0x7f118415fd50 legacy=0x7f11841601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1170003a70 0x7f1170003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170004800 0x7f1170004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1170005210 0x7f117000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f118406f120 con 0x7f1170004800 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f118406f400 con 0x7f1170003a70 2024-05-15T19:04:21.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1170014950 con 0x7f1170005210 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.088+0000 7f118a4a1640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1170005210 0x7f117000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.089+0000 7f118a4a1640 1 -- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1170003a70 msgr2=0x7f1170003e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.089+0000 7f118a4a1640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1170003a70 0x7f1170003e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.089+0000 7f118a4a1640 1 -- 172.21.15.77:0/3349462411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170004800 msgr2=0x7f1170004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.089+0000 7f118a4a1640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170004800 0x7f1170004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.089+0000 7f118a4a1640 1 -- 172.21.15.77:0/3349462411 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1170003520 con 0x7f1170005210 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.090+0000 7f118a4a1640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1170005210 0x7f117000b9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f118000c2f0 tx=0x7f1170005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=996befcb94eadc3d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.090+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180007d90 con 0x7f1170005210 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.090+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1180005af0 con 0x7f1170005210 2024-05-15T19:04:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.090+0000 7f1188c9e640 1 -- 172.21.15.77:0/3349462411 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1180007070 con 0x7f1170005210 2024-05-15T19:04:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.091+0000 7f118bf04640 1 -- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1170005210 msgr2=0x7f117000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.091+0000 7f118bf04640 1 --2- 172.21.15.77:0/3349462411 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1170005210 0x7f117000b9c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f118000c2f0 tx=0x7f1170005830 comp rx=0 tx=0).stop 2024-05-15T19:04:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.091+0000 7f118a4a1640 1 -- 172.21.15.77:0/3349462411 reap_dead start 2024-05-15T19:04:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.091+0000 7f118bf04640 1 -- 172.21.15.77:0/3349462411 shutdown_connections 2024-05-15T19:04:21.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.091+0000 7f118bf04640 1 -- 172.21.15.77:0/3349462411 >> 172.21.15.77:0/3349462411 conn(0x7f118406c810 msgr2=0x7f118406cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:21.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.095+0000 7f118bf04640 1 -- 172.21.15.77:0/3349462411 shutdown_connections 2024-05-15T19:04:21.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.095+0000 7f118bf04640 1 -- 172.21.15.77:0/3349462411 wait complete. 2024-05-15T19:04:21.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.100+0000 7f118bf04640 1 Processor -- start 2024-05-15T19:04:21.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.100+0000 7f118bf04640 1 -- start start 2024-05-15T19:04:21.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.105+0000 7f118bf04640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170005210 0x7f11841416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.105+0000 7f118bf04640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118415cb10 0x7f118415e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.105+0000 7f1189ca0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170005210 0x7f11841416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:21.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.105+0000 7f1189ca0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170005210 0x7f11841416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:52882/0 (socket says 172.21.15.77:52882) 2024-05-15T19:04:21.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.105+0000 7f1189ca0640 1 -- 172.21.15.77:0/2478459520 learned_addr learned my addr 172.21.15.77:0/2478459520 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:21.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.106+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11840b1e00 0x7f11840b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.106+0000 7f118949f640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118415cb10 0x7f118415e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.106+0000 7f118a4a1640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11840b1e00 0x7f11840b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.106+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f11840aa490 con 0x7f1170005210 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.106+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f11840b6340 con 0x7f11840b1e00 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.106+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f11840aa610 con 0x7f118415cb10 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.107+0000 7f118949f640 1 -- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11840b1e00 msgr2=0x7f11840b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.107+0000 7f118949f640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11840b1e00 0x7f11840b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:21.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.107+0000 7f118949f640 1 -- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170005210 msgr2=0x7f11841416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:21.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.107+0000 7f118949f640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170005210 0x7f11841416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:21.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.107+0000 7f118949f640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1184141c30 con 0x7f118415cb10 2024-05-15T19:04:21.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.107+0000 7f118949f640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118415cb10 0x7f118415e760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f117c00ef70 tx=0x7f117c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:21.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.108+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c018020 con 0x7f118415cb10 2024-05-15T19:04:21.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.108+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f117c014480 con 0x7f118415cb10 2024-05-15T19:04:21.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.109+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f117c014870 con 0x7f118415cb10 2024-05-15T19:04:21.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.109+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f118415cfa0 con 0x7f118415cb10 2024-05-15T19:04:21.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.109+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f118415d560 con 0x7f118415cb10 2024-05-15T19:04:21.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.112+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f117c005d10 con 0x7f118415cb10 2024-05-15T19:04:21.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.114+0000 7f117a7fc640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11680763a0 0x7f1168078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:21.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.115+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f117c098320 con 0x7f118415cb10 2024-05-15T19:04:21.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.115+0000 7f1189ca0640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11680763a0 0x7f1168078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:21.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.116+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f118415e020 con 0x7f118415cb10 2024-05-15T19:04:21.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.117+0000 7f1189ca0640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11680763a0 0x7f1168078860 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1174006fd0 tx=0x7f1174008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:21.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:21.122+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f118415e020 con 0x7f118415cb10 2024-05-15T19:04:22.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.323+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f118406a640 con 0x7f118415cb10 2024-05-15T19:04:22.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.325+0000 7f117a7fc640 1 -- 172.21.15.77:0/2478459520 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5178 (secure 0 0 0) 0x7f117c022030 con 0x7f118415cb10 2024-05-15T19:04:22.329 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:22.329 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:10:25.666896+0000","modified":"2024-05-15T12:10:27.671771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4863},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4863":{"gid":4863,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1303228576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1303228576},{"type":"v1","addr":"172.21.15.77:6837","nonce":1303228576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4863,"qdb_cluster":[4863]},"id":2}]} 2024-05-15T19:04:22.329 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-05-15T19:04:22.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.337+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11680763a0 msgr2=0x7f1168078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.337+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11680763a0 0x7f1168078860 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1174006fd0 tx=0x7f1174008040 comp rx=0 tx=0).stop 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.337+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118415cb10 msgr2=0x7f118415e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.337+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118415cb10 0x7f118415e760 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f117c00ef70 tx=0x7f117c00c490 comp rx=0 tx=0).stop 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 shutdown_connections 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f11680763a0 0x7f1168078860 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f118415cb10 0x7f118415e760 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f11840b1e00 0x7f11840b22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 --2- 172.21.15.77:0/2478459520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1170005210 0x7f11841416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 >> 172.21.15.77:0/2478459520 conn(0x7f118406c810 msgr2=0x7f11841601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:22.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 shutdown_connections 2024-05-15T19:04:22.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.338+0000 7f118bf04640 1 -- 172.21.15.77:0/2478459520 wait complete. 2024-05-15T19:04:22.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T19:04:22.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.804+0000 7f2ebf59e640 1 Processor -- start 2024-05-15T19:04:22.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.805+0000 7f2ebf59e640 1 -- start start 2024-05-15T19:04:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.808+0000 7f2ebf59e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2ec0160420 0x7f2ec006c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebf59e640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00b57a0 con 0x7f2ec006c930 2024-05-15T19:04:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebf59e640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00b5a80 con 0x7f2ec0148b10 2024-05-15T19:04:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebf59e640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec006cd60 con 0x7f2ec0160420 2024-05-15T19:04:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebe59c640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2ec0148b10 0x7f2ec00b4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:40664/0 (socket says 172.21.15.77:40664) 2024-05-15T19:04:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebe59c640 1 -- 172.21.15.77:0/3411333058 learned_addr learned my addr 172.21.15.77:0/3411333058 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebdd9b640 1 --2- 172.21.15.77:0/3411333058 >> v2:172.21.15.83:3300/0 conn(0x7f2ec0160420 0x7f2ec006c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebd59a640 1 -- 172.21.15.77:0/3411333058 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005835385 0 0) 0x7f2ec00b5a80 con 0x7f2ec0148b10 2024-05-15T19:04:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebd59a640 1 -- 172.21.15.77:0/3411333058 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ea8003520 con 0x7f2ec0148b10 2024-05-15T19:04:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebdd9b640 1 -- 172.21.15.77:0/3411333058 >> v1:172.21.15.83:6789/0 conn(0x7f2ec0148b10 legacy=0x7f2ec00b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebdd9b640 1 -- 172.21.15.77:0/3411333058 >> v1:172.21.15.77:6789/0 conn(0x7f2ec006c930 legacy=0x7f2ec006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.809+0000 7f2ebdd9b640 1 -- 172.21.15.77:0/3411333058 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec00b5d60 con 0x7f2ec0160420 2024-05-15T19:04:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.810+0000 7f2ebdd9b640 1 --2- 172.21.15.77:0/3411333058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0160420 0x7f2ec006c3f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009d90 tx=0x7f2eb002a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ca2ee0c470c018 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.810+0000 7f2ebd59a640 1 -- 172.21.15.77:0/3411333058 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0007740 con 0x7f2ec0160420 2024-05-15T19:04:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.811+0000 7f2ebd59a640 1 -- 172.21.15.77:0/3411333058 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb00078e0 con 0x7f2ec0160420 2024-05-15T19:04:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.811+0000 7f2ebd59a640 1 -- 172.21.15.77:0/3411333058 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0007cb0 con 0x7f2ec0160420 2024-05-15T19:04:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.812+0000 7f2ebf59e640 1 -- 172.21.15.77:0/3411333058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0160420 msgr2=0x7f2ec006c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.812+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/3411333058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0160420 0x7f2ec006c3f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0009d90 tx=0x7f2eb002a530 comp rx=0 tx=0).stop 2024-05-15T19:04:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.812+0000 7f2ebf59e640 1 -- 172.21.15.77:0/3411333058 shutdown_connections 2024-05-15T19:04:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.812+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/3411333058 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0160420 0x7f2ec006c3f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.813+0000 7f2ebf59e640 1 -- 172.21.15.77:0/3411333058 >> 172.21.15.77:0/3411333058 conn(0x7f2ec00b3bc0 msgr2=0x7f2ec00b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.813+0000 7f2ebf59e640 1 -- 172.21.15.77:0/3411333058 shutdown_connections 2024-05-15T19:04:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.813+0000 7f2ebf59e640 1 -- 172.21.15.77:0/3411333058 wait complete. 2024-05-15T19:04:22.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.815+0000 7f2ebf59e640 1 Processor -- start 2024-05-15T19:04:22.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.816+0000 7f2ebf59e640 1 -- start start 2024-05-15T19:04:22.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.819+0000 7f2ebf59e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 0x7f2ec015e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:22.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.819+0000 7f2ebf59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0148b10 0x7f2ec00d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:22.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.819+0000 7f2ebf59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ec0160420 0x7f2ec01f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:22.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.819+0000 7f2ebf59e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec00703d0 con 0x7f2ec0160420 2024-05-15T19:04:22.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.819+0000 7f2ebf59e640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec0070250 con 0x7f2ec0148b10 2024-05-15T19:04:22.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.819+0000 7f2ebf59e640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec0070550 con 0x7f2ec006c930 2024-05-15T19:04:22.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.820+0000 7f2ebe59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 0x7f2ec015e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.820+0000 7f2ebe59c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 0x7f2ec015e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:52622/0 (socket says 172.21.15.77:52622) 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.820+0000 7f2ebe59c640 1 -- 172.21.15.77:0/2347198410 learned_addr learned my addr 172.21.15.77:0/2347198410 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.820+0000 7f2ebed9d640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ec0160420 0x7f2ec01f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.821+0000 7f2ebe59c640 1 -- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0148b10 msgr2=0x7f2ec00d0320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.821+0000 7f2ebe59c640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0148b10 0x7f2ec00d0320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.821+0000 7f2ebe59c640 1 -- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ec0160420 msgr2=0x7f2ec01f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.821+0000 7f2ebe59c640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ec0160420 0x7f2ec01f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.821+0000 7f2ebe59c640 1 -- 172.21.15.77:0/2347198410 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec01fca80 con 0x7f2ec006c930 2024-05-15T19:04:22.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.822+0000 7f2ebe59c640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 0x7f2ec015e8c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c490 tx=0x7f2eb800c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:22.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.823+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8018070 con 0x7f2ec006c930 2024-05-15T19:04:22.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.824+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8007500 con 0x7f2ec006c930 2024-05-15T19:04:22.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.824+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8004a20 con 0x7f2ec006c930 2024-05-15T19:04:22.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.825+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec0143d50 con 0x7f2ec006c930 2024-05-15T19:04:22.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.825+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec0144310 con 0x7f2ec006c930 2024-05-15T19:04:22.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.826+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec00768e0 con 0x7f2ec006c930 2024-05-15T19:04:22.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.829+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2eb801b070 con 0x7f2ec006c930 2024-05-15T19:04:22.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.831+0000 7f2eaeffd640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2ea0076350 0x7f2ea0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:22.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.831+0000 7f2ebdd9b640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2ea0076350 0x7f2ea0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:22.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.832+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f2eb8096dd0 con 0x7f2ec006c930 2024-05-15T19:04:22.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.832+0000 7f2ebdd9b640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2ea0076350 0x7f2ea0078810 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0034000 tx=0x7f2eb002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:22.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:22.836+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2eb8022020 con 0x7f2ec006c930 2024-05-15T19:04:24.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.112+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ec00b6c60 con 0x7f2ec006c930 2024-05-15T19:04:24.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.119+0000 7f2eaeffd640 1 -- 172.21.15.77:0/2347198410 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5178 (secure 0 0 0) 0x7f2eb80600d0 con 0x7f2ec006c930 2024-05-15T19:04:24.123 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:24.123 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:10:25.666896+0000","modified":"2024-05-15T12:10:27.671771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4863},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4863":{"gid":4863,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1303228576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1303228576},{"type":"v1","addr":"172.21.15.77:6837","nonce":1303228576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4863,"qdb_cluster":[4863]},"id":2}]} 2024-05-15T19:04:24.123 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-05-15T19:04:24.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.127+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2ea0076350 msgr2=0x7f2ea0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.127+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2ea0076350 0x7f2ea0078810 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0034000 tx=0x7f2eb002f000 comp rx=0 tx=0).stop 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.127+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 msgr2=0x7f2ec015e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.127+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 0x7f2ec015e8c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c490 tx=0x7f2eb800c950 comp rx=0 tx=0).stop 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.128+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 shutdown_connections 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.128+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2ea0076350 0x7f2ea0078810 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.128+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ec0160420 0x7f2ec01f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.128+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2ec0148b10 0x7f2ec00d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.128+0000 7f2ebf59e640 1 --2- 172.21.15.77:0/2347198410 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2ec006c930 0x7f2ec015e8c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.128+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 >> 172.21.15.77:0/2347198410 conn(0x7f2ec00b3bc0 msgr2=0x7f2ec006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:24.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.131+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 shutdown_connections 2024-05-15T19:04:24.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.131+0000 7f2ebf59e640 1 -- 172.21.15.77:0/2347198410 wait complete. 2024-05-15T19:04:24.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T19:04:24.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.571+0000 7f96cb514640 1 Processor -- start 2024-05-15T19:04:24.574 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.572+0000 7f96cb514640 1 -- start start 2024-05-15T19:04:24.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.575+0000 7f96cb514640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141fd0 0x7f96c415cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:24.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.575+0000 7f96cb514640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96c415d2b0 0x7f96c4073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:24.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.575+0000 7f96cb514640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96c4160380 con 0x7f96c4141bf0 2024-05-15T19:04:24.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.575+0000 7f96cb514640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f96c413f3b0 con 0x7f96c415d2b0 2024-05-15T19:04:24.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.575+0000 7f96cb514640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f96c4160660 con 0x7f96c4141fd0 2024-05-15T19:04:24.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96c415d2b0 0x7f96c4073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:24.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f96c415d2b0 0x7f96c4073310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:50666/0 (socket says 172.21.15.77:50666) 2024-05-15T19:04:24.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1842022739 learned_addr learned my addr 172.21.15.77:0/1842022739 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:24.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c8aaf640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141fd0 0x7f96c415cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:24.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141fd0 msgr2=0x7f96c415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:24.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141fd0 0x7f96c415cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1842022739 >> v1:172.21.15.77:6789/0 conn(0x7f96c4141bf0 legacy=0x7f96c415fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:24.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.576+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1842022739 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c4160940 con 0x7f96c415d2b0 2024-05-15T19:04:24.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.577+0000 7f96c8aaf640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141fd0 0x7f96c415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:24.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.579+0000 7f96c9ab1640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c415d2b0 0x7f96c4073310 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009870 tx=0x7f96bc02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c1d203c07eb6a6d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:24.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.580+0000 7f96bbfff640 1 -- 172.21.15.77:0/1842022739 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc037070 con 0x7f96c415d2b0 2024-05-15T19:04:24.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.580+0000 7f96bbfff640 1 -- 172.21.15.77:0/1842022739 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96bc032440 con 0x7f96c415d2b0 2024-05-15T19:04:24.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.580+0000 7f96bbfff640 1 -- 172.21.15.77:0/1842022739 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc032810 con 0x7f96c415d2b0 2024-05-15T19:04:24.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.581+0000 7f96cb514640 1 -- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c415d2b0 msgr2=0x7f96c4073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:24.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.581+0000 7f96cb514640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c415d2b0 0x7f96c4073310 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f96bc009870 tx=0x7f96bc02a250 comp rx=0 tx=0).stop 2024-05-15T19:04:24.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.581+0000 7f96cb514640 1 -- 172.21.15.77:0/1842022739 shutdown_connections 2024-05-15T19:04:24.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.581+0000 7f96cb514640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c415d2b0 0x7f96c4073310 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.581+0000 7f96cb514640 1 --2- 172.21.15.77:0/1842022739 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141fd0 0x7f96c415cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.581+0000 7f96cb514640 1 -- 172.21.15.77:0/1842022739 >> 172.21.15.77:0/1842022739 conn(0x7f96c40b3c30 msgr2=0x7f96c40b4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:24.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.582+0000 7f96cb514640 1 -- 172.21.15.77:0/1842022739 shutdown_connections 2024-05-15T19:04:24.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.582+0000 7f96cb514640 1 -- 172.21.15.77:0/1842022739 wait complete. 2024-05-15T19:04:24.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.584+0000 7f96cb514640 1 Processor -- start 2024-05-15T19:04:24.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.585+0000 7f96cb514640 1 -- start start 2024-05-15T19:04:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96cb514640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141bf0 0x7f96c4204ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96cb514640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c4141fd0 0x7f96c40d1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96cb514640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c415d2b0 0x7f96c415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96cb514640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96c4142430 con 0x7f96c415d2b0 2024-05-15T19:04:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96cb514640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f96c415c540 con 0x7f96c4141fd0 2024-05-15T19:04:24.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96cb514640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f96c41425b0 con 0x7f96c4141bf0 2024-05-15T19:04:24.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96c8aaf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c4141fd0 0x7f96c40d1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:24.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96c8aaf640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c4141fd0 0x7f96c40d1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:50672/0 (socket says 172.21.15.77:50672) 2024-05-15T19:04:24.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.586+0000 7f96c8aaf640 1 -- 172.21.15.77:0/1988261989 learned_addr learned my addr 172.21.15.77:0/1988261989 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:24.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.587+0000 7f96c92b0640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141bf0 0x7f96c4204ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:24.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.588+0000 7f96c9ab1640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c415d2b0 0x7f96c415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.589+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141bf0 msgr2=0x7f96c4204ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.589+0000 7f96c9ab1640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141bf0 0x7f96c4204ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.589+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c4141fd0 msgr2=0x7f96c40d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.589+0000 7f96c9ab1640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c4141fd0 0x7f96c40d1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.589+0000 7f96c9ab1640 1 -- 172.21.15.77:0/1988261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c4157af0 con 0x7f96c415d2b0 2024-05-15T19:04:24.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.591+0000 7f96c9ab1640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c415d2b0 0x7f96c415adc0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f96c40b4bf0 tx=0x7f96bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:24.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.593+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc041020 con 0x7f96c415d2b0 2024-05-15T19:04:24.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.593+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c4157dd0 con 0x7f96c415d2b0 2024-05-15T19:04:24.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.593+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96bc03d6e0 con 0x7f96c415d2b0 2024-05-15T19:04:24.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.594+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c4158390 con 0x7f96c415d2b0 2024-05-15T19:04:24.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.597+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c406a640 con 0x7f96c415d2b0 2024-05-15T19:04:24.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.597+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96bc037040 con 0x7f96c415d2b0 2024-05-15T19:04:24.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.602+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f96bc044020 con 0x7f96c415d2b0 2024-05-15T19:04:24.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.602+0000 7f96b9ffb640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96a80763a0 0x7f96a8078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:24.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.602+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f96bc0b7b80 con 0x7f96c415d2b0 2024-05-15T19:04:24.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.603+0000 7f96c92b0640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96a80763a0 0x7f96a8078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:24.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.604+0000 7f96c92b0640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96a80763a0 0x7f96a8078860 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f96c00012e0 tx=0x7f96c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:24.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:24.629+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f96bc04b030 con 0x7f96c415d2b0 2024-05-15T19:04:25.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.672+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96c40b63c0 con 0x7f96c415d2b0 2024-05-15T19:04:25.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.677+0000 7f96b9ffb640 1 -- 172.21.15.77:0/1988261989 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16786 (secure 0 0 0) 0x7f96bc0814d0 con 0x7f96c415d2b0 2024-05-15T19:04:25.681 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:25.681 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:11:25.415549+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:10:23.590791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T12:10:24.630314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]},{"pgid":"5.35","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T19:04:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.683+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96a80763a0 msgr2=0x7f96a8078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.683+0000 7f96cb514640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96a80763a0 0x7f96a8078860 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f96c00012e0 tx=0x7f96c0009040 comp rx=0 tx=0).stop 2024-05-15T19:04:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.683+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c415d2b0 msgr2=0x7f96c415adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.683+0000 7f96cb514640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c415d2b0 0x7f96c415adc0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f96c40b4bf0 tx=0x7f96bc0046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:25.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.683+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 shutdown_connections 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.683+0000 7f96cb514640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f96a80763a0 0x7f96a8078860 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.684+0000 7f96cb514640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c415d2b0 0x7f96c415adc0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.684+0000 7f96cb514640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f96c4141fd0 0x7f96c40d1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.684+0000 7f96cb514640 1 --2- 172.21.15.77:0/1988261989 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f96c4141bf0 0x7f96c4204ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.684+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 >> 172.21.15.77:0/1988261989 conn(0x7f96c40b3c30 msgr2=0x7f96c40b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.684+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 shutdown_connections 2024-05-15T19:04:25.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:25.684+0000 7f96cb514640 1 -- 172.21.15.77:0/1988261989 wait complete. 2024-05-15T19:04:25.724 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-15T19:04:25.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T19:04:26.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.128+0000 7fb9ff996640 1 Processor -- start 2024-05-15T19:04:26.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.129+0000 7fb9ff996640 1 -- start start 2024-05-15T19:04:26.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9ff996640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb9f815f510 0x7fb9f80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:26.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9ff996640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80af210 0x7fb9f80af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:26.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9ff996640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f80b46e0 con 0x7fb9f815f130 2024-05-15T19:04:26.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9ff996640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb9f80afbc0 con 0x7fb9f815f510 2024-05-15T19:04:26.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9ff996640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f80b4950 con 0x7fb9f80af210 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9fd732640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb9f815f130 0x7fb9f8073640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37422/0 (socket says 172.21.15.77:37422) 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9fd732640 1 -- 172.21.15.77:0/3242347355 learned_addr learned my addr 172.21.15.77:0/3242347355 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.132+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3242347355 >> v2:172.21.15.77:3300/0 conn(0x7fb9f815f510 0x7fb9f80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.133+0000 7fb9fdf33640 1 --2- 172.21.15.77:0/3242347355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80af210 0x7fb9f80af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.133+0000 7fb9effff640 1 -- 172.21.15.77:0/3242347355 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751922308 0 0) 0x7fb9f80b46e0 con 0x7fb9f815f130 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.133+0000 7fb9effff640 1 -- 172.21.15.77:0/3242347355 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9e4003520 con 0x7fb9f815f130 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.133+0000 7fb9fcf31640 1 -- 172.21.15.77:0/3242347355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80af210 msgr2=0x7fb9f80af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.133+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3242347355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80af210 0x7fb9f80af680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.133+0000 7fb9effff640 1 -- 172.21.15.77:0/3242347355 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 20247263 0 0) 0x7fb9e4003520 con 0x7fb9f815f130 2024-05-15T19:04:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.134+0000 7fb9fcf31640 1 -- 172.21.15.77:0/3242347355 >> v1:172.21.15.77:6789/0 conn(0x7fb9f815f130 legacy=0x7fb9f8073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.134+0000 7fb9fcf31640 1 -- 172.21.15.77:0/3242347355 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f80b4c30 con 0x7fb9f815f510 2024-05-15T19:04:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.137+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3242347355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f815f510 0x7fb9f80ae8a0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80097a0 tx=0x7fb9e802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc06a42dc015b43 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.137+0000 7fb9effff640 1 -- 172.21.15.77:0/3242347355 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8037070 con 0x7fb9f815f510 2024-05-15T19:04:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.137+0000 7fb9effff640 1 -- 172.21.15.77:0/3242347355 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e802aba0 con 0x7fb9f815f510 2024-05-15T19:04:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.137+0000 7fb9effff640 1 -- 172.21.15.77:0/3242347355 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0001a90 con 0x7fb9f815f510 2024-05-15T19:04:26.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.140+0000 7fb9ff996640 1 -- 172.21.15.77:0/3242347355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f815f510 msgr2=0x7fb9f80ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:26.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.140+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3242347355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f815f510 0x7fb9f80ae8a0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80097a0 tx=0x7fb9e802a110 comp rx=0 tx=0).stop 2024-05-15T19:04:26.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.140+0000 7fb9ff996640 1 -- 172.21.15.77:0/3242347355 shutdown_connections 2024-05-15T19:04:26.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.140+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3242347355 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80af210 0x7fb9f80af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:26.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.140+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3242347355 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f815f510 0x7fb9f80ae8a0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:26.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.140+0000 7fb9ff996640 1 -- 172.21.15.77:0/3242347355 >> 172.21.15.77:0/3242347355 conn(0x7fb9f8072b20 msgr2=0x7fb9f8072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:26.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.141+0000 7fb9ff996640 1 -- 172.21.15.77:0/3242347355 shutdown_connections 2024-05-15T19:04:26.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.141+0000 7fb9ff996640 1 -- 172.21.15.77:0/3242347355 wait complete. 2024-05-15T19:04:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.146+0000 7fb9ff996640 1 Processor -- start 2024-05-15T19:04:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.146+0000 7fb9ff996640 1 -- start start 2024-05-15T19:04:26.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.149+0000 7fb9ff996640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 0x7fb9f814ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.149+0000 7fb9fd732640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 0x7fb9f814ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.149+0000 7fb9fd732640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 0x7fb9f814ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46170/0 (socket says 172.21.15.77:46170) 2024-05-15T19:04:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.149+0000 7fb9fd732640 1 -- 172.21.15.77:0/3240357291 learned_addr learned my addr 172.21.15.77:0/3240357291 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.149+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9f815f130 0x7fb9f81565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.150+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80ce130 0x7fb9f80ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.150+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f80b5710 con 0x7fb9f80af210 2024-05-15T19:04:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.150+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f80b51f0 con 0x7fb9f815f130 2024-05-15T19:04:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.150+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f80b5890 con 0x7fb9f80ce130 2024-05-15T19:04:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.150+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9f815f130 0x7fb9f81565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.150+0000 7fb9fdf33640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80ce130 0x7fb9f80ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.151+0000 7fb9fcf31640 1 -- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80ce130 msgr2=0x7fb9f80ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.151+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80ce130 0x7fb9f80ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:26.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.151+0000 7fb9fcf31640 1 -- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 msgr2=0x7fb9f814ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:26.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.151+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 0x7fb9f814ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:26.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.151+0000 7fb9fcf31640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f80d0350 con 0x7fb9f815f130 2024-05-15T19:04:26.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.151+0000 7fb9fd732640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 0x7fb9f814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:26.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.152+0000 7fb9fcf31640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9f815f130 0x7fb9f81565f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8031000 tx=0x7fb9e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:26.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.153+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8041020 con 0x7fb9f815f130 2024-05-15T19:04:26.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.153+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e803d620 con 0x7fb9f815f130 2024-05-15T19:04:26.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.153+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8037040 con 0x7fb9f815f130 2024-05-15T19:04:26.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.154+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f80d0630 con 0x7fb9f815f130 2024-05-15T19:04:26.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.155+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f80d0bf0 con 0x7fb9f815f130 2024-05-15T19:04:26.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.158+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f80694d0 con 0x7fb9f815f130 2024-05-15T19:04:26.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.159+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb9e8044020 con 0x7fb9f815f130 2024-05-15T19:04:26.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.161+0000 7fb9edffb640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb9dc076320 0x7fb9dc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:26.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.162+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7fb9e80b7a60 con 0x7fb9f815f130 2024-05-15T19:04:26.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.162+0000 7fb9fd732640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb9dc076320 0x7fb9dc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:26.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.164+0000 7fb9fd732640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb9dc076320 0x7fb9dc0787e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007fd0 tx=0x7fb9f0001b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:26.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:26.169+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb9e804b030 con 0x7fb9f815f130 2024-05-15T19:04:27.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.430+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9f80b4730 con 0x7fb9f815f130 2024-05-15T19:04:27.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.431+0000 7fb9edffb640 1 -- 172.21.15.77:0/3240357291 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5178 (secure 0 0 0) 0x7fb9e80813b0 con 0x7fb9f815f130 2024-05-15T19:04:27.438 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:27.438 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:10:25.666896+0000","modified":"2024-05-15T12:10:27.671771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4863},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4863":{"gid":4863,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1303228576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1303228576},{"type":"v1","addr":"172.21.15.77:6837","nonce":1303228576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4863,"qdb_cluster":[4863]},"id":2}]} 2024-05-15T19:04:27.439 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-05-15T19:04:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb9dc076320 msgr2=0x7fb9dc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb9dc076320 0x7fb9dc0787e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007fd0 tx=0x7fb9f0001b70 comp rx=0 tx=0).stop 2024-05-15T19:04:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9f815f130 msgr2=0x7fb9f81565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:27.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9f815f130 0x7fb9f81565f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8031000 tx=0x7fb9e80046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 shutdown_connections 2024-05-15T19:04:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb9dc076320 0x7fb9dc0787e0 secure :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0007fd0 tx=0x7fb9f0001b70 comp rx=0 tx=0).stop 2024-05-15T19:04:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb9f80ce130 0x7fb9f80ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb9f815f130 0x7fb9f81565f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 --2- 172.21.15.77:0/3240357291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb9f80af210 0x7fb9f814ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.440+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 >> 172.21.15.77:0/3240357291 conn(0x7fb9f8072b20 msgr2=0x7fb9f8162b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:27.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.443+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 shutdown_connections 2024-05-15T19:04:27.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.443+0000 7fb9ff996640 1 -- 172.21.15.77:0/3240357291 wait complete. 2024-05-15T19:04:27.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T19:04:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.683+0000 7f16361b6640 1 Processor -- start 2024-05-15T19:04:27.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.683+0000 7f16361b6640 1 -- start start 2024-05-15T19:04:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f16361b6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f16300b3710 0x7f16300b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f16361b6640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f163015b010 0x7f1630073210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:27.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f16361b6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16300cf270 con 0x7f16300d03d0 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f16361b6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f163006e570 con 0x7f16300b3710 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f16361b6640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f16300b4460 con 0x7f163015b010 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f162effd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f16300d03d0 0x7f16300ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37438/0 (socket says 172.21.15.77:37438) 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f162effd640 1 -- 172.21.15.77:0/3624274053 learned_addr learned my addr 172.21.15.77:0/3624274053 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.684+0000 7f162ffff640 1 --2- 172.21.15.77:0/3624274053 >> v2:172.21.15.83:3300/0 conn(0x7f163015b010 0x7f1630073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.685+0000 7f162e7fc640 1 -- 172.21.15.77:0/3624274053 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128016719 0 0) 0x7f1620001110 con 0x7f16300d03d0 2024-05-15T19:04:27.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.685+0000 7f162e7fc640 1 -- 172.21.15.77:0/3624274053 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1618003520 con 0x7f16300d03d0 2024-05-15T19:04:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.685+0000 7f162ffff640 1 -- 172.21.15.77:0/3624274053 >> v2:172.21.15.77:3300/0 conn(0x7f16300b3710 msgr2=0x7f16300b3f20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-15T19:04:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.685+0000 7f162ffff640 1 --2- 172.21.15.77:0/3624274053 >> v2:172.21.15.77:3300/0 conn(0x7f16300b3710 0x7f16300b3f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.685+0000 7f162ffff640 1 -- 172.21.15.77:0/3624274053 >> v1:172.21.15.77:6789/0 conn(0x7f16300d03d0 legacy=0x7f16300ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:27.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.686+0000 7f162ffff640 1 -- 172.21.15.77:0/3624274053 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16300b4700 con 0x7f163015b010 2024-05-15T19:04:27.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.688+0000 7f162ffff640 1 --2- 172.21.15.77:0/3624274053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163015b010 0x7f1630073210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1630070d90 tx=0x7f162802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41de2a9aba06aa52 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:27.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.692+0000 7f162e7fc640 1 -- 172.21.15.77:0/3624274053 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628007740 con 0x7f163015b010 2024-05-15T19:04:27.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.692+0000 7f162e7fc640 1 -- 172.21.15.77:0/3624274053 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16280078e0 con 0x7f163015b010 2024-05-15T19:04:27.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.692+0000 7f162e7fc640 1 -- 172.21.15.77:0/3624274053 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628007cb0 con 0x7f163015b010 2024-05-15T19:04:27.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.694+0000 7f16361b6640 1 -- 172.21.15.77:0/3624274053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163015b010 msgr2=0x7f1630073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:27.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.694+0000 7f16361b6640 1 --2- 172.21.15.77:0/3624274053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163015b010 0x7f1630073210 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1630070d90 tx=0x7f162802a730 comp rx=0 tx=0).stop 2024-05-15T19:04:27.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.695+0000 7f16361b6640 1 -- 172.21.15.77:0/3624274053 shutdown_connections 2024-05-15T19:04:27.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.695+0000 7f16361b6640 1 --2- 172.21.15.77:0/3624274053 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f163015b010 0x7f1630073210 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.695+0000 7f16361b6640 1 --2- 172.21.15.77:0/3624274053 >> v2:172.21.15.77:3300/0 conn(0x7f16300b3710 0x7f16300b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.695+0000 7f16361b6640 1 -- 172.21.15.77:0/3624274053 >> 172.21.15.77:0/3624274053 conn(0x7f16300b2c20 msgr2=0x7f16300b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:27.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.696+0000 7f16361b6640 1 -- 172.21.15.77:0/3624274053 shutdown_connections 2024-05-15T19:04:27.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.698+0000 7f16361b6640 1 -- 172.21.15.77:0/3624274053 wait complete. 2024-05-15T19:04:27.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.705+0000 7f16361b6640 1 Processor -- start 2024-05-15T19:04:27.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.706+0000 7f16361b6640 1 -- start start 2024-05-15T19:04:27.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.709+0000 7f16361b6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16300b3710 0x7f1630146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:27.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.709+0000 7f16361b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16300d03d0 0x7f163014ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:27.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.710+0000 7f16361b6640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 0x7f16300729c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:27.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.710+0000 7f16361b6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f163015b480 con 0x7f16300d03d0 2024-05-15T19:04:27.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.710+0000 7f16361b6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f16300b4cc0 con 0x7f16300b3710 2024-05-15T19:04:27.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.710+0000 7f16361b6640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f163015b600 con 0x7f163015b010 2024-05-15T19:04:27.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.710+0000 7f162ffff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 0x7f16300729c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:27.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 0x7f16300729c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:52670/0 (socket says 172.21.15.77:52670) 2024-05-15T19:04:27.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 -- 172.21.15.77:0/1015545164 learned_addr learned my addr 172.21.15.77:0/1015545164 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:27.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162f7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16300b3710 0x7f1630146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:27.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162effd640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16300d03d0 0x7f163014ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:27.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 -- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16300b3710 msgr2=0x7f1630146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:27.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16300b3710 0x7f1630146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 -- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16300d03d0 msgr2=0x7f163014ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:27.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16300d03d0 0x7f163014ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.711+0000 7f162ffff640 1 -- 172.21.15.77:0/1015545164 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163014b640 con 0x7f163015b010 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.712+0000 7f162ffff640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 0x7f16300729c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1628009e50 tx=0x7f1628004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.712+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162803f070 con 0x7f163015b010 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.712+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1628031bf0 con 0x7f163015b010 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.712+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1630169680 con 0x7f163015b010 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.712+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1628009450 con 0x7f163015b010 2024-05-15T19:04:27.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.712+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1630169c40 con 0x7f163015b010 2024-05-15T19:04:27.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.717+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1628044460 con 0x7f163015b010 2024-05-15T19:04:27.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.719+0000 7f1617fff640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f161c076320 0x7f161c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.719+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f16280b8a90 con 0x7f163015b010 2024-05-15T19:04:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.719+0000 7f162f7fe640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f161c076320 0x7f161c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.720+0000 7f162f7fe640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f161c076320 0x7f161c0787e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1630168ef0 tx=0x7f16240090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:27.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.721+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16300694d0 con 0x7f163015b010 2024-05-15T19:04:27.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:27.732+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f16300694d0 con 0x7f163015b010 2024-05-15T19:04:28.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.681+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16300697d0 con 0x7f163015b010 2024-05-15T19:04:28.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.683+0000 7f1617fff640 1 -- 172.21.15.77:0/1015545164 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5178 (secure 0 0 0) 0x7f1628081e90 con 0x7f163015b010 2024-05-15T19:04:28.687 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:28.687 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-15T12:10:25.666896+0000","modified":"2024-05-15T12:10:27.671771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4863},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4863":{"gid":4863,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6837/1303228576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1303228576},{"type":"v1","addr":"172.21.15.77:6837","nonce":1303228576}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4863,"qdb_cluster":[4863]},"id":2}]} 2024-05-15T19:04:28.687 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 15 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.690+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f161c076320 msgr2=0x7f161c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.690+0000 7f16361b6640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f161c076320 0x7f161c0787e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1630168ef0 tx=0x7f16240090e0 comp rx=0 tx=0).stop 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.690+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 msgr2=0x7f16300729c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.690+0000 7f16361b6640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 0x7f16300729c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1628009e50 tx=0x7f1628004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.690+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 shutdown_connections 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.690+0000 7f16361b6640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f161c076320 0x7f161c0787e0 secure :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1630168ef0 tx=0x7f16240090e0 comp rx=0 tx=0).stop 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.691+0000 7f16361b6640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f163015b010 0x7f16300729c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.691+0000 7f16361b6640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16300d03d0 0x7f163014ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.691+0000 7f16361b6640 1 --2- 172.21.15.77:0/1015545164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f16300b3710 0x7f1630146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.691+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 >> 172.21.15.77:0/1015545164 conn(0x7f16300b2c20 msgr2=0x7f163015f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.691+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 shutdown_connections 2024-05-15T19:04:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:28.692+0000 7f16361b6640 1 -- 172.21.15.77:0/1015545164 wait complete. 2024-05-15T19:04:28.736 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T19:04:29.111 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.108+0000 7fbe56519640 1 Processor -- start 2024-05-15T19:04:29.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.109+0000 7fbe56519640 1 -- start start 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe56519640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50073ab0 0x7fbe500cff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe56519640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe500d0640 con 0x7fbe50141e40 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe56519640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe500d0920 con 0x7fbe5013ee10 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe56519640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbe500d0c00 con 0x7fbe50073ab0 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe4ffff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fbe5013ee10 0x7fbe50141730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:40670/0 (socket says 172.21.15.77:40670) 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe4ffff640 1 -- 172.21.15.77:0/3922558068 learned_addr learned my addr 172.21.15.77:0/3922558068 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe54ab6640 1 --2- 172.21.15.77:0/3922558068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50073ab0 0x7fbe500cff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297902604 0 0) 0x7fbe500d0920 con 0x7fbe5013ee10 2024-05-15T19:04:29.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.113+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe38003520 con 0x7fbe5013ee10 2024-05-15T19:04:29.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.114+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1294867442 0 0) 0x7fbe500d0640 con 0x7fbe50141e40 2024-05-15T19:04:29.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.114+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe500d0920 con 0x7fbe50141e40 2024-05-15T19:04:29.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.114+0000 7fbe54ab6640 1 -- 172.21.15.77:0/3922558068 >> v1:172.21.15.83:6789/0 conn(0x7fbe5013ee10 legacy=0x7fbe50141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.114+0000 7fbe54ab6640 1 -- 172.21.15.77:0/3922558068 >> v1:172.21.15.77:6789/0 conn(0x7fbe50141e40 legacy=0x7fbe500cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.114+0000 7fbe54ab6640 1 -- 172.21.15.77:0/3922558068 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe500722a0 con 0x7fbe50073ab0 2024-05-15T19:04:29.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.117+0000 7fbe54ab6640 1 --2- 172.21.15.77:0/3922558068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50073ab0 0x7fbe500cff90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009dc0 tx=0x7fbe4802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9486243813518414 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:29.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.117+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe48035020 con 0x7fbe50073ab0 2024-05-15T19:04:29.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.117+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe48007540 con 0x7fbe50073ab0 2024-05-15T19:04:29.120 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.117+0000 7fbe4effd640 1 -- 172.21.15.77:0/3922558068 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe400016f0 con 0x7fbe50073ab0 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.119+0000 7fbe56519640 1 -- 172.21.15.77:0/3922558068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50073ab0 msgr2=0x7fbe500cff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.119+0000 7fbe56519640 1 --2- 172.21.15.77:0/3922558068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50073ab0 0x7fbe500cff90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe48009dc0 tx=0x7fbe4802a680 comp rx=0 tx=0).stop 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.120+0000 7fbe56519640 1 -- 172.21.15.77:0/3922558068 shutdown_connections 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.120+0000 7fbe56519640 1 --2- 172.21.15.77:0/3922558068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50073ab0 0x7fbe500cff90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.120+0000 7fbe56519640 1 -- 172.21.15.77:0/3922558068 >> 172.21.15.77:0/3922558068 conn(0x7fbe5006c810 msgr2=0x7fbe5006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.120+0000 7fbe56519640 1 -- 172.21.15.77:0/3922558068 shutdown_connections 2024-05-15T19:04:29.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.120+0000 7fbe56519640 1 -- 172.21.15.77:0/3922558068 wait complete. 2024-05-15T19:04:29.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.125+0000 7fbe56519640 1 Processor -- start 2024-05-15T19:04:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.126+0000 7fbe56519640 1 -- start start 2024-05-15T19:04:29.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.129+0000 7fbe56519640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe50073ab0 0x7fbe50137de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.129+0000 7fbe56519640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe5013ee10 0x7fbe50139f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.129+0000 7fbe56519640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50141e40 0x7fbe501405d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.129+0000 7fbe56519640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5013f370 con 0x7fbe50073ab0 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.129+0000 7fbe56519640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5013f1f0 con 0x7fbe5013ee10 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.129+0000 7fbe56519640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fbe50166f90 con 0x7fbe50141e40 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.130+0000 7fbe54ab6640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50141e40 0x7fbe501405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.130+0000 7fbe54ab6640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50141e40 0x7fbe501405d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:52698/0 (socket says 172.21.15.77:52698) 2024-05-15T19:04:29.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.130+0000 7fbe54ab6640 1 -- 172.21.15.77:0/1621402732 learned_addr learned my addr 172.21.15.77:0/1621402732 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:29.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.130+0000 7fbe4ffff640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe50073ab0 0x7fbe50137de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.130+0000 7fbe4f7fe640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe5013ee10 0x7fbe50139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.131+0000 7fbe4ffff640 1 -- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50141e40 msgr2=0x7fbe501405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.131+0000 7fbe4ffff640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50141e40 0x7fbe501405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.131+0000 7fbe4ffff640 1 -- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe5013ee10 msgr2=0x7fbe50139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.131+0000 7fbe4ffff640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe5013ee10 0x7fbe50139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.131+0000 7fbe4ffff640 1 -- 172.21.15.77:0/1621402732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe500b0770 con 0x7fbe50073ab0 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.131+0000 7fbe4ffff640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe50073ab0 0x7fbe50137de0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fbe40001e50 tx=0x7fbe4000cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.132+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe400070d0 con 0x7fbe50073ab0 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.132+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe40018020 con 0x7fbe50073ab0 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.132+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe400074b0 con 0x7fbe50073ab0 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.132+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe500b0a50 con 0x7fbe50073ab0 2024-05-15T19:04:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.132+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe500b1010 con 0x7fbe50073ab0 2024-05-15T19:04:29.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.135+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe30005290 con 0x7fbe50073ab0 2024-05-15T19:04:29.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.138+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe400047e0 con 0x7fbe50073ab0 2024-05-15T19:04:29.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.139+0000 7fbe4cff9640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe3c0762d0 0x7fbe3c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.140+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7fbe4009b150 con 0x7fbe50073ab0 2024-05-15T19:04:29.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.140+0000 7fbe4f7fe640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe3c0762d0 0x7fbe3c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.142+0000 7fbe4f7fe640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe3c0762d0 0x7fbe3c078790 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbe5015c850 tx=0x7fbe44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:29.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.147+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe40022030 con 0x7fbe50073ab0 2024-05-15T19:04:29.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.462+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe30005580 con 0x7fbe50073ab0 2024-05-15T19:04:29.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.465+0000 7fbe4cff9640 1 -- 172.21.15.77:0/1621402732 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16786 (secure 0 0 0) 0x7fbe400649a0 con 0x7fbe50073ab0 2024-05-15T19:04:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:29.470 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":34,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T12:11:25.415549+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-05-15T12:10:23.590791+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-05-15T12:10:24.630314+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.27","mappings":[{"from":4,"to":5}]},{"pgid":"5.35","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.469+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe3c0762d0 msgr2=0x7fbe3c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.469+0000 7fbe56519640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe3c0762d0 0x7fbe3c078790 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbe5015c850 tx=0x7fbe44009040 comp rx=0 tx=0).stop 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.469+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe50073ab0 msgr2=0x7fbe50137de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.469+0000 7fbe56519640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe50073ab0 0x7fbe50137de0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fbe40001e50 tx=0x7fbe4000cb40 comp rx=0 tx=0).stop 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 shutdown_connections 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fbe3c0762d0 0x7fbe3c078790 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fbe50141e40 0x7fbe501405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fbe5013ee10 0x7fbe50139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 --2- 172.21.15.77:0/1621402732 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe50073ab0 0x7fbe50137de0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 >> 172.21.15.77:0/1621402732 conn(0x7fbe5006c810 msgr2=0x7fbe5015b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 shutdown_connections 2024-05-15T19:04:29.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.470+0000 7fbe56519640 1 -- 172.21.15.77:0/1621402732 wait complete. 2024-05-15T19:04:29.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-15T19:04:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.762+0000 7f811b012640 1 Processor -- start 2024-05-15T19:04:29.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.762+0000 7f811b012640 1 -- start start 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.766+0000 7f811b012640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81140d1560 0x7f811415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.766+0000 7f811b012640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8114160870 con 0x7f81140cd940 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.766+0000 7f811b012640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81140cddb0 con 0x7f81140cd490 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.766+0000 7f811b012640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f8114162dd0 con 0x7f81140d1560 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.767+0000 7f811a010640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81140d1560 0x7f811415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.767+0000 7f811a811640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f81140cd940 0x7f8114160160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37442/0 (socket says 172.21.15.77:37442) 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.767+0000 7f811a010640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f81140d1560 0x7f811415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:50722/0 (socket says 172.21.15.77:50722) 2024-05-15T19:04:29.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.767+0000 7f811a811640 1 -- 172.21.15.77:0/3703864258 learned_addr learned my addr 172.21.15.77:0/3703864258 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.767+0000 7f811900e640 1 -- 172.21.15.77:0/3703864258 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987814614 0 0) 0x7f81140cddb0 con 0x7f81140cd490 2024-05-15T19:04:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.768+0000 7f811900e640 1 -- 172.21.15.77:0/3703864258 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8100003520 con 0x7f81140cd490 2024-05-15T19:04:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.768+0000 7f811900e640 1 -- 172.21.15.77:0/3703864258 <== mon.1 v1:172.21.15.83:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2867678457 0 0) 0x7f8100003520 con 0x7f81140cd490 2024-05-15T19:04:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.768+0000 7f811a010640 1 -- 172.21.15.77:0/3703864258 >> v1:172.21.15.83:6789/0 conn(0x7f81140cd490 legacy=0x7f811415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.768+0000 7f811a010640 1 -- 172.21.15.77:0/3703864258 >> v1:172.21.15.77:6789/0 conn(0x7f81140cd940 legacy=0x7f8114160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.768+0000 7f811a010640 1 -- 172.21.15.77:0/3703864258 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81140cc430 con 0x7f81140d1560 2024-05-15T19:04:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.771+0000 7f811a010640 1 --2- 172.21.15.77:0/3703864258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f811415cee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d90 tx=0x7f810c02a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb5ac1adf95bc9d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.771+0000 7f811900e640 1 -- 172.21.15.77:0/3703864258 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c035020 con 0x7f81140d1560 2024-05-15T19:04:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.771+0000 7f811900e640 1 -- 172.21.15.77:0/3703864258 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c007540 con 0x7f81140d1560 2024-05-15T19:04:29.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.771+0000 7f811900e640 1 -- 172.21.15.77:0/3703864258 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81100016f0 con 0x7f81140d1560 2024-05-15T19:04:29.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.773+0000 7f811b012640 1 -- 172.21.15.77:0/3703864258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 msgr2=0x7f811415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.773+0000 7f811b012640 1 --2- 172.21.15.77:0/3703864258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f811415cee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d90 tx=0x7f810c02a5b0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.773+0000 7f811b012640 1 -- 172.21.15.77:0/3703864258 shutdown_connections 2024-05-15T19:04:29.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.773+0000 7f811b012640 1 --2- 172.21.15.77:0/3703864258 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f811415cee0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.773+0000 7f811b012640 1 -- 172.21.15.77:0/3703864258 >> 172.21.15.77:0/3703864258 conn(0x7f81140ce6c0 msgr2=0x7f81140cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:29.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.774+0000 7f811b012640 1 -- 172.21.15.77:0/3703864258 shutdown_connections 2024-05-15T19:04:29.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.775+0000 7f811b012640 1 -- 172.21.15.77:0/3703864258 wait complete. 2024-05-15T19:04:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.780+0000 7f811b012640 1 Processor -- start 2024-05-15T19:04:29.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.780+0000 7f811b012640 1 -- start start 2024-05-15T19:04:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811b012640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 0x7f81140cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811b012640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81140cd940 0x7f81140c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811b012640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f8114156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811b012640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81140cccd0 con 0x7f81140cd940 2024-05-15T19:04:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811b012640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f81140cc9f0 con 0x7f81140d1560 2024-05-15T19:04:29.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811b012640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f81140ccfb0 con 0x7f81140cd490 2024-05-15T19:04:29.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811a010640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 0x7f81140cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811a010640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 0x7f81140cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:52712/0 (socket says 172.21.15.77:52712) 2024-05-15T19:04:29.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.783+0000 7f811a010640 1 -- 172.21.15.77:0/3744181602 learned_addr learned my addr 172.21.15.77:0/3744181602 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.784+0000 7f811a811640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f8114156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.784+0000 7f811a010640 1 -- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 msgr2=0x7f8114156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.784+0000 7f811a010640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f8114156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.784+0000 7f811a010640 1 -- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81140cd940 msgr2=0x7f81140c9d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.784+0000 7f811a010640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81140cd940 0x7f81140c9d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.784+0000 7f811a010640 1 -- 172.21.15.77:0/3744181602 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81140ca2a0 con 0x7f81140cd490 2024-05-15T19:04:29.788 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.785+0000 7f811a010640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 0x7f81140cb5c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d90 tx=0x7f810c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:29.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.786+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c040070 con 0x7f81140cd490 2024-05-15T19:04:29.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.786+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f810c031c40 con 0x7f81140cd490 2024-05-15T19:04:29.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.786+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f810c035040 con 0x7f81140cd490 2024-05-15T19:04:29.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.786+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81140ca520 con 0x7f81140cd490 2024-05-15T19:04:29.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.786+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81140caae0 con 0x7f81140cd490 2024-05-15T19:04:29.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.788+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8114076760 con 0x7f81140cd490 2024-05-15T19:04:29.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.791+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f810c043070 con 0x7f81140cd490 2024-05-15T19:04:29.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.793+0000 7f810affd640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f80f8076320 0x7f80f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:29.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.793+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f810c0b8210 con 0x7f81140cd490 2024-05-15T19:04:29.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.793+0000 7f811980f640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f80f8076320 0x7f80f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:29.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.795+0000 7f811980f640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f80f8076320 0x7f80f80787e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8110001220 tx=0x7f81100010f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:29.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:29.799+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f81140ca2a0 con 0x7f81140cd490 2024-05-15T19:04:30.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.932+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8114070db0 con 0x7f81140cd490 2024-05-15T19:04:30.937 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-05-15T19:04:30.934+0000 7f9551be8640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-15T19:04:30.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.943+0000 7f810affd640 1 -- 172.21.15.77:0/3744181602 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7f810c0814f0 con 0x7f81140cd490 2024-05-15T19:04:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-15T19:04:30.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f80f8076320 msgr2=0x7f80f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f80f8076320 0x7f80f80787e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8110001220 tx=0x7f81100010f0 comp rx=0 tx=0).stop 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 msgr2=0x7f81140cb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 0x7f81140cb5c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f810c009d90 tx=0x7f810c004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 shutdown_connections 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f80f8076320 0x7f80f80787e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f81140d1560 0x7f8114156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81140cd940 0x7f81140c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 --2- 172.21.15.77:0/3744181602 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f81140cd490 0x7f81140cb5c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:30.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.955+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 >> 172.21.15.77:0/3744181602 conn(0x7f81140ce6c0 msgr2=0x7f81140cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:30.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.960+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 shutdown_connections 2024-05-15T19:04:30.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:30.960+0000 7f811b012640 1 -- 172.21.15.77:0/3744181602 wait complete. 2024-05-15T19:04:30.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-15T19:04:31.052 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2024-05-15T19:04:31.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.255+0000 7f1ab1bf7640 1 Processor -- start 2024-05-15T19:04:31.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.255+0000 7f1ab1bf7640 1 -- start start 2024-05-15T19:04:31.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1ab1bf7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f1aac15f310 0x7f1aac0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:31.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1ab1bf7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0d4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:31.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1ab1bf7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aac0d2e10 con 0x7f1aac0d0300 2024-05-15T19:04:31.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1ab1bf7640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f1aac0d3440 con 0x7f1aac15f310 2024-05-15T19:04:31.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1ab1bf7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1aac0b5ed0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1aaaffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1aac0d0300 0x7f1aac0d38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:37452/0 (socket says 172.21.15.77:37452) 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1aaaffd640 1 -- 172.21.15.77:0/5065905 learned_addr learned my addr 172.21.15.77:0/5065905 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1aab7fe640 1 --2- 172.21.15.77:0/5065905 >> v2:172.21.15.83:3300/0 conn(0x7f1aac15f310 0x7f1aac0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.257+0000 7f1aabfff640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0d4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aaa7fc640 1 -- 172.21.15.77:0/5065905 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330104316 0 0) 0x7f1aac0d2e10 con 0x7f1aac0d0300 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aaa7fc640 1 -- 172.21.15.77:0/5065905 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a94003520 con 0x7f1aac0d0300 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aab7fe640 1 -- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 msgr2=0x7f1aac0d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aab7fe640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0d4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aab7fe640 1 -- 172.21.15.77:0/5065905 >> v1:172.21.15.77:6789/0 conn(0x7f1aac0d0300 legacy=0x7f1aac0d38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aab7fe640 1 -- 172.21.15.77:0/5065905 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac0b61b0 con 0x7f1aac15f310 2024-05-15T19:04:31.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.258+0000 7f1aabfff640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0d4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:31.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.260+0000 7f1aab7fe640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac15f310 0x7f1aac0cfdc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0097a0 tx=0x7f1a9c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68cbe6f6a2576e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:31.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.260+0000 7f1aaa7fc640 1 -- 172.21.15.77:0/5065905 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c037070 con 0x7f1aac15f310 2024-05-15T19:04:31.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.260+0000 7f1aaa7fc640 1 -- 172.21.15.77:0/5065905 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9c02ae50 con 0x7f1aac15f310 2024-05-15T19:04:31.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.260+0000 7f1aaa7fc640 1 -- 172.21.15.77:0/5065905 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c032660 con 0x7f1aac15f310 2024-05-15T19:04:31.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac15f310 msgr2=0x7f1aac0cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:31.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac15f310 0x7f1aac0cfdc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c0097a0 tx=0x7f1a9c02a100 comp rx=0 tx=0).stop 2024-05-15T19:04:31.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/5065905 shutdown_connections 2024-05-15T19:04:31.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0d4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:31.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/5065905 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac15f310 0x7f1aac0cfdc0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:31.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/5065905 >> 172.21.15.77:0/5065905 conn(0x7f1aac08ebf0 msgr2=0x7f1aac09e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:31.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/5065905 shutdown_connections 2024-05-15T19:04:31.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.262+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/5065905 wait complete. 2024-05-15T19:04:31.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.265+0000 7f1ab1bf7640 1 Processor -- start 2024-05-15T19:04:31.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.266+0000 7f1ab1bf7640 1 -- start start 2024-05-15T19:04:31.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1ab1bf7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac0d0300 0x7f1aac0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:31.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1ab1bf7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:31.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1ab1bf7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac15f310 0x7f1aac152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:31.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1ab1bf7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac15f870 con 0x7f1aac15f310 2024-05-15T19:04:31.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1ab1bf7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f1aac15f6f0 con 0x7f1aac0d0300 2024-05-15T19:04:31.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1ab1bf7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f1aac0d5490 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac0d0300 0x7f1aac0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:31.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac15f310 0x7f1aac152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:52750/0 (socket says 172.21.15.77:52750) 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 -- 172.21.15.77:0/2103001823 learned_addr learned my addr 172.21.15.77:0/2103001823 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aab7fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac0d0300 0x7f1aac0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:50754/0 (socket says 172.21.15.77:50754) 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 -- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac0d0300 msgr2=0x7f1aac0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac0d0300 0x7f1aac0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 -- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac15f310 msgr2=0x7f1aac152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac15f310 0x7f1aac152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.268+0000 7f1aaaffd640 1 -- 172.21.15.77:0/2103001823 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aac0b28f0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.269+0000 7f1aaaffd640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0c9780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000c530 tx=0x7f1aa000c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.269+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0017070 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.269+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa0005ce0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.269+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0007270 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.269+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aac0b2bd0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.269+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aac0b3190 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.271+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac0695f0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.272+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1aa001a070 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.273+0000 7f1a93fff640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1a980762d0 0x7f1a98078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.274+0000 7f1aab7fe640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1a980762d0 0x7f1a98078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.274+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5911+0+0 (secure 0 0 0) 0x7f1aa00967f0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.275+0000 7f1aab7fe640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1a980762d0 0x7f1a98078790 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c034000 tx=0x7f1a9c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.277+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1aac0695f0 con 0x7f1aac0d3fe0 2024-05-15T19:04:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:31.967+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1aac0b4ca0 con 0x7f1aac0d3fe0 2024-05-15T19:04:32.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.943+0000 7f1a93fff640 1 -- 172.21.15.77:0/2103001823 <== mon.2 v2:172.21.15.83:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7f1aa005fac0 con 0x7f1aac0d3fe0 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.948+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1a980762d0 msgr2=0x7f1a98078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.948+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1a980762d0 0x7f1a98078790 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c034000 tx=0x7f1a9c02e000 comp rx=0 tx=0).stop 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 msgr2=0x7f1aac0c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0c9780 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000c530 tx=0x7f1aa000c930 comp rx=0 tx=0).stop 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 shutdown_connections 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f1a980762d0 0x7f1a98078790 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:32.952 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f1aac0d3fe0 0x7f1aac0c9780 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1aac15f310 0x7f1aac152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 --2- 172.21.15.77:0/2103001823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f1aac0d0300 0x7f1aac0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 >> 172.21.15.77:0/2103001823 conn(0x7f1aac08ebf0 msgr2=0x7f1aac0d5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 shutdown_connections 2024-05-15T19:04:32.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:32.949+0000 7f1ab1bf7640 1 -- 172.21.15.77:0/2103001823 wait complete. 2024-05-15T19:04:32.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-15T19:04:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.258+0000 7fb566454640 1 Processor -- start 2024-05-15T19:04:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.258+0000 7fb566454640 1 -- start start 2024-05-15T19:04:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb566454640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fb56015f440 0x7fb5600b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb566454640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 0x7fb5600d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb566454640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb5600d1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb566454640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fb5600d30e0 con 0x7fb5600b4f30 2024-05-15T19:04:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb566454640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fb5600b53a0 con 0x7fb56015f440 2024-05-15T19:04:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb566454640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb5600d5860 con 0x7fb5600d53d0 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb55f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 0x7fb5600d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.260+0000 7fb55f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 0x7fb5600d4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41304/0 (socket says 172.21.15.77:41304) 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb55f7fe640 1 -- 172.21.15.77:0/1739833351 learned_addr learned my addr 172.21.15.77:0/1739833351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb5649f1640 1 --2- 172.21.15.77:0/1739833351 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb5600d1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb55ffff640 1 --2- 172.21.15.77:0/1739833351 >> v2:172.21.15.83:3300/0 conn(0x7fb56015f440 0x7fb5600b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb5649f1640 1 -- 172.21.15.77:0/1739833351 >> v2:172.21.15.83:3300/0 conn(0x7fb56015f440 msgr2=0x7fb5600b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb5649f1640 1 --2- 172.21.15.77:0/1739833351 >> v2:172.21.15.83:3300/0 conn(0x7fb56015f440 0x7fb5600b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb5649f1640 1 -- 172.21.15.77:0/1739833351 >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 msgr2=0x7fb5600d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb5649f1640 1 --2- 172.21.15.77:0/1739833351 >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 0x7fb5600d4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb5649f1640 1 -- 172.21.15.77:0/1739833351 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5600b55d0 con 0x7fb5600d53d0 2024-05-15T19:04:33.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.261+0000 7fb55f7fe640 1 --2- 172.21.15.77:0/1739833351 >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 0x7fb5600d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.262+0000 7fb5649f1640 1 --2- 172.21.15.77:0/1739833351 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb5600d1bd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb56008d850 tx=0x7fb55802a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2019f1240de5c4a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.262+0000 7fb55effd640 1 -- 172.21.15.77:0/1739833351 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558007740 con 0x7fb5600d53d0 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.262+0000 7fb55effd640 1 -- 172.21.15.77:0/1739833351 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5580078e0 con 0x7fb5600d53d0 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.262+0000 7fb55effd640 1 -- 172.21.15.77:0/1739833351 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558007cb0 con 0x7fb5600d53d0 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 -- 172.21.15.77:0/1739833351 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 msgr2=0x7fb5600d1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 --2- 172.21.15.77:0/1739833351 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb5600d1bd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb56008d850 tx=0x7fb55802a540 comp rx=0 tx=0).stop 2024-05-15T19:04:33.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 -- 172.21.15.77:0/1739833351 shutdown_connections 2024-05-15T19:04:33.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 --2- 172.21.15.77:0/1739833351 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb5600d1bd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 --2- 172.21.15.77:0/1739833351 >> v2:172.21.15.77:3300/0 conn(0x7fb5600b4f30 0x7fb5600d4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 --2- 172.21.15.77:0/1739833351 >> v2:172.21.15.83:3300/0 conn(0x7fb56015f440 0x7fb5600b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 -- 172.21.15.77:0/1739833351 >> 172.21.15.77:0/1739833351 conn(0x7fb56008ebb0 msgr2=0x7fb56009e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:33.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 -- 172.21.15.77:0/1739833351 shutdown_connections 2024-05-15T19:04:33.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.264+0000 7fb566454640 1 -- 172.21.15.77:0/1739833351 wait complete. 2024-05-15T19:04:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.267+0000 7fb566454640 1 Processor -- start 2024-05-15T19:04:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.268+0000 7fb566454640 1 -- start start 2024-05-15T19:04:33.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb566454640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5600b4f30 0x7fb560161990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb566454640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb560160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb566454640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 0x7fb5600cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb566454640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb5600b5e70 con 0x7fb56015f440 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb566454640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fb5600b5b90 con 0x7fb5600b4f30 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb566454640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fb56015f820 con 0x7fb5600d53d0 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 0x7fb5600cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 0x7fb5600cb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41320/0 (socket says 172.21.15.77:41320) 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 -- 172.21.15.77:0/2382391164 learned_addr learned my addr 172.21.15.77:0/2382391164 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb55ffff640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5600b4f30 0x7fb560161990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb55f7fe640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb560160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 -- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 msgr2=0x7fb560160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb560160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 -- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5600b4f30 msgr2=0x7fb560161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:33.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5600b4f30 0x7fb560161990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb5649f1640 1 -- 172.21.15.77:0/2382391164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb560161f70 con 0x7fb56015f440 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.270+0000 7fb55f7fe640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb560160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.271+0000 7fb5649f1640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 0x7fb5600cb6c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fb558009e50 tx=0x7fb558004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.271+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558040070 con 0x7fb56015f440 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.271+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb558031bf0 con 0x7fb56015f440 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.271+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb560162250 con 0x7fb56015f440 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.271+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558009450 con 0x7fb56015f440 2024-05-15T19:04:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.271+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5600c9de0 con 0x7fb56015f440 2024-05-15T19:04:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.274+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56006a640 con 0x7fb56015f440 2024-05-15T19:04:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.275+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb558039040 con 0x7fb56015f440 2024-05-15T19:04:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.276+0000 7fb55cff9640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb54c076300 0x7fb54c0787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.276+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5911+0+0 (secure 0 0 0) 0x7fb5580b8ef0 con 0x7fb56015f440 2024-05-15T19:04:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.276+0000 7fb55ffff640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb54c076300 0x7fb54c0787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.277+0000 7fb55ffff640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb54c076300 0x7fb54c0787c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb550009b40 tx=0x7fb550009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:33.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.289+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb558082650 con 0x7fb56015f440 2024-05-15T19:04:33.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.851+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb5600b6640 con 0x7fb56015f440 2024-05-15T19:04:33.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.956+0000 7fb55cff9640 1 -- 172.21.15.77:0/2382391164 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fb558081f50 con 0x7fb56015f440 2024-05-15T19:04:33.960 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2024-05-15T19:04:33.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.964+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb54c076300 msgr2=0x7fb54c0787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.964+0000 7fb566454640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb54c076300 0x7fb54c0787c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb550009b40 tx=0x7fb550009190 comp rx=0 tx=0).stop 2024-05-15T19:04:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.964+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 msgr2=0x7fb5600cb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.964+0000 7fb566454640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 0x7fb5600cb6c0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fb558009e50 tx=0x7fb558004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.965+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 shutdown_connections 2024-05-15T19:04:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.965+0000 7fb566454640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fb54c076300 0x7fb54c0787c0 secure :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb550009b40 tx=0x7fb550009190 comp rx=0 tx=0).stop 2024-05-15T19:04:33.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.965+0000 7fb566454640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fb5600d53d0 0x7fb560160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.965+0000 7fb566454640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56015f440 0x7fb5600cb6c0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.965+0000 7fb566454640 1 --2- 172.21.15.77:0/2382391164 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fb5600b4f30 0x7fb560161990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:33.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.965+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 >> 172.21.15.77:0/2382391164 conn(0x7fb56008ebb0 msgr2=0x7fb5600b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.966+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 shutdown_connections 2024-05-15T19:04:33.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:33.966+0000 7fb566454640 1 -- 172.21.15.77:0/2382391164 wait complete. 2024-05-15T19:04:33.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-15T19:04:34.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.164+0000 7f070f259640 1 Processor -- start 2024-05-15T19:04:34.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.164+0000 7f070f259640 1 -- start start 2024-05-15T19:04:34.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070f259640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f070815f3a0 0x7f07080d2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:34.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070f259640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07080d55e0 0x7f07080d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070f259640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07080d3330 con 0x7f070815f780 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070f259640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f07080d3600 con 0x7f07080d55e0 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070f259640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f07080d38e0 con 0x7f070815f3a0 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070cff5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f070815f3a0 0x7f07080d2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f0707fff640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f070815f780 0x7f07080d4ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:58294/0 (socket says 172.21.15.77:58294) 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070d7f6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07080d55e0 0x7f07080d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f070cff5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f070815f3a0 0x7f07080d2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:45744/0 (socket says 172.21.15.77:45744) 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.166+0000 7f0707fff640 1 -- 172.21.15.77:0/3658928643 learned_addr learned my addr 172.21.15.77:0/3658928643 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.167+0000 7f070cff5640 1 -- 172.21.15.77:0/3658928643 >> v2:172.21.15.77:3300/0 conn(0x7f07080d55e0 msgr2=0x7f07080d0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.167+0000 7f070cff5640 1 --2- 172.21.15.77:0/3658928643 >> v2:172.21.15.77:3300/0 conn(0x7f07080d55e0 0x7f07080d0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.167+0000 7f070cff5640 1 -- 172.21.15.77:0/3658928643 >> v1:172.21.15.83:6789/0 conn(0x7f070815f780 legacy=0x7f07080d4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.167+0000 7f070cff5640 1 -- 172.21.15.77:0/3658928643 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07080d3bc0 con 0x7f070815f3a0 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.167+0000 7f07077fe640 1 -- 172.21.15.77:0/3658928643 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 529675806 0 0) 0x7f07080d3330 con 0x7f070815f780 2024-05-15T19:04:34.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.168+0000 7f070cff5640 1 --2- 172.21.15.77:0/3658928643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f070815f3a0 0x7f07080d2df0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f07080d2d60 tx=0x7f06f802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2c73cb421afcf4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:34.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.168+0000 7f07077fe640 1 -- 172.21.15.77:0/3658928643 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8007740 con 0x7f070815f3a0 2024-05-15T19:04:34.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.168+0000 7f07077fe640 1 -- 172.21.15.77:0/3658928643 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f80078e0 con 0x7f070815f3a0 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.168+0000 7f07077fe640 1 -- 172.21.15.77:0/3658928643 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8007cb0 con 0x7f070815f3a0 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 -- 172.21.15.77:0/3658928643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f070815f3a0 msgr2=0x7f07080d2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 --2- 172.21.15.77:0/3658928643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f070815f3a0 0x7f07080d2df0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f07080d2d60 tx=0x7f06f802a680 comp rx=0 tx=0).stop 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 -- 172.21.15.77:0/3658928643 shutdown_connections 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 --2- 172.21.15.77:0/3658928643 >> v2:172.21.15.77:3300/0 conn(0x7f07080d55e0 0x7f07080d0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 --2- 172.21.15.77:0/3658928643 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f070815f3a0 0x7f07080d2df0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 -- 172.21.15.77:0/3658928643 >> 172.21.15.77:0/3658928643 conn(0x7f070808ebf0 msgr2=0x7f070809e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 -- 172.21.15.77:0/3658928643 shutdown_connections 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.169+0000 7f070f259640 1 -- 172.21.15.77:0/3658928643 wait complete. 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.170+0000 7f070f259640 1 Processor -- start 2024-05-15T19:04:34.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.170+0000 7f070f259640 1 -- start start 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.171+0000 7f070f259640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 0x7f07081f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.171+0000 7f070f259640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f070815f3a0 0x7f0708149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.171+0000 7f070f259640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f070815f780 0x7f07080cec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.171+0000 7f070f259640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f07080b5fe0 con 0x7f070815f3a0 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.171+0000 7f070f259640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f07080b5e60 con 0x7f07080d55e0 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.171+0000 7f070f259640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f07080b6160 con 0x7f070815f780 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 0x7f07081f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 0x7f07081f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:45748/0 (socket says 172.21.15.77:45748) 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 -- 172.21.15.77:0/2491573710 learned_addr learned my addr 172.21.15.77:0/2491573710 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f0707fff640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f070815f3a0 0x7f0708149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070d7f6640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f070815f780 0x7f07080cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:34.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 -- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f070815f780 msgr2=0x7f07080cec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f070815f780 0x7f07080cec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 -- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f070815f3a0 msgr2=0x7f0708149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f070815f3a0 0x7f0708149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.172+0000 7f070cff5640 1 -- 172.21.15.77:0/2491573710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07080cf3e0 con 0x7f07080d55e0 2024-05-15T19:04:34.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.173+0000 7f070cff5640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 0x7f07081f5be0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009e80 tx=0x7f06f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.175+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040070 con 0x7f07080d55e0 2024-05-15T19:04:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.175+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f8031c40 con 0x7f07080d55e0 2024-05-15T19:04:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.175+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8009450 con 0x7f07080d55e0 2024-05-15T19:04:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.176+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0708160200 con 0x7f07080d55e0 2024-05-15T19:04:34.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.176+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07081607c0 con 0x7f07080d55e0 2024-05-15T19:04:34.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.179+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07080694d0 con 0x7f07080d55e0 2024-05-15T19:04:34.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.182+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f06f8039040 con 0x7f07080d55e0 2024-05-15T19:04:34.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.183+0000 7f07057fa640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06e8076350 0x7f06e8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:34.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.184+0000 7f0707fff640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06e8076350 0x7f06e8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:34.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.184+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5473+0+0 (secure 0 0 0) 0x7f06f80b87c0 con 0x7f07080d55e0 2024-05-15T19:04:34.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.185+0000 7f0707fff640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06e8076350 0x7f06e8078810 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f070815c660 tx=0x7f06f0007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.188+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f06f8081c90 con 0x7f07080d55e0 2024-05-15T19:04:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.390+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f070815e8c0 con 0x7f07080d55e0 2024-05-15T19:04:34.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.972+0000 7f07057fa640 1 -- 172.21.15.77:0/2491573710 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f06f8085f90 con 0x7f07080d55e0 2024-05-15T19:04:34.976 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2024-05-15T19:04:34.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06e8076350 msgr2=0x7f06e8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06e8076350 0x7f06e8078810 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f070815c660 tx=0x7f06f0007de0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 msgr2=0x7f07081f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 0x7f07081f5be0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009e80 tx=0x7f06f8004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 shutdown_connections 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f06e8076350 0x7f06e8078810 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f070815f780 0x7f07080cec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f070815f3a0 0x7f0708149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 --2- 172.21.15.77:0/2491573710 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f07080d55e0 0x7f07081f5be0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 >> 172.21.15.77:0/2491573710 conn(0x7f070808ebf0 msgr2=0x7f07080cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 shutdown_connections 2024-05-15T19:04:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:34.976+0000 7f070f259640 1 -- 172.21.15.77:0/2491573710 wait complete. 2024-05-15T19:04:35.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-05-15T19:04:35.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.420+0000 7f7b911f9640 1 Processor -- start 2024-05-15T19:04:35.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.421+0000 7f7b911f9640 1 -- start start 2024-05-15T19:04:35.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.424+0000 7f7b911f9640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b8c164910 0x7f7b8c167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.433+0000 7f7b911f9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b8c0b3f20 0x7f7b8c072600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.433+0000 7f7b911f9640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b8c0b47e0 con 0x7f7b8c0d10b0 2024-05-15T19:04:35.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.433+0000 7f7b911f9640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f7b8c1672f0 con 0x7f7b8c0b3f20 2024-05-15T19:04:35.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.433+0000 7f7b911f9640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8c1675d0 con 0x7f7b8c164910 2024-05-15T19:04:35.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.433+0000 7f7b8ad9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7b8c0d10b0 0x7f7b8c0d1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40488/0 (socket says 172.21.15.77:40488) 2024-05-15T19:04:35.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.433+0000 7f7b8ad9d640 1 -- 172.21.15.77:0/4235143621 learned_addr learned my addr 172.21.15.77:0/4235143621 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:35.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.435+0000 7f7b8a59c640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b8c164910 0x7f7b8c167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.436+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955221585 0 0) 0x7f7b8c0b47e0 con 0x7f7b8c0d10b0 2024-05-15T19:04:35.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.436+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b74003520 con 0x7f7b8c0d10b0 2024-05-15T19:04:35.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.436+0000 7f7b8b59e640 1 --2- 172.21.15.77:0/4235143621 >> v2:172.21.15.77:3300/0 conn(0x7f7b8c0b3f20 0x7f7b8c072600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 859874339 0 0) 0x7f7b74003520 con 0x7f7b8c0d10b0 2024-05-15T19:04:35.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b8c164910 msgr2=0x7f7b8c167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:35.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b8c164910 0x7f7b8c167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 >> v2:172.21.15.77:3300/0 conn(0x7f7b8c0b3f20 msgr2=0x7f7b8c072600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:35.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 --2- 172.21.15.77:0/4235143621 >> v2:172.21.15.77:3300/0 conn(0x7f7b8c0b3f20 0x7f7b8c072600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c1678b0 con 0x7f7b8c0d10b0 2024-05-15T19:04:35.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 154754283 0 0) 0x7f7b800016f0 con 0x7f7b8c0d10b0 2024-05-15T19:04:35.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 >> v1:172.21.15.77:6789/0 conn(0x7f7b8c0d10b0 legacy=0x7f7b8c0d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:35.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b74003a00 0x7f7b74003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b74004800 0x7f7b74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.440+0000 7f7b89d9b640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b740051c0 0x7f7b7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.441+0000 7f7b8ad9d640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b74003a00 0x7f7b74003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.442+0000 7f7b8b59e640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b740051c0 0x7f7b7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.443+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1672f0 con 0x7f7b740051c0 2024-05-15T19:04:35.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.443+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c1675d0 con 0x7f7b74003a00 2024-05-15T19:04:35.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.443+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7400bf80 con 0x7f7b74004800 2024-05-15T19:04:35.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.445+0000 7f7b8a59c640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b74004800 0x7f7b74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.450+0000 7f7b8b59e640 1 -- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b74004800 msgr2=0x7f7b74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.450+0000 7f7b8b59e640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b74004800 0x7f7b74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.450+0000 7f7b8b59e640 1 -- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b74003a00 msgr2=0x7f7b74003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.450+0000 7f7b8b59e640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b74003a00 0x7f7b74003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.450+0000 7f7b8b59e640 1 -- 172.21.15.77:0/4235143621 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c1678b0 con 0x7f7b740051c0 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.453+0000 7f7b8b59e640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b740051c0 0x7f7b7400b9c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009aa0 tx=0x7f7b74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0f2880481ced1c server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.454+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c036070 con 0x7f7b740051c0 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.455+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b7c031400 con 0x7f7b740051c0 2024-05-15T19:04:35.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.455+0000 7f7b89d9b640 1 -- 172.21.15.77:0/4235143621 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7c009670 con 0x7f7b740051c0 2024-05-15T19:04:35.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.459+0000 7f7b911f9640 1 -- 172.21.15.77:0/4235143621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b740051c0 msgr2=0x7f7b7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:35.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.459+0000 7f7b911f9640 1 --2- 172.21.15.77:0/4235143621 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b740051c0 0x7f7b7400b9c0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c009aa0 tx=0x7f7b74005830 comp rx=0 tx=0).stop 2024-05-15T19:04:35.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.459+0000 7f7b8b59e640 1 -- 172.21.15.77:0/4235143621 reap_dead start 2024-05-15T19:04:35.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.460+0000 7f7b911f9640 1 -- 172.21.15.77:0/4235143621 shutdown_connections 2024-05-15T19:04:35.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.460+0000 7f7b911f9640 1 -- 172.21.15.77:0/4235143621 >> 172.21.15.77:0/4235143621 conn(0x7f7b8c06c5d0 msgr2=0x7f7b8c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:35.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.467+0000 7f7b911f9640 1 -- 172.21.15.77:0/4235143621 shutdown_connections 2024-05-15T19:04:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.469+0000 7f7b911f9640 1 -- 172.21.15.77:0/4235143621 wait complete. 2024-05-15T19:04:35.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.474+0000 7f7b911f9640 1 Processor -- start 2024-05-15T19:04:35.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.481+0000 7f7b911f9640 1 -- start start 2024-05-15T19:04:35.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.484+0000 7f7b911f9640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b740051c0 0x7f7b8c153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.484+0000 7f7b911f9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b8c14f3f0 0x7f7b8c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.484+0000 7f7b911f9640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b8c150f40 0x7f7b8c154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.484+0000 7f7b911f9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c0b4510 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.484+0000 7f7b911f9640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7b8c0b4390 con 0x7f7b8c150f40 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.484+0000 7f7b911f9640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7b8c0d09b0 con 0x7f7b740051c0 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.486+0000 7f7b8b59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b8c150f40 0x7f7b8c154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.486+0000 7f7b8b59e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b8c150f40 0x7f7b8c154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:45778/0 (socket says 172.21.15.77:45778) 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.486+0000 7f7b8b59e640 1 -- 172.21.15.77:0/45373601 learned_addr learned my addr 172.21.15.77:0/45373601 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:35.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.486+0000 7f7b8a59c640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b8c14f3f0 0x7f7b8c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.486+0000 7f7b8a59c640 1 -- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b740051c0 msgr2=0x7f7b8c153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.486+0000 7f7b8ad9d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b740051c0 0x7f7b8c153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b8a59c640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b740051c0 0x7f7b8c153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b8a59c640 1 -- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b8c150f40 msgr2=0x7f7b8c154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b8a59c640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b8c150f40 0x7f7b8c154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b8a59c640 1 -- 172.21.15.77:0/45373601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8c1523d0 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b8ad9d640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b740051c0 0x7f7b8c153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-15T19:04:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b8a59c640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b8c14f3f0 0x7f7b8c1539b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009f90 tx=0x7f7b840115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84011ea0 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b8401b070 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b84003990 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b8c1526b0 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.487+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b8c152c70 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.491+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7b84005d10 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.490+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b6c005290 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.492+0000 7f7b737fe640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7b78076350 0x7f7b78078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:35.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.492+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f7b8405d540 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.492+0000 7f7b8ad9d640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7b78076350 0x7f7b78078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:35.501 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.496+0000 7f7b8ad9d640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7b78076350 0x7f7b78078810 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b80000ff0 tx=0x7f7b80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:35.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.501+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7b84025020 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.879+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f7b6c005850 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.886+0000 7f7b737fe640 1 -- 172.21.15.77:0/45373601 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f7b84025020 con 0x7f7b8c14f3f0 2024-05-15T19:04:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.889+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7b78076350 msgr2=0x7f7b78078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.889+0000 7f7b911f9640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7b78076350 0x7f7b78078810 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7b80000ff0 tx=0x7f7b80009040 comp rx=0 tx=0).stop 2024-05-15T19:04:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.889+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b8c14f3f0 msgr2=0x7f7b8c1539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:35.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.889+0000 7f7b911f9640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b8c14f3f0 0x7f7b8c1539b0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009f90 tx=0x7f7b840115a0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 shutdown_connections 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f7b78076350 0x7f7b78078810 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7b8c150f40 0x7f7b8c154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b8c14f3f0 0x7f7b8c1539b0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 --2- 172.21.15.77:0/45373601 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7b740051c0 0x7f7b8c153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 >> 172.21.15.77:0/45373601 conn(0x7f7b8c06c5d0 msgr2=0x7f7b8c0b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 shutdown_connections 2024-05-15T19:04:35.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:35.890+0000 7f7b911f9640 1 -- 172.21.15.77:0/45373601 wait complete. 2024-05-15T19:04:35.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-15T19:04:36.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.381+0000 7f6b9a727640 1 Processor -- start 2024-05-15T19:04:36.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.385+0000 7f6b9a727640 1 -- start start 2024-05-15T19:04:36.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.389+0000 7f6b9a727640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b8c0e0050 0x7f6b8c0531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:36.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.390+0000 7f6b99725640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b8c0e0050 0x7f6b8c0531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:36.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.390+0000 7f6b99725640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6b8c0e0050 0x7f6b8c0531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41388/0 (socket says 172.21.15.77:41388) 2024-05-15T19:04:36.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.390+0000 7f6b99725640 1 -- 172.21.15.77:0/2429789146 learned_addr learned my addr 172.21.15.77:0/2429789146 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:36.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.391+0000 7f6b9a727640 1 --2- 172.21.15.77:0/2429789146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c053710 0x7f6b8c050a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:36.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.391+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b8c03a340 con 0x7f6b8c0e0430 2024-05-15T19:04:36.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.391+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f6b8c0516c0 con 0x7f6b8c0e0050 2024-05-15T19:04:36.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.391+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8c0519a0 con 0x7f6b8c053710 2024-05-15T19:04:36.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.395+0000 7f6b99f26640 1 --2- 172.21.15.77:0/2429789146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c053710 0x7f6b8c050a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:36.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.395+0000 7f6b87fff640 1 -- 172.21.15.77:0/2429789146 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647429677 0 0) 0x7f6b8c03a340 con 0x7f6b8c0e0430 2024-05-15T19:04:36.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.396+0000 7f6b99f26640 1 -- 172.21.15.77:0/2429789146 >> v2:172.21.15.77:3300/0 conn(0x7f6b8c0e0050 msgr2=0x7f6b8c0531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:36.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.396+0000 7f6b99f26640 1 --2- 172.21.15.77:0/2429789146 >> v2:172.21.15.77:3300/0 conn(0x7f6b8c0e0050 0x7f6b8c0531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:36.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.396+0000 7f6b99f26640 1 -- 172.21.15.77:0/2429789146 >> v1:172.21.15.77:6789/0 conn(0x7f6b8c0e0430 legacy=0x7f6b8c006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:36.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.396+0000 7f6b99f26640 1 -- 172.21.15.77:0/2429789146 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c006270 con 0x7f6b8c053710 2024-05-15T19:04:36.404 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.401+0000 7f6b99f26640 1 --2- 172.21.15.77:0/2429789146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c053710 0x7f6b8c050a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b880097a0 tx=0x7f6b8802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d179f1cff413b78 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:36.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.406+0000 7f6b87fff640 1 -- 172.21.15.77:0/2429789146 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88037070 con 0x7f6b8c053710 2024-05-15T19:04:36.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.406+0000 7f6b87fff640 1 -- 172.21.15.77:0/2429789146 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88032440 con 0x7f6b8c053710 2024-05-15T19:04:36.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.406+0000 7f6b87fff640 1 -- 172.21.15.77:0/2429789146 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88032810 con 0x7f6b8c053710 2024-05-15T19:04:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.411+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c053710 msgr2=0x7f6b8c050a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.411+0000 7f6b9a727640 1 --2- 172.21.15.77:0/2429789146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c053710 0x7f6b8c050a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b880097a0 tx=0x7f6b8802a250 comp rx=0 tx=0).stop 2024-05-15T19:04:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.412+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 shutdown_connections 2024-05-15T19:04:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.412+0000 7f6b9a727640 1 --2- 172.21.15.77:0/2429789146 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c053710 0x7f6b8c050a50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.412+0000 7f6b9a727640 1 --2- 172.21.15.77:0/2429789146 >> v2:172.21.15.77:3300/0 conn(0x7f6b8c0e0050 0x7f6b8c0531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.412+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 >> 172.21.15.77:0/2429789146 conn(0x7f6b8c01e6c0 msgr2=0x7f6b8c0553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.413+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 shutdown_connections 2024-05-15T19:04:36.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.415+0000 7f6b9a727640 1 -- 172.21.15.77:0/2429789146 wait complete. 2024-05-15T19:04:36.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.421+0000 7f6b9a727640 1 Processor -- start 2024-05-15T19:04:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.430+0000 7f6b9a727640 1 -- start start 2024-05-15T19:04:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.433+0000 7f6b9a727640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 0x7f6b8c1802e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.434+0000 7f6b9a727640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c0e0050 0x7f6b8c020f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.434+0000 7f6b9a727640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b8c0e0430 0x7f6b8c0214c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.434+0000 7f6b9a727640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c050f90 con 0x7f6b8c0e0430 2024-05-15T19:04:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.434+0000 7f6b9a727640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f6b8c006830 con 0x7f6b8c053710 2024-05-15T19:04:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.435+0000 7f6b9a727640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f6b8c051110 con 0x7f6b8c0e0050 2024-05-15T19:04:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.435+0000 7f6b98f24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c0e0050 0x7f6b8c020f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.435+0000 7f6b99725640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 0x7f6b8c1802e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.435+0000 7f6b98f24640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c0e0050 0x7f6b8c020f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:48144/0 (socket says 172.21.15.77:48144) 2024-05-15T19:04:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.435+0000 7f6b98f24640 1 -- 172.21.15.77:0/563733068 learned_addr learned my addr 172.21.15.77:0/563733068 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.435+0000 7f6b99725640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 0x7f6b8c1802e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:45794/0 (socket says 172.21.15.77:45794) 2024-05-15T19:04:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.436+0000 7f6b99f26640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b8c0e0430 0x7f6b8c0214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.436+0000 7f6b99725640 1 -- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c0e0050 msgr2=0x7f6b8c020f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.436+0000 7f6b99725640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c0e0050 0x7f6b8c020f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.436+0000 7f6b99725640 1 -- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b8c0e0430 msgr2=0x7f6b8c0214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.436+0000 7f6b99725640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b8c0e0430 0x7f6b8c0214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.436+0000 7f6b99725640 1 -- 172.21.15.77:0/563733068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8c034cc0 con 0x7f6b8c053710 2024-05-15T19:04:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.438+0000 7f6b99725640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 0x7f6b8c1802e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6b9406abe0 tx=0x7f6b94069fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:36.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.440+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94095430 con 0x7f6b8c053710 2024-05-15T19:04:36.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.440+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b94095610 con 0x7f6b8c053710 2024-05-15T19:04:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.440+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94095a00 con 0x7f6b8c053710 2024-05-15T19:04:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.440+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b8c034fa0 con 0x7f6b8c053710 2024-05-15T19:04:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.440+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b8c035560 con 0x7f6b8c053710 2024-05-15T19:04:36.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.446+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b74005290 con 0x7f6b8c053710 2024-05-15T19:04:36.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.451+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6b94095ba0 con 0x7f6b8c053710 2024-05-15T19:04:36.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.454+0000 7f6b85ffb640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6b780763a0 0x7f6b78078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:36.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.454+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f6b94112fd0 con 0x7f6b8c053710 2024-05-15T19:04:36.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.455+0000 7f6b98f24640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6b780763a0 0x7f6b78078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:36.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.457+0000 7f6b98f24640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6b780763a0 0x7f6b78078860 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c001040 tx=0x7f6b90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:36.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:36.457+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6b940dc5d0 con 0x7f6b8c053710 2024-05-15T19:04:37.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.532+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f6b74005580 con 0x7f6b8c053710 2024-05-15T19:04:37.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.987+0000 7f6b85ffb640 1 -- 172.21.15.77:0/563733068 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v12519) ==== 144+0+0 (secure 0 0 0) 0x7f6b940e08d0 con 0x7f6b8c053710 2024-05-15T19:04:37.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6b780763a0 msgr2=0x7f6b78078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:37.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6b780763a0 0x7f6b78078860 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c001040 tx=0x7f6b90009040 comp rx=0 tx=0).stop 2024-05-15T19:04:37.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 msgr2=0x7f6b8c1802e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:37.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 0x7f6b8c1802e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f6b9406abe0 tx=0x7f6b94069fb0 comp rx=0 tx=0).stop 2024-05-15T19:04:37.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 shutdown_connections 2024-05-15T19:04:38.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f6b780763a0 0x7f6b78078860 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:38.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6b8c0e0050 0x7f6b8c020f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:38.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b8c0e0430 0x7f6b8c0214c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:38.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.993+0000 7f6b9a727640 1 --2- 172.21.15.77:0/563733068 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f6b8c053710 0x7f6b8c1802e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:38.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.994+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 >> 172.21.15.77:0/563733068 conn(0x7f6b8c01e6c0 msgr2=0x7f6b8c051e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:38.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.994+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 shutdown_connections 2024-05-15T19:04:38.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:37.994+0000 7f6b9a727640 1 -- 172.21.15.77:0/563733068 wait complete. 2024-05-15T19:04:38.293 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-05-15T19:04:38.294 INFO:tasks.cephfs_test_runner: 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:Ran 1 test in 24870.598s 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:====================================================================== 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner:AssertionError: 17 != 0 2024-05-15T19:04:38.295 INFO:tasks.cephfs_test_runner: 2024-05-15T19:04:38.296 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-15T19:04:38.671 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1d880c1fff044e3b88b2b47f524c6881 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_9b63866860f0b71216b2c0a73aedd2e0a8a5c98b/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-15T19:04:38.672 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-05-15T19:04:38.683 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-15T19:04:38.700 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-15T19:04:38.701 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T19:04:38.701 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:38.743 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1230 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-15T19:04:38.743 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-05-15T19:04:38.743 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:38.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056323,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1230 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248824k,nr_inodes=812206,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497656k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-05-15T19:04:38.820 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T19:04:38.820 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:38.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20541 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-15T19:04:38.840 DEBUG:teuthology.orchestra.run.smithi083:> set -ex 2024-05-15T19:04:38.840 DEBUG:teuthology.orchestra.run.smithi083:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-15T19:04:38.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056333,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20541 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497672k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-15T19:04:38.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:38.898 DEBUG:teuthology.orchestra.run.smithi083:> ip netns list 2024-05-15T19:04:38.971 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-05-15T19:04:38.972 INFO:teuthology.orchestra.run.smithi083.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-15T19:04:38.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:38.972 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-15T19:04:39.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:39.042 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-15T19:04:39.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:39.110 DEBUG:teuthology.orchestra.run.smithi083:> sudo ip link delete ceph-brx 2024-05-15T19:04:39.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:39.213 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-05-15T19:04:39.546 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-15T19:04:39.547 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-15T19:04:39.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:39.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-15T19:04:39.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:39.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-15T19:04:39.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-15T19:04:39.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-05-15T19:04:39.779 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-15T19:04:39.789 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-15T19:04:39.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T19:04:40.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.040+0000 7f2bffe08640 1 Processor -- start 2024-05-15T19:04:40.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.041+0000 7f2bffe08640 1 -- start start 2024-05-15T19:04:40.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bffe08640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 0x7f2bf8073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bffe08640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bf806f2b0 0x7f2bf806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bffe08640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bf8149ca0 con 0x7f2bf81672d0 2024-05-15T19:04:40.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bffe08640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f2bf806e860 con 0x7f2bf806f2b0 2024-05-15T19:04:40.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bffe08640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf8074080 con 0x7f2bf80733c0 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bfd3a3640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 0x7f2bf8073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bfd3a3640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 0x7f2bf8073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:48156/0 (socket says 172.21.15.77:48156) 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bfe3a5640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f2bf806f2b0 0x7f2bf806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/558363536 learned_addr learned my addr 172.21.15.77:0/558363536 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.043+0000 7f2bfdba4640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f2bf81672d0 0x7f2bf81676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:58302/0 (socket says 172.21.15.77:58302) 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.044+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/558363536 >> v2:172.21.15.83:3300/0 conn(0x7f2bf806f2b0 msgr2=0x7f2bf806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.044+0000 7f2bfd3a3640 1 --2- 172.21.15.77:0/558363536 >> v2:172.21.15.83:3300/0 conn(0x7f2bf806f2b0 0x7f2bf806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.044+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/558363536 >> v1:172.21.15.83:6789/0 conn(0x7f2bf81672d0 legacy=0x7f2bf81676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.044+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/558363536 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8074360 con 0x7f2bf80733c0 2024-05-15T19:04:40.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.044+0000 7f2bfcba2640 1 -- 172.21.15.77:0/558363536 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273640031 0 0) 0x7f2bf8149ca0 con 0x7f2bf81672d0 2024-05-15T19:04:40.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.045+0000 7f2bfd3a3640 1 --2- 172.21.15.77:0/558363536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 0x7f2bf8073800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009870 tx=0x7f2be802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9b06de3153e4bfd server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:40.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.045+0000 7f2bfcba2640 1 -- 172.21.15.77:0/558363536 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8037070 con 0x7f2bf80733c0 2024-05-15T19:04:40.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.045+0000 7f2bfcba2640 1 -- 172.21.15.77:0/558363536 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be8032440 con 0x7f2bf80733c0 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.045+0000 7f2bfcba2640 1 -- 172.21.15.77:0/558363536 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8032810 con 0x7f2bf80733c0 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.046+0000 7f2bffe08640 1 -- 172.21.15.77:0/558363536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 msgr2=0x7f2bf8073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.046+0000 7f2bffe08640 1 --2- 172.21.15.77:0/558363536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 0x7f2bf8073800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009870 tx=0x7f2be802a270 comp rx=0 tx=0).stop 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.046+0000 7f2bffe08640 1 -- 172.21.15.77:0/558363536 shutdown_connections 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.046+0000 7f2bffe08640 1 --2- 172.21.15.77:0/558363536 >> v2:172.21.15.83:3300/0 conn(0x7f2bf806f2b0 0x7f2bf806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.046+0000 7f2bffe08640 1 --2- 172.21.15.77:0/558363536 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf80733c0 0x7f2bf8073800 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.046+0000 7f2bffe08640 1 -- 172.21.15.77:0/558363536 >> 172.21.15.77:0/558363536 conn(0x7f2bf806c810 msgr2=0x7f2bf806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:40.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.047+0000 7f2bffe08640 1 -- 172.21.15.77:0/558363536 shutdown_connections 2024-05-15T19:04:40.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.047+0000 7f2bffe08640 1 -- 172.21.15.77:0/558363536 wait complete. 2024-05-15T19:04:40.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.050+0000 7f2bffe08640 1 Processor -- start 2024-05-15T19:04:40.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.050+0000 7f2bffe08640 1 -- start start 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bffe08640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf806f2b0 0x7f2bf815cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bffe08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 0x7f2bf81fd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bffe08640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf81672d0 0x7f2bf8148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bffe08640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf8073d40 con 0x7f2bf80733c0 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bffe08640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf806ed90 con 0x7f2bf806f2b0 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bffe08640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f2bf81468c0 con 0x7f2bf81672d0 2024-05-15T19:04:40.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bfd3a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 0x7f2bf81fd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bfd3a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 0x7f2bf81fd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41404/0 (socket says 172.21.15.77:41404) 2024-05-15T19:04:40.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/4268351614 learned_addr learned my addr 172.21.15.77:0/4268351614 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:40.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bfdba4640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf806f2b0 0x7f2bf815cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.052+0000 7f2bfe3a5640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf81672d0 0x7f2bf8148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf81672d0 msgr2=0x7f2bf8148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bfd3a3640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf81672d0 0x7f2bf8148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf806f2b0 msgr2=0x7f2bf815cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bfd3a3640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf806f2b0 0x7f2bf815cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bfd3a3640 1 -- 172.21.15.77:0/4268351614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf815d140 con 0x7f2bf80733c0 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bfd3a3640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 0x7f2bf81fd720 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f2be8000c00 tx=0x7f2be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.053+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8037040 con 0x7f2bf80733c0 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.054+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf815d420 con 0x7f2bf80733c0 2024-05-15T19:04:40.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.054+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2be8042070 con 0x7f2bf80733c0 2024-05-15T19:04:40.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.054+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be8030880 con 0x7f2bf80733c0 2024-05-15T19:04:40.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.054+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf815d9e0 con 0x7f2bf80733c0 2024-05-15T19:04:40.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.055+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf806a640 con 0x7f2bf80733c0 2024-05-15T19:04:40.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.057+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2be8030a20 con 0x7f2bf80733c0 2024-05-15T19:04:40.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.058+0000 7f2bee7fc640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2bdc0762d0 0x7f2bdc078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.058+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f2be80b7ab0 con 0x7f2bf80733c0 2024-05-15T19:04:40.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.058+0000 7f2bfdba4640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2bdc0762d0 0x7f2bdc078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.059+0000 7f2bfdba4640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2bdc0762d0 0x7f2bdc078790 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40012e0 tx=0x7f2bf4001630 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:40.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.072+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2be8081030 con 0x7f2bf80733c0 2024-05-15T19:04:40.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.252+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2bf815e0d0 con 0x7f2bdc0762d0 2024-05-15T19:04:40.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.253+0000 7f2bee7fc640 1 -- 172.21.15.77:0/4268351614 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13677 (secure 0 0 0) 0x7f2bf815e0d0 con 0x7f2bdc0762d0 2024-05-15T19:04:40.257 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:40.257 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T19:04:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2bdc0762d0 msgr2=0x7f2bdc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2bdc0762d0 0x7f2bdc078790 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40012e0 tx=0x7f2bf4001630 comp rx=0 tx=0).stop 2024-05-15T19:04:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 msgr2=0x7f2bf81fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 0x7f2bf81fd720 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f2be8000c00 tx=0x7f2be80046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 shutdown_connections 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f2bdc0762d0 0x7f2bdc078790 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f2bf81672d0 0x7f2bf8148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bf80733c0 0x7f2bf81fd720 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 --2- 172.21.15.77:0/4268351614 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f2bf806f2b0 0x7f2bf815cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 >> 172.21.15.77:0/4268351614 conn(0x7f2bf806c810 msgr2=0x7f2bf80b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:40.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 shutdown_connections 2024-05-15T19:04:40.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.256+0000 7f2bffe08640 1 -- 172.21.15.77:0/4268351614 wait complete. 2024-05-15T19:04:40.273 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":12482,"stamp":"2024-05-15T19:04:39.223076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":14199468,"kb_used_data":2651928,"kb_used_omap":3975,"kb_used_meta":11531192,"kb_avail":740775252,"statfs":{"total":773094113280,"available":758553858048,"internally_reserved":0,"allocated":2715574272,"data_stored":2713341890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4070423,"internal_metadata":11807941609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":283,"apply_latency_ms":283,"commit_latency_ns":283000000,"apply_latency_ns":283000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7655293248,"num_objects":-8361,"num_object_clones":0,"num_object_copies":-16722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8361,"num_whiteouts":0,"num_read":-2048198,"num_read_kb":-143877779,"num_write":-7536991,"num_write_kb":-208370139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002546"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":347,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-15T19:04:35.283067+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T19:04:35.283067+0000","last_peered":"2024-05-15T19:04:35.283067+0000","last_clean":"2024-05-15T19:04:35.283067+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T19:04:35.283067+0000","last_undegraded":"2024-05-15T19:04:35.283067+0000","last_fullsized":"2024-05-15T19:04:35.283067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719481668,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1435112,"kb_used_data":412,"kb_used_omap":528,"kb_used_meta":1434159,"kb_avail":92936728,"statfs":{"total":96636764160,"available":95167209472,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":541416,"internal_metadata":1468579096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424514425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1565096,"kb_used_data":412,"kb_used_omap":218,"kb_used_meta":1564453,"kb_avail":92806744,"statfs":{"total":96636764160,"available":95034105856,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223458,"internal_metadata":1602000670},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424514425,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1715500,"kb_used_data":992,"kb_used_omap":30,"kb_used_meta":1714465,"kb_avail":92656340,"statfs":{"total":96636764160,"available":94880092160,"internally_reserved":0,"allocated":1015808,"data_stored":756726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30760,"internal_metadata":1755613144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547129,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2590056,"kb_used_data":1096668,"kb_used_omap":126,"kb_used_meta":1493249,"kb_avail":91781784,"statfs":{"total":96636764160,"available":93984546816,"internally_reserved":0,"allocated":1122988032,"data_stored":1122639756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":129857,"internal_metadata":1529087167},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547128,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3070360,"kb_used_data":1518860,"kb_used_omap":915,"kb_used_meta":1550572,"kb_avail":91301480,"statfs":{"total":96636764160,"available":93492715520,"internally_reserved":0,"allocated":1555312640,"data_stored":1554968818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":937533,"internal_metadata":1587786179},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129547094,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":741924,"kb_used_data":29084,"kb_used_omap":1568,"kb_used_meta":698975,"kb_avail":93629916,"statfs":{"total":96636764160,"available":95877033984,"internally_reserved":0,"allocated":29782016,"data_stored":29526486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1605839,"internal_metadata":715751217},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129547090,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1603560,"kb_used_data":5088,"kb_used_omap":391,"kb_used_meta":1598072,"kb_avail":92768280,"statfs":{"total":96636764160,"available":94994718720,"internally_reserved":0,"allocated":5210112,"data_stored":4951030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":400499,"internal_metadata":1636426637},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1477860,"kb_used_data":412,"kb_used_omap":196,"kb_used_meta":1477243,"kb_avail":92893980,"statfs":{"total":96636764160,"available":95123435520,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":201061,"internal_metadata":1512697499},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T19:04:40.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T19:04:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.534+0000 7ff81e1a4640 1 Processor -- start 2024-05-15T19:04:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.534+0000 7ff81e1a4640 1 -- start start 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff81e1a4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8181469b0 0x7ff81815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff81e1a4640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff8180cec70 0x7ff81806e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff81e1a4640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81815e620 con 0x7ff8180b4a40 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff81e1a4640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff8180b6430 con 0x7ff8180cec70 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff81e1a4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff8180b4f00 con 0x7ff8181469b0 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff816ffd640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff8180b4a40 0x7ff8180ce560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40506/0 (socket says 172.21.15.77:40506) 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff816ffd640 1 -- 172.21.15.77:0/2405476765 learned_addr learned my addr 172.21.15.77:0/2405476765 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff8177fe640 1 --2- 172.21.15.77:0/2405476765 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8181469b0 0x7ff81815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.535+0000 7ff817fff640 1 --2- 172.21.15.77:0/2405476765 >> v2:172.21.15.83:3300/0 conn(0x7ff8180cec70 0x7ff81806e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.536+0000 7ff8177fe640 1 -- 172.21.15.77:0/2405476765 >> v2:172.21.15.83:3300/0 conn(0x7ff8180cec70 msgr2=0x7ff81806e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.536+0000 7ff8177fe640 1 --2- 172.21.15.77:0/2405476765 >> v2:172.21.15.83:3300/0 conn(0x7ff8180cec70 0x7ff81806e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.536+0000 7ff8177fe640 1 -- 172.21.15.77:0/2405476765 >> v1:172.21.15.77:6789/0 conn(0x7ff8180b4a40 legacy=0x7ff8180ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.536+0000 7ff8167fc640 1 -- 172.21.15.77:0/2405476765 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577693860 0 0) 0x7ff800001490 con 0x7ff8180b4a40 2024-05-15T19:04:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.536+0000 7ff8177fe640 1 -- 172.21.15.77:0/2405476765 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8180b51e0 con 0x7ff8181469b0 2024-05-15T19:04:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.538+0000 7ff8177fe640 1 --2- 172.21.15.77:0/2405476765 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8181469b0 0x7ff81815e0e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff8080097a0 tx=0x7ff80802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1aced0b594c2b44 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.538+0000 7ff8167fc640 1 -- 172.21.15.77:0/2405476765 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808037070 con 0x7ff8181469b0 2024-05-15T19:04:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.538+0000 7ff8167fc640 1 -- 172.21.15.77:0/2405476765 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80802ae50 con 0x7ff8181469b0 2024-05-15T19:04:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.538+0000 7ff8167fc640 1 -- 172.21.15.77:0/2405476765 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808032660 con 0x7ff8181469b0 2024-05-15T19:04:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.539+0000 7ff81e1a4640 1 -- 172.21.15.77:0/2405476765 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8181469b0 msgr2=0x7ff81815e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.539+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/2405476765 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8181469b0 0x7ff81815e0e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff8080097a0 tx=0x7ff80802a100 comp rx=0 tx=0).stop 2024-05-15T19:04:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.540+0000 7ff81e1a4640 1 -- 172.21.15.77:0/2405476765 shutdown_connections 2024-05-15T19:04:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.540+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/2405476765 >> v2:172.21.15.83:3300/0 conn(0x7ff8180cec70 0x7ff81806e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.540+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/2405476765 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8181469b0 0x7ff81815e0e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.540+0000 7ff81e1a4640 1 -- 172.21.15.77:0/2405476765 >> 172.21.15.77:0/2405476765 conn(0x7ff81806c810 msgr2=0x7ff81806cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:40.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.540+0000 7ff81e1a4640 1 -- 172.21.15.77:0/2405476765 shutdown_connections 2024-05-15T19:04:40.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.540+0000 7ff81e1a4640 1 -- 172.21.15.77:0/2405476765 wait complete. 2024-05-15T19:04:40.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.543+0000 7ff81e1a4640 1 Processor -- start 2024-05-15T19:04:40.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.544+0000 7ff81e1a4640 1 -- start start 2024-05-15T19:04:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff81e1a4640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 0x7ff8181f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff81e1a4640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8180cec70 0x7ff818139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff81e1a4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8181469b0 0x7ff81815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff81e1a4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180b5a80 con 0x7ff8181469b0 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff81e1a4640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff8180b57a0 con 0x7ff8180b4a40 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff81e1a4640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff81806eea0 con 0x7ff8180cec70 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 0x7ff8181f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff817fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8181469b0 0x7ff81815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 0x7ff8181f6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:45822/0 (socket says 172.21.15.77:45822) 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 -- 172.21.15.77:0/3830413459 learned_addr learned my addr 172.21.15.77:0/3830413459 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff816ffd640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8180cec70 0x7ff818139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 -- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8180cec70 msgr2=0x7ff818139ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8180cec70 0x7ff818139ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 -- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8181469b0 msgr2=0x7ff81815a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.546+0000 7ff8177fe640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8181469b0 0x7ff81815a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff8177fe640 1 -- 172.21.15.77:0/3830413459 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8181f6d00 con 0x7ff8180b4a40 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff8177fe640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 0x7ff8181f6690 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff808035040 tx=0x7ff8080046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808041070 con 0x7ff8180b4a40 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80803c460 con 0x7ff8180b4a40 2024-05-15T19:04:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808037040 con 0x7ff8180b4a40 2024-05-15T19:04:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8181f6fe0 con 0x7ff8180b4a40 2024-05-15T19:04:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.547+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81815a8a0 con 0x7ff8180b4a40 2024-05-15T19:04:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.549+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff80803a070 con 0x7ff8180b4a40 2024-05-15T19:04:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.549+0000 7ff80ffff640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff7f80762d0 0x7ff7f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.550+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff8080b7620 con 0x7ff8180b4a40 2024-05-15T19:04:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.550+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8181f7500 con 0x7ff8180b4a40 2024-05-15T19:04:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.550+0000 7ff816ffd640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff7f80762d0 0x7ff7f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.550+0000 7ff816ffd640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff7f80762d0 0x7ff7f8078790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b0530 tx=0x7ff800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:40.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:40.555+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff8181f7500 con 0x7ff8180b4a40 2024-05-15T19:04:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.105+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff81813a430 con 0x7ff7f80762d0 2024-05-15T19:04:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.106+0000 7ff80ffff640 1 -- 172.21.15.77:0/3830413459 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13677 (secure 0 0 0) 0x7ff81813a430 con 0x7ff7f80762d0 2024-05-15T19:04:41.110 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T19:04:41.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff7f80762d0 msgr2=0x7ff7f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff7f80762d0 0x7ff7f8078790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff8180b0530 tx=0x7ff800009040 comp rx=0 tx=0).stop 2024-05-15T19:04:41.114 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 msgr2=0x7ff8181f6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 0x7ff8181f6690 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff808035040 tx=0x7ff8080046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 shutdown_connections 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff7f80762d0 0x7ff7f8078790 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff8180cec70 0x7ff818139ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8181469b0 0x7ff81815a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 --2- 172.21.15.77:0/3830413459 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff8180b4a40 0x7ff8181f6690 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 >> 172.21.15.77:0/3830413459 conn(0x7ff81806c810 msgr2=0x7ff81815fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:41.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 shutdown_connections 2024-05-15T19:04:41.116 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.111+0000 7ff81e1a4640 1 -- 172.21.15.77:0/3830413459 wait complete. 2024-05-15T19:04:41.142 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":12482,"stamp":"2024-05-15T19:04:39.223076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":14199468,"kb_used_data":2651928,"kb_used_omap":3975,"kb_used_meta":11531192,"kb_avail":740775252,"statfs":{"total":773094113280,"available":758553858048,"internally_reserved":0,"allocated":2715574272,"data_stored":2713341890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4070423,"internal_metadata":11807941609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":283,"apply_latency_ms":283,"commit_latency_ns":283000000,"apply_latency_ns":283000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7655293248,"num_objects":-8361,"num_object_clones":0,"num_object_copies":-16722,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-8361,"num_whiteouts":0,"num_read":-2048198,"num_read_kb":-143877779,"num_write":-7536991,"num_write_kb":-208370139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002546"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":347,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-15T19:04:35.283067+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T19:04:35.283067+0000","last_peered":"2024-05-15T19:04:35.283067+0000","last_clean":"2024-05-15T19:04:35.283067+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T19:04:35.283067+0000","last_undegraded":"2024-05-15T19:04:35.283067+0000","last_fullsized":"2024-05-15T19:04:35.283067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719481668,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1435112,"kb_used_data":412,"kb_used_omap":528,"kb_used_meta":1434159,"kb_avail":92936728,"statfs":{"total":96636764160,"available":95167209472,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":541416,"internal_metadata":1468579096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424514425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1565096,"kb_used_data":412,"kb_used_omap":218,"kb_used_meta":1564453,"kb_avail":92806744,"statfs":{"total":96636764160,"available":95034105856,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223458,"internal_metadata":1602000670},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424514425,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1715500,"kb_used_data":992,"kb_used_omap":30,"kb_used_meta":1714465,"kb_avail":92656340,"statfs":{"total":96636764160,"available":94880092160,"internally_reserved":0,"allocated":1015808,"data_stored":756726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30760,"internal_metadata":1755613144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547129,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2590056,"kb_used_data":1096668,"kb_used_omap":126,"kb_used_meta":1493249,"kb_avail":91781784,"statfs":{"total":96636764160,"available":93984546816,"internally_reserved":0,"allocated":1122988032,"data_stored":1122639756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":129857,"internal_metadata":1529087167},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547128,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3070360,"kb_used_data":1518860,"kb_used_omap":915,"kb_used_meta":1550572,"kb_avail":91301480,"statfs":{"total":96636764160,"available":93492715520,"internally_reserved":0,"allocated":1555312640,"data_stored":1554968818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":937533,"internal_metadata":1587786179},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129547094,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":741924,"kb_used_data":29084,"kb_used_omap":1568,"kb_used_meta":698975,"kb_avail":93629916,"statfs":{"total":96636764160,"available":95877033984,"internally_reserved":0,"allocated":29782016,"data_stored":29526486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1605839,"internal_metadata":715751217},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129547090,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1603560,"kb_used_data":5088,"kb_used_omap":391,"kb_used_meta":1598072,"kb_avail":92768280,"statfs":{"total":96636764160,"available":94994718720,"internally_reserved":0,"allocated":5210112,"data_stored":4951030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":400499,"internal_metadata":1636426637},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1477860,"kb_used_data":412,"kb_used_omap":196,"kb_used_meta":1477243,"kb_avail":92893980,"statfs":{"total":96636764160,"available":95123435520,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":201061,"internal_metadata":1512697499},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T19:04:41.143 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-15T19:04:41.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T19:04:41.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.402+0000 7f937781c640 1 Processor -- start 2024-05-15T19:04:41.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.403+0000 7f937781c640 1 -- start start 2024-05-15T19:04:41.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f937781c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93700b4a40 0x7f93700ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:41.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f937781c640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93700b6430 con 0x7f93700ceaa0 2024-05-15T19:04:41.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f937781c640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93700b4f00 con 0x7f93701469b0 2024-05-15T19:04:41.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f937781c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f93700b51e0 con 0x7f93700b4a40 2024-05-15T19:04:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9374db7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93700b4a40 0x7f93700ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9375db9640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f93700ceaa0 0x7f937006e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40516/0 (socket says 172.21.15.77:40516) 2024-05-15T19:04:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9374db7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93700b4a40 0x7f93700ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41414/0 (socket says 172.21.15.77:41414) 2024-05-15T19:04:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f93755b8640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f93701469b0 0x7f937015e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:58316/0 (socket says 172.21.15.77:58316) 2024-05-15T19:04:41.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9375db9640 1 -- 172.21.15.77:0/176144235 learned_addr learned my addr 172.21.15.77:0/176144235 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9363fff640 1 -- 172.21.15.77:0/176144235 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558948004 0 0) 0x7f93700b4f00 con 0x7f93701469b0 2024-05-15T19:04:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9363fff640 1 -- 172.21.15.77:0/176144235 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f935c003520 con 0x7f93701469b0 2024-05-15T19:04:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9374db7640 1 -- 172.21.15.77:0/176144235 >> v1:172.21.15.83:6789/0 conn(0x7f93701469b0 legacy=0x7f937015e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.404+0000 7f9374db7640 1 -- 172.21.15.77:0/176144235 >> v1:172.21.15.77:6789/0 conn(0x7f93700ceaa0 legacy=0x7f937006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.405+0000 7f9374db7640 1 -- 172.21.15.77:0/176144235 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93700b54c0 con 0x7f93700b4a40 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.405+0000 7f9374db7640 1 --2- 172.21.15.77:0/176144235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f93700ce560 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f936c0097a0 tx=0x7f936c02a0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968cfa1028b9203e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.405+0000 7f9363fff640 1 -- 172.21.15.77:0/176144235 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c037070 con 0x7f93700b4a40 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f9363fff640 1 -- 172.21.15.77:0/176144235 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c02ad30 con 0x7f93700b4a40 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f9363fff640 1 -- 172.21.15.77:0/176144235 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c032640 con 0x7f93700b4a40 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 -- 172.21.15.77:0/176144235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 msgr2=0x7f93700ce560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 --2- 172.21.15.77:0/176144235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f93700ce560 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f936c0097a0 tx=0x7f936c02a0a0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 -- 172.21.15.77:0/176144235 shutdown_connections 2024-05-15T19:04:41.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 --2- 172.21.15.77:0/176144235 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f93700ce560 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 -- 172.21.15.77:0/176144235 >> 172.21.15.77:0/176144235 conn(0x7f937006c810 msgr2=0x7f937006cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 -- 172.21.15.77:0/176144235 shutdown_connections 2024-05-15T19:04:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.406+0000 7f937781c640 1 -- 172.21.15.77:0/176144235 wait complete. 2024-05-15T19:04:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 Processor -- start 2024-05-15T19:04:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 -- start start 2024-05-15T19:04:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f937013af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93700ceaa0 0x7f937015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93701469b0 0x7f9370160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f937006f070 con 0x7f93700b4a40 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f93700b5a80 con 0x7f93701469b0 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.408+0000 7f937781c640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f937006f1f0 con 0x7f93700ceaa0 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f93755b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f937013af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f93755b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f937013af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41428/0 (socket says 172.21.15.77:41428) 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f93755b8640 1 -- 172.21.15.77:0/4045686165 learned_addr learned my addr 172.21.15.77:0/4045686165 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9375db9640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93701469b0 0x7f9370160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9374db7640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93700ceaa0 0x7f937015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9374db7640 1 -- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93701469b0 msgr2=0x7f9370160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9374db7640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93701469b0 0x7f9370160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9374db7640 1 -- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 msgr2=0x7f937013af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9374db7640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f937013af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9374db7640 1 -- 172.21.15.77:0/4045686165 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93701605c0 con 0x7f93700ceaa0 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f93755b8640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f937013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.409+0000 7f9375db9640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93701469b0 0x7f9370160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.410+0000 7f9374db7640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93700ceaa0 0x7f937015fb40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f936c031000 tx=0x7f936c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.410+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c037040 con 0x7f93700ceaa0 2024-05-15T19:04:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.410+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f936c004030 con 0x7f93700ceaa0 2024-05-15T19:04:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.410+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f937013b940 con 0x7f93700ceaa0 2024-05-15T19:04:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.410+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f936c004400 con 0x7f93700ceaa0 2024-05-15T19:04:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.410+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f937013bf00 con 0x7f93700ceaa0 2024-05-15T19:04:41.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.413+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f937015de20 con 0x7f93700ceaa0 2024-05-15T19:04:41.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.413+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f936c003610 con 0x7f93700ceaa0 2024-05-15T19:04:41.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.415+0000 7f9361ffb640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9354076300 0x7f93540787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:41.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.415+0000 7f93755b8640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9354076300 0x7f93540787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:41.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.415+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f936c0b79e0 con 0x7f93700ceaa0 2024-05-15T19:04:41.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.415+0000 7f93755b8640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9354076300 0x7f93540787c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f93640012e0 tx=0x7f9364001720 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:41.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.419+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f93701605c0 con 0x7f93700ceaa0 2024-05-15T19:04:41.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.970+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93700ce820 con 0x7f9354076300 2024-05-15T19:04:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.972+0000 7f9361ffb640 1 -- 172.21.15.77:0/4045686165 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13644 (secure 0 0 0) 0x7f93700ce820 con 0x7f9354076300 2024-05-15T19:04:41.975 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T19:04:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9354076300 msgr2=0x7f93540787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9354076300 0x7f93540787c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f93640012e0 tx=0x7f9364001720 comp rx=0 tx=0).stop 2024-05-15T19:04:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93700ceaa0 msgr2=0x7f937015fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93700ceaa0 0x7f937015fb40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f936c031000 tx=0x7f936c0046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 shutdown_connections 2024-05-15T19:04:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9354076300 0x7f93540787c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f93700ceaa0 0x7f937015fb40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f93701469b0 0x7f9370160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 --2- 172.21.15.77:0/4045686165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93700b4a40 0x7f937013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 >> 172.21.15.77:0/4045686165 conn(0x7f937006c810 msgr2=0x7f937015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 shutdown_connections 2024-05-15T19:04:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:41.978+0000 7f937781c640 1 -- 172.21.15.77:0/4045686165 wait complete. 2024-05-15T19:04:42.009 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":12483,"stamp":"2024-05-15T19:04:41.223405+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11597948,"kb_used_data":8552,"kb_used_omap":3975,"kb_used_meta":11585336,"kb_avail":743376772,"statfs":{"total":773094113280,"available":761217814528,"internally_reserved":0,"allocated":8757248,"data_stored":6705904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4070423,"internal_metadata":11863385065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":478,"apply_latency_ms":478,"commit_latency_ns":478000000,"apply_latency_ns":478000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5885296960,"num_objects":-7939,"num_object_clones":0,"num_object_copies":-15878,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-7939,"num_whiteouts":0,"num_read":-2048198,"num_read_kb":-143877779,"num_write":-7537413,"num_write_kb":-208370139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-85,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002244"},"pg_stats":[{"pgid":"1.0","version":"16'72","reported_seq":347,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-15T19:04:35.283067+0000","last_change":"2024-05-15T12:09:32.171659+0000","last_active":"2024-05-15T19:04:35.283067+0000","last_peered":"2024-05-15T19:04:35.283067+0000","last_clean":"2024-05-15T19:04:35.283067+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T19:04:35.283067+0000","last_undegraded":"2024-05-15T19:04:35.283067+0000","last_fullsized":"2024-05-15T19:04:35.283067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-15T12:09:30.956404+0000","last_clean_scrub_stamp":"2024-05-15T12:09:30.956404+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T14:08:21.966511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719481668,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1435112,"kb_used_data":412,"kb_used_omap":528,"kb_used_meta":1434159,"kb_avail":92936728,"statfs":{"total":96636764160,"available":95167209472,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":541416,"internal_metadata":1468579096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424514425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1565096,"kb_used_data":412,"kb_used_omap":218,"kb_used_meta":1564453,"kb_avail":92806744,"statfs":{"total":96636764160,"available":95034105856,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223458,"internal_metadata":1602000670},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424514425,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1715500,"kb_used_data":992,"kb_used_omap":30,"kb_used_meta":1714465,"kb_avail":92656340,"statfs":{"total":96636764160,"available":94880092160,"internally_reserved":0,"allocated":1015808,"data_stored":756726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30760,"internal_metadata":1755613144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547130,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1529900,"kb_used_data":412,"kb_used_omap":126,"kb_used_meta":1529345,"kb_avail":92841940,"statfs":{"total":96636764160,"available":95070146560,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":129857,"internal_metadata":1566049471},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547129,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1569956,"kb_used_data":412,"kb_used_omap":915,"kb_used_meta":1568620,"kb_avail":92801884,"statfs":{"total":96636764160,"available":95029129216,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":937533,"internal_metadata":1606267331},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129547095,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":700964,"kb_used_data":412,"kb_used_omap":1568,"kb_used_meta":698975,"kb_avail":93670876,"statfs":{"total":96636764160,"available":95918977024,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1605839,"internal_metadata":715751217},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":182,"apply_latency_ms":182,"commit_latency_ns":182000000,"apply_latency_ns":182000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129547090,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1603560,"kb_used_data":5088,"kb_used_omap":391,"kb_used_meta":1598072,"kb_avail":92768280,"statfs":{"total":96636764160,"available":94994718720,"internally_reserved":0,"allocated":5210112,"data_stored":4951030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":400499,"internal_metadata":1636426637},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1477860,"kb_used_data":412,"kb_used_omap":196,"kb_used_meta":1477243,"kb_avail":92893980,"statfs":{"total":96636764160,"available":95123435520,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":201061,"internal_metadata":1512697499},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T19:04:42.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-15T19:04:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.278+0000 7ff983d12640 1 Processor -- start 2024-05-15T19:04:42.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.278+0000 7ff983d12640 1 -- start start 2024-05-15T19:04:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff983d12640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7ff97c15b950 0x7ff97c0b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff983d12640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff97c06db10 0x7ff97c06fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff983d12640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97c0cde20 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff983d12640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7ff97c06fff0 con 0x7ff97c06db10 2024-05-15T19:04:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff983d12640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7ff97c15bd30 con 0x7ff97c15b950 2024-05-15T19:04:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff9812ad640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7ff97c0cd9c0 0x7ff97c06d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:58324/0 (socket says 172.21.15.77:58324) 2024-05-15T19:04:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff9812ad640 1 -- 172.21.15.77:0/846917023 learned_addr learned my addr 172.21.15.77:0/846917023 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff9822af640 1 --2- 172.21.15.77:0/846917023 >> v2:172.21.15.77:3300/0 conn(0x7ff97c06db10 0x7ff97c06fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:42.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.281+0000 7ff981aae640 1 --2- 172.21.15.77:0/846917023 >> v2:172.21.15.83:3300/0 conn(0x7ff97c15b950 0x7ff97c0b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff980aac640 1 -- 172.21.15.77:0/846917023 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550191465 0 0) 0x7ff97c0cde20 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff980aac640 1 -- 172.21.15.77:0/846917023 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff968003520 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff981aae640 1 -- 172.21.15.77:0/846917023 >> v2:172.21.15.77:3300/0 conn(0x7ff97c06db10 msgr2=0x7ff97c06fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff981aae640 1 --2- 172.21.15.77:0/846917023 >> v2:172.21.15.77:3300/0 conn(0x7ff97c06db10 0x7ff97c06fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff981aae640 1 -- 172.21.15.77:0/846917023 >> v1:172.21.15.83:6789/0 conn(0x7ff97c0cd9c0 legacy=0x7ff97c06d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:42.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff981aae640 1 -- 172.21.15.77:0/846917023 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c070220 con 0x7ff97c15b950 2024-05-15T19:04:42.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.282+0000 7ff9822af640 1 --2- 172.21.15.77:0/846917023 >> v2:172.21.15.77:3300/0 conn(0x7ff97c06db10 0x7ff97c06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:42.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.284+0000 7ff981aae640 1 --2- 172.21.15.77:0/846917023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c15b950 0x7ff97c0b67d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff97c075e30 tx=0x7ff97802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f18c29848bcfd31 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:42.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.284+0000 7ff980aac640 1 -- 172.21.15.77:0/846917023 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff978037070 con 0x7ff97c15b950 2024-05-15T19:04:42.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.284+0000 7ff980aac640 1 -- 172.21.15.77:0/846917023 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff978032440 con 0x7ff97c15b950 2024-05-15T19:04:42.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.284+0000 7ff980aac640 1 -- 172.21.15.77:0/846917023 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97802ae60 con 0x7ff97c15b950 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.285+0000 7ff983d12640 1 -- 172.21.15.77:0/846917023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c15b950 msgr2=0x7ff97c0b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.285+0000 7ff983d12640 1 --2- 172.21.15.77:0/846917023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c15b950 0x7ff97c0b67d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff97c075e30 tx=0x7ff97802a110 comp rx=0 tx=0).stop 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.286+0000 7ff983d12640 1 -- 172.21.15.77:0/846917023 shutdown_connections 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.286+0000 7ff983d12640 1 --2- 172.21.15.77:0/846917023 >> v2:172.21.15.77:3300/0 conn(0x7ff97c06db10 0x7ff97c06fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.286+0000 7ff983d12640 1 --2- 172.21.15.77:0/846917023 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c15b950 0x7ff97c0b67d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.286+0000 7ff983d12640 1 -- 172.21.15.77:0/846917023 >> 172.21.15.77:0/846917023 conn(0x7ff97c072b20 msgr2=0x7ff97c072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:42.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.286+0000 7ff983d12640 1 -- 172.21.15.77:0/846917023 shutdown_connections 2024-05-15T19:04:42.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.286+0000 7ff983d12640 1 -- 172.21.15.77:0/846917023 wait complete. 2024-05-15T19:04:42.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.289+0000 7ff983d12640 1 Processor -- start 2024-05-15T19:04:42.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.289+0000 7ff983d12640 1 -- start start 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff983d12640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97c06db10 0x7ff97c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff983d12640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 0x7ff97c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff983d12640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff97c15b950 0x7ff97c14d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff983d12640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c0b5fd0 con 0x7ff97c06db10 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff983d12640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff97c0b5d80 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff983d12640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff97c0b62b0 con 0x7ff97c15b950 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff9812ad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 0x7ff97c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:42.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff981aae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97c06db10 0x7ff97c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.291+0000 7ff9812ad640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 0x7ff97c148a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:45848/0 (socket says 172.21.15.77:45848) 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 -- 172.21.15.77:0/2000763101 learned_addr learned my addr 172.21.15.77:0/2000763101 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9822af640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff97c15b950 0x7ff97c14d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 -- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff97c15b950 msgr2=0x7ff97c14d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff97c15b950 0x7ff97c14d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 -- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97c06db10 msgr2=0x7ff97c147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97c06db10 0x7ff97c147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 -- 172.21.15.77:0/2000763101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff97c1479c0 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9812ad640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 0x7ff97c148a40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c530 tx=0x7ff96c00c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:42.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.292+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c017070 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.293+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff96c005ce0 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.293+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff97c149290 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.293+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff96c007270 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.293+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff97c149850 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.296+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97c0694d0 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.297+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff96c01a070 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.298+0000 7ff9727fc640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff9600762d0 0x7ff960078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:42.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.298+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff96c096420 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.298+0000 7ff981aae640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff9600762d0 0x7ff960078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:42.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.299+0000 7ff981aae640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff9600762d0 0x7ff960078790 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff978034000 tx=0x7ff97802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:42.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.302+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff96c05fa30 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.869+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff97c073110 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.877 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.875+0000 7ff9727fc640 1 -- 172.21.15.77:0/2000763101 <== mon.1 v2:172.21.15.83:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+12948 (secure 0 0 0) 0x7ff96c063d30 con 0x7ff97c0cd9c0 2024-05-15T19:04:42.878 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:42.878 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":37,"fsid":"80026697-69b5-4668-adbe-f40fd7cb21f7","created":"2024-05-15T12:09:19.935122+0000","modified":"2024-05-15T19:04:34.957773+0000","last_up_change":"2024-05-15T12:09:31.957821+0000","last_in_change":"2024-05-15T12:09:22.090762+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-15T12:09:30.256214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"59dc97f1-ec1e-4bd1-9bea-277ec6925d4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6801","nonce":3927618642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6803","nonce":3927618642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6807","nonce":3927618642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":3927618642},{"type":"v1","addr":"172.21.15.77:6805","nonce":3927618642}]},"public_addr":"172.21.15.77:6801/3927618642","cluster_addr":"172.21.15.77:6803/3927618642","heartbeat_back_addr":"172.21.15.77:6807/3927618642","heartbeat_front_addr":"172.21.15.77:6805/3927618642","state":["exists","up"]},{"osd":1,"uuid":"283debc2-c7a2-4c35-927b-2fe20fe90876","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6811","nonce":1670577123}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6813","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6815","nonce":1670577123}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6822","nonce":1670577123}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":1670577123},{"type":"v1","addr":"172.21.15.77:6818","nonce":1670577123}]},"public_addr":"172.21.15.77:6811/1670577123","cluster_addr":"172.21.15.77:6815/1670577123","heartbeat_back_addr":"172.21.15.77:6822/1670577123","heartbeat_front_addr":"172.21.15.77:6818/1670577123","state":["exists","up"]},{"osd":2,"uuid":"a6c86551-eeab-4d74-bf49-db221ec4bbd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6810","nonce":606387833}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6814","nonce":606387833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6823","nonce":606387833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6817","nonce":606387833},{"type":"v1","addr":"172.21.15.77:6819","nonce":606387833}]},"public_addr":"172.21.15.77:6810/606387833","cluster_addr":"172.21.15.77:6814/606387833","heartbeat_back_addr":"172.21.15.77:6823/606387833","heartbeat_front_addr":"172.21.15.77:6819/606387833","state":["exists","up"]},{"osd":3,"uuid":"2c9ea503-e247-4b68-889d-2602fa53a867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6825","nonce":2819431659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6827","nonce":2819431659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6831","nonce":2819431659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2819431659},{"type":"v1","addr":"172.21.15.77:6829","nonce":2819431659}]},"public_addr":"172.21.15.77:6825/2819431659","cluster_addr":"172.21.15.77:6827/2819431659","heartbeat_back_addr":"172.21.15.77:6831/2819431659","heartbeat_front_addr":"172.21.15.77:6829/2819431659","state":["exists","up"]},{"osd":4,"uuid":"eb9b2415-afbd-4d8b-b1cb-1cb0041cc8ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6800","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6801","nonce":675760629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6802","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6803","nonce":675760629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6806","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6807","nonce":675760629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6804","nonce":675760629},{"type":"v1","addr":"172.21.15.83:6805","nonce":675760629}]},"public_addr":"172.21.15.83:6801/675760629","cluster_addr":"172.21.15.83:6803/675760629","heartbeat_back_addr":"172.21.15.83:6807/675760629","heartbeat_front_addr":"172.21.15.83:6805/675760629","state":["exists","up"]},{"osd":5,"uuid":"b5e4c411-9357-4134-b26b-63d1f218ce12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6808","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6810","nonce":2185384150}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6812","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6814","nonce":2185384150}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6820","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6822","nonce":2185384150}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6816","nonce":2185384150},{"type":"v1","addr":"172.21.15.83:6818","nonce":2185384150}]},"public_addr":"172.21.15.83:6810/2185384150","cluster_addr":"172.21.15.83:6814/2185384150","heartbeat_back_addr":"172.21.15.83:6822/2185384150","heartbeat_front_addr":"172.21.15.83:6818/2185384150","state":["exists","up"]},{"osd":6,"uuid":"06b7dd78-d345-4a6f-b118-1f3a640c59e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6809","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6811","nonce":151067659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6813","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6815","nonce":151067659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6821","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6823","nonce":151067659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6817","nonce":151067659},{"type":"v1","addr":"172.21.15.83:6819","nonce":151067659}]},"public_addr":"172.21.15.83:6811/151067659","cluster_addr":"172.21.15.83:6815/151067659","heartbeat_back_addr":"172.21.15.83:6823/151067659","heartbeat_front_addr":"172.21.15.83:6819/151067659","state":["exists","up"]},{"osd":7,"uuid":"5c8b4206-3b10-4eb0-a459-a06f62505354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6824","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6825","nonce":3871315040}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6826","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6827","nonce":3871315040}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6830","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6831","nonce":3871315040}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6828","nonce":3871315040},{"type":"v1","addr":"172.21.15.83:6829","nonce":3871315040}]},"public_addr":"172.21.15.83:6825/3871315040","cluster_addr":"172.21.15.83:6827/3871315040","heartbeat_back_addr":"172.21.15.83:6831/3871315040","heartbeat_front_addr":"172.21.15.83:6829/3871315040","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.186623+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273945+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.256791+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.273029+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.129229+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.284093+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.313747+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-15T12:09:27.289021+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:6837/1303228576":"2024-05-16T19:04:30.934575+0000","172.21.15.77:6835/1303228576":"2024-05-16T19:04:30.934575+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-15T19:04:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.877+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff9600762d0 msgr2=0x7ff960078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.877+0000 7ff983d12640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff9600762d0 0x7ff960078790 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7ff978034000 tx=0x7ff97802e000 comp rx=0 tx=0).stop 2024-05-15T19:04:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.877+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 msgr2=0x7ff97c148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 0x7ff97c148a40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff96c00c530 tx=0x7ff96c00c930 comp rx=0 tx=0).stop 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 shutdown_connections 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff9600762d0 0x7ff960078790 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff97c15b950 0x7ff97c14d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff97c0cd9c0 0x7ff97c148a40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 --2- 172.21.15.77:0/2000763101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff97c06db10 0x7ff97c147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 >> 172.21.15.77:0/2000763101 conn(0x7ff97c072b20 msgr2=0x7ff97c06d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 shutdown_connections 2024-05-15T19:04:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:42.878+0000 7ff983d12640 1 -- 172.21.15.77:0/2000763101 wait complete. 2024-05-15T19:04:43.908 INFO:tasks.ceph:Scrubbing osd.0 2024-05-15T19:04:43.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:44.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.190+0000 7fc3a07f2640 1 Processor -- start 2024-05-15T19:04:44.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.190+0000 7fc3a07f2640 1 -- start start 2024-05-15T19:04:44.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.192+0000 7fc3a07f2640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc39806d400 0x7fc398160560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc3a07f2640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 0x7fc3980af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc3a07f2640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3980afb00 con 0x7fc398162f40 2024-05-15T19:04:44.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc3a07f2640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fc3980afde0 con 0x7fc39806d400 2024-05-15T19:04:44.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc3a07f2640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc398160b10 con 0x7fc39806d7e0 2024-05-15T19:04:44.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39e58e640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fc39806d400 0x7fc398160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 0x7fc3980af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 0x7fc3980af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:40004/0 (socket says 172.21.15.77:40004) 2024-05-15T19:04:44.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 -- 172.21.15.77:0/1912200825 learned_addr learned my addr 172.21.15.77:0/1912200825 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:44.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 -- 172.21.15.77:0/1912200825 >> v2:172.21.15.83:3300/0 conn(0x7fc39806d400 msgr2=0x7fc398160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:44.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 --2- 172.21.15.77:0/1912200825 >> v2:172.21.15.83:3300/0 conn(0x7fc39806d400 0x7fc398160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 -- 172.21.15.77:0/1912200825 >> v1:172.21.15.77:6789/0 conn(0x7fc398162f40 legacy=0x7fc3981633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39dd8d640 1 -- 172.21.15.77:0/1912200825 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc398160d60 con 0x7fc39806d7e0 2024-05-15T19:04:44.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.193+0000 7fc39e58e640 1 --2- 172.21.15.77:0/1912200825 >> v2:172.21.15.83:3300/0 conn(0x7fc39806d400 0x7fc398160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:44.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.194+0000 7fc39dd8d640 1 --2- 172.21.15.77:0/1912200825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 0x7fc3980af2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc388009870 tx=0x7fc38802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff7050b5cfc84ec3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.194+0000 7fc39d58c640 1 -- 172.21.15.77:0/1912200825 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388037070 con 0x7fc39806d7e0 2024-05-15T19:04:44.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.195+0000 7fc39d58c640 1 -- 172.21.15.77:0/1912200825 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc388032440 con 0x7fc39806d7e0 2024-05-15T19:04:44.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.195+0000 7fc39d58c640 1 -- 172.21.15.77:0/1912200825 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc388032810 con 0x7fc39806d7e0 2024-05-15T19:04:44.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 -- 172.21.15.77:0/1912200825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 msgr2=0x7fc3980af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 --2- 172.21.15.77:0/1912200825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 0x7fc3980af2b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc388009870 tx=0x7fc38802a250 comp rx=0 tx=0).stop 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 -- 172.21.15.77:0/1912200825 shutdown_connections 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 --2- 172.21.15.77:0/1912200825 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d7e0 0x7fc3980af2b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 --2- 172.21.15.77:0/1912200825 >> v2:172.21.15.83:3300/0 conn(0x7fc39806d400 0x7fc398160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 -- 172.21.15.77:0/1912200825 >> 172.21.15.77:0/1912200825 conn(0x7fc398072a10 msgr2=0x7fc398072e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.196+0000 7fc3a07f2640 1 -- 172.21.15.77:0/1912200825 shutdown_connections 2024-05-15T19:04:44.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.197+0000 7fc3a07f2640 1 -- 172.21.15.77:0/1912200825 wait complete. 2024-05-15T19:04:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.200+0000 7fc3a07f2640 1 Processor -- start 2024-05-15T19:04:44.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.200+0000 7fc3a07f2640 1 -- start start 2024-05-15T19:04:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d400 0x7fc398150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc39806d7e0 0x7fc3980cf650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc398162f40 0x7fc39806f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3980af7f0 con 0x7fc39806d7e0 2024-05-15T19:04:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fc398161320 con 0x7fc398162f40 2024-05-15T19:04:44.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fc39806dc60 con 0x7fc39806d400 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39dd8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc39806d7e0 0x7fc3980cf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d400 0x7fc398150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d400 0x7fc398150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:40010/0 (socket says 172.21.15.77:40010) 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 -- 172.21.15.77:0/2071296735 learned_addr learned my addr 172.21.15.77:0/2071296735 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39ed8f640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc398162f40 0x7fc39806f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 -- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc398162f40 msgr2=0x7fc39806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc398162f40 0x7fc39806f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 -- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc39806d7e0 msgr2=0x7fc3980cf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc39806d7e0 0x7fc3980cf650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 -- 172.21.15.77:0/2071296735 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3980d00f0 con 0x7fc39806d400 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39ed8f640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fc398162f40 0x7fc39806f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39dd8d640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc39806d7e0 0x7fc3980cf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc39e58e640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d400 0x7fc398150ba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e960 tx=0x7fc39400ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc394017070 con 0x7fc39806d400 2024-05-15T19:04:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39400ca00 con 0x7fc39806d400 2024-05-15T19:04:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39400cdd0 con 0x7fc39806d400 2024-05-15T19:04:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3980d03d0 con 0x7fc39806d400 2024-05-15T19:04:44.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.203+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3980d0990 con 0x7fc39806d400 2024-05-15T19:04:44.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.205+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc39401a070 con 0x7fc39806d400 2024-05-15T19:04:44.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.205+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3980694d0 con 0x7fc39806d400 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.206+0000 7fc38effd640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc37c0762d0 0x7fc37c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.206+0000 7fc39dd8d640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc37c0762d0 0x7fc37c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.206+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fc3940975e0 con 0x7fc39806d400 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.207+0000 7fc38effd640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7fc37c07c190 0x7fc37c07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.207+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 --> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc37c07ec60 con 0x7fc37c07c190 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.207+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fc39409e050 con 0x7fc39806d400 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.207+0000 7fc39ed8f640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7fc37c07c190 0x7fc37c07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.207+0000 7fc39dd8d640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc37c0762d0 0x7fc37c078790 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc388034000 tx=0x7fc38802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.208+0000 7fc39ed8f640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7fc37c07c190 0x7fc37c07e5b0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.209+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== osd.0 v2:172.21.15.77:6800/3927618642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc37c07ec60 con 0x7fc37c07c190 2024-05-15T19:04:44.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.247+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 --> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc3981510e0 con 0x7fc37c07c190 2024-05-15T19:04:44.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.248+0000 7fc38effd640 1 -- 172.21.15.77:0/2071296735 <== osd.0 v2:172.21.15.77:6800/3927618642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc3981510e0 con 0x7fc37c07c190 2024-05-15T19:04:44.251 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:44.251 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:44.252 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.248+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7fc37c07c190 msgr2=0x7fc37c07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.248+0000 7fc3a07f2640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6800/3927618642,v1:172.21.15.77:6801/3927618642] conn(0x7fc37c07c190 0x7fc37c07e5b0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc37c0762d0 msgr2=0x7fc37c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fc37c0762d0 0x7fc37c078790 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fc388034000 tx=0x7fc38802e000 comp rx=0 tx=0).stop 2024-05-15T19:04:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d400 msgr2=0x7fc398150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 --2- 172.21.15.77:0/2071296735 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fc39806d400 0x7fc398150ba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e960 tx=0x7fc39400ee20 comp rx=0 tx=0).stop 2024-05-15T19:04:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc39ed8f640 1 -- 172.21.15.77:0/2071296735 reap_dead start 2024-05-15T19:04:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 shutdown_connections 2024-05-15T19:04:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 >> 172.21.15.77:0/2071296735 conn(0x7fc398072a10 msgr2=0x7fc39815d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 shutdown_connections 2024-05-15T19:04:44.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.249+0000 7fc3a07f2640 1 -- 172.21.15.77:0/2071296735 wait complete. 2024-05-15T19:04:44.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-15T19:04:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 Processor -- start 2024-05-15T19:04:44.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 -- start start 2024-05-15T19:04:44.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f17f4159a30 0x7f17f4073db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f17f406fc00 0x7f17f415c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f415d060 con 0x7f17f415c4f0 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f17f415d340 con 0x7f17f4159a30 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17fa704640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40735b0 con 0x7f17f406fc00 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f17f4159a30 0x7f17f4073db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17eb7fe640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f17f415c4f0 0x7f17f406f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40750/0 (socket says 172.21.15.77:40750) 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.542+0000 7f17eb7fe640 1 -- 172.21.15.77:0/284444583 learned_addr learned my addr 172.21.15.77:0/284444583 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:44.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.543+0000 7f17f8ca1640 1 --2- 172.21.15.77:0/284444583 >> v2:172.21.15.83:3300/0 conn(0x7f17f406fc00 0x7f17f415c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.543+0000 7f17f8ca1640 1 -- 172.21.15.77:0/284444583 >> v2:172.21.15.77:3300/0 conn(0x7f17f4159a30 msgr2=0x7f17f4073db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:44.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.543+0000 7f17f8ca1640 1 --2- 172.21.15.77:0/284444583 >> v2:172.21.15.77:3300/0 conn(0x7f17f4159a30 0x7f17f4073db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.543+0000 7f17f8ca1640 1 -- 172.21.15.77:0/284444583 >> v1:172.21.15.77:6789/0 conn(0x7f17f415c4f0 legacy=0x7f17f406f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.543+0000 7f17f8ca1640 1 -- 172.21.15.77:0/284444583 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f4073890 con 0x7f17f406fc00 2024-05-15T19:04:44.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.543+0000 7f17f3fff640 1 --2- 172.21.15.77:0/284444583 >> v2:172.21.15.77:3300/0 conn(0x7f17f4159a30 0x7f17f4073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:44.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.545+0000 7f17f8ca1640 1 --2- 172.21.15.77:0/284444583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f415c9a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f17f40cdc50 tx=0x7f17ec02a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21a350d74b9408f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17f37fe640 1 -- 172.21.15.77:0/284444583 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007740 con 0x7f17f406fc00 2024-05-15T19:04:44.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17f37fe640 1 -- 172.21.15.77:0/284444583 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ec0078e0 con 0x7f17f406fc00 2024-05-15T19:04:44.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17f37fe640 1 -- 172.21.15.77:0/284444583 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007cb0 con 0x7f17f406fc00 2024-05-15T19:04:44.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 -- 172.21.15.77:0/284444583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 msgr2=0x7f17f415c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 --2- 172.21.15.77:0/284444583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f415c9a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f17f40cdc50 tx=0x7f17ec02a680 comp rx=0 tx=0).stop 2024-05-15T19:04:44.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 -- 172.21.15.77:0/284444583 shutdown_connections 2024-05-15T19:04:44.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 --2- 172.21.15.77:0/284444583 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f415c9a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 --2- 172.21.15.77:0/284444583 >> v2:172.21.15.77:3300/0 conn(0x7f17f4159a30 0x7f17f4073db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 -- 172.21.15.77:0/284444583 >> 172.21.15.77:0/284444583 conn(0x7f17f406c3f0 msgr2=0x7f17f406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:44.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 -- 172.21.15.77:0/284444583 shutdown_connections 2024-05-15T19:04:44.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.547+0000 7f17fa704640 1 -- 172.21.15.77:0/284444583 wait complete. 2024-05-15T19:04:44.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.548+0000 7f17fa704640 1 Processor -- start 2024-05-15T19:04:44.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.548+0000 7f17fa704640 1 -- start start 2024-05-15T19:04:44.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.549+0000 7f17fa704640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f4147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.549+0000 7f17fa704640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17f4159a30 0x7f17f4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.549+0000 7f17fa704640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f415c4f0 0x7f17f41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.549+0000 7f17fa704640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4159f90 con 0x7f17f415c4f0 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.549+0000 7f17fa704640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f17f4159e10 con 0x7f17f406fc00 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.549+0000 7f17fa704640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40742f0 con 0x7f17f4159a30 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f8ca1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f415c4f0 0x7f17f41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f3fff640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f4147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f8ca1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f415c4f0 0x7f17f41558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59606/0 (socket says 172.21.15.77:59606) 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f8ca1640 1 -- 172.21.15.77:0/478942875 learned_addr learned my addr 172.21.15.77:0/478942875 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:44.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17eb7fe640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17f4159a30 0x7f17f4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f3fff640 1 -- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17f4159a30 msgr2=0x7f17f4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f3fff640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17f4159a30 0x7f17f4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f3fff640 1 -- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f415c4f0 msgr2=0x7f17f41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f3fff640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f415c4f0 0x7f17f41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:44.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.550+0000 7f17f3fff640 1 -- 172.21.15.77:0/478942875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f4147cc0 con 0x7f17f406fc00 2024-05-15T19:04:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.551+0000 7f17f3fff640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f4147450 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f17e400e900 tx=0x7f17e400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.551+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4017070 con 0x7f17f406fc00 2024-05-15T19:04:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.551+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e400ca00 con 0x7f17f406fc00 2024-05-15T19:04:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.551+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f4154800 con 0x7f17f406fc00 2024-05-15T19:04:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.551+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e400cdf0 con 0x7f17f406fc00 2024-05-15T19:04:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.551+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f4154dc0 con 0x7f17f406fc00 2024-05-15T19:04:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.553+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f17e401a070 con 0x7f17f406fc00 2024-05-15T19:04:44.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.553+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f40768e0 con 0x7f17f406fc00 2024-05-15T19:04:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.554+0000 7f17f17fa640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f17d40762d0 0x7f17d4078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:44.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.555+0000 7f17eb7fe640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f17d40762d0 0x7f17d4078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.555+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f17e40971c0 con 0x7f17f406fc00 2024-05-15T19:04:44.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.555+0000 7f17eb7fe640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f17d40762d0 0x7f17d4078790 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f17f4152740 tx=0x7f17dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:44.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:44.559+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f17e4060730 con 0x7f17f406fc00 2024-05-15T19:04:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.120+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f17f406f6b0 con 0x7f17d40762d0 2024-05-15T19:04:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.120+0000 7f17f17fa640 1 -- 172.21.15.77:0/478942875 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f17f406f6b0 con 0x7f17d40762d0 2024-05-15T19:04:45.124 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 0 to deep-scrub 2024-05-15T19:04:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f17d40762d0 msgr2=0x7f17d4078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f17d40762d0 0x7f17d4078790 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f17f4152740 tx=0x7f17dc009040 comp rx=0 tx=0).stop 2024-05-15T19:04:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 msgr2=0x7f17f4147450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f4147450 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f17e400e900 tx=0x7f17e400edc0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 shutdown_connections 2024-05-15T19:04:45.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f17d40762d0 0x7f17d4078790 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f17f4159a30 0x7f17f4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f17f415c4f0 0x7f17f41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 --2- 172.21.15.77:0/478942875 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f17f406fc00 0x7f17f4147450 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 >> 172.21.15.77:0/478942875 conn(0x7f17f406c3f0 msgr2=0x7f17f40b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 shutdown_connections 2024-05-15T19:04:45.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.125+0000 7f17fa704640 1 -- 172.21.15.77:0/478942875 wait complete. 2024-05-15T19:04:45.155 INFO:tasks.ceph:Scrubbing osd.1 2024-05-15T19:04:45.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:45.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.446+0000 7fd95212b640 1 Processor -- start 2024-05-15T19:04:45.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.446+0000 7fd95212b640 1 -- start start 2024-05-15T19:04:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd95212b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd94c073350 0x7fd94c0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd95212b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0b4fa0 0x7fd94c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd95212b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94c0b5910 con 0x7fd94c0708b0 2024-05-15T19:04:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd95212b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fd94c0b5bf0 con 0x7fd94c073350 2024-05-15T19:04:45.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd95212b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c0b5ed0 con 0x7fd94c0b4fa0 2024-05-15T19:04:45.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd94b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd94c073350 0x7fd94c0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd94b7fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fd94c073350 0x7fd94c0b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:34210/0 (socket says 172.21.15.77:34210) 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd94b7fe640 1 -- 172.21.15.77:0/1651371374 learned_addr learned my addr 172.21.15.77:0/1651371374 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd942ffd640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7fd94c0708b0 0x7fd94c073730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:58566/0 (socket says 172.21.15.77:58566) 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.449+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0b4fa0 0x7fd94c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.450+0000 7fd94b7fe640 1 -- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0b4fa0 msgr2=0x7fd94c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.450+0000 7fd94b7fe640 1 --2- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0b4fa0 0x7fd94c0cf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.450+0000 7fd94b7fe640 1 -- 172.21.15.77:0/1651371374 >> v1:172.21.15.83:6789/0 conn(0x7fd94c0708b0 legacy=0x7fd94c073730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.450+0000 7fd94b7fe640 1 -- 172.21.15.77:0/1651371374 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0b61b0 con 0x7fd94c073350 2024-05-15T19:04:45.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.452+0000 7fd94b7fe640 1 --2- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 0x7fd94c0b69b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009870 tx=0x7fd93c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ff9f48ec66692d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.452+0000 7fd94affd640 1 -- 172.21.15.77:0/1651371374 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c037070 con 0x7fd94c073350 2024-05-15T19:04:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.452+0000 7fd94affd640 1 -- 172.21.15.77:0/1651371374 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c032440 con 0x7fd94c073350 2024-05-15T19:04:45.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.452+0000 7fd94affd640 1 -- 172.21.15.77:0/1651371374 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c032810 con 0x7fd94c073350 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.453+0000 7fd95212b640 1 -- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 msgr2=0x7fd94c0b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.453+0000 7fd95212b640 1 --2- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 0x7fd94c0b69b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009870 tx=0x7fd93c02a270 comp rx=0 tx=0).stop 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.454+0000 7fd95212b640 1 -- 172.21.15.77:0/1651371374 shutdown_connections 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.454+0000 7fd95212b640 1 --2- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0b4fa0 0x7fd94c0cf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.454+0000 7fd95212b640 1 --2- 172.21.15.77:0/1651371374 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 0x7fd94c0b69b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.454+0000 7fd95212b640 1 -- 172.21.15.77:0/1651371374 >> 172.21.15.77:0/1651371374 conn(0x7fd94c0b3ca0 msgr2=0x7fd94c0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:45.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.454+0000 7fd95212b640 1 -- 172.21.15.77:0/1651371374 shutdown_connections 2024-05-15T19:04:45.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.454+0000 7fd95212b640 1 -- 172.21.15.77:0/1651371374 wait complete. 2024-05-15T19:04:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.457+0000 7fd95212b640 1 Processor -- start 2024-05-15T19:04:45.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.457+0000 7fd95212b640 1 -- start start 2024-05-15T19:04:45.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.458+0000 7fd95212b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0708b0 0x7fd94c156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.458+0000 7fd95212b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 0x7fd94c0aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd95212b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd94c0b4fa0 0x7fd94c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd95212b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c15c430 con 0x7fd94c0b4fa0 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd95212b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fd94c15c2b0 con 0x7fd94c073350 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd95212b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fd94c0b5410 con 0x7fd94c0708b0 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0708b0 0x7fd94c156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd942ffd640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 0x7fd94c0aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd94c0b4fa0 0x7fd94c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0708b0 0x7fd94c156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:40040/0 (socket says 172.21.15.77:40040) 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 -- 172.21.15.77:0/3443949750 learned_addr learned my addr 172.21.15.77:0/3443949750 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:45.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 -- 172.21.15.77:0/3443949750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 msgr2=0x7fd94c0aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fd94c073350 0x7fd94c0aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 -- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd94c0b4fa0 msgr2=0x7fd94c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd94c0b4fa0 0x7fd94c0ad0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.459+0000 7fd94b7fe640 1 -- 172.21.15.77:0/3443949750 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94c0ab300 con 0x7fd94c0708b0 2024-05-15T19:04:45.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.460+0000 7fd94b7fe640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0708b0 0x7fd94c156ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd93c000c00 tx=0x7fd93c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.460+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c037040 con 0x7fd94c0708b0 2024-05-15T19:04:45.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.460+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd93c042070 con 0x7fd94c0708b0 2024-05-15T19:04:45.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.460+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c030880 con 0x7fd94c0708b0 2024-05-15T19:04:45.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.460+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94c0ab5e0 con 0x7fd94c0708b0 2024-05-15T19:04:45.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.460+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd94c0abba0 con 0x7fd94c0708b0 2024-05-15T19:04:45.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.462+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd94c0abf80 con 0x7fd94c0708b0 2024-05-15T19:04:45.467 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.463+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd93c030a20 con 0x7fd94c0708b0 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.464+0000 7fd948ff9640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd92c0762d0 0x7fd92c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.464+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd93c0b7a30 con 0x7fd94c0708b0 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.464+0000 7fd948ff9640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fd92c07c190 0x7fd92c07e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.464+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 --> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd93c040e80 con 0x7fd92c07c190 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.464+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd93c0bc2a0 con 0x7fd94c0708b0 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.464+0000 7fd942ffd640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd92c0762d0 0x7fd92c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.465+0000 7fd94bfff640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fd92c07c190 0x7fd92c07e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.465+0000 7fd942ffd640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd92c0762d0 0x7fd92c078790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd934000f60 tx=0x7fd934000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.465+0000 7fd94bfff640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fd92c07c190 0x7fd92c07e5b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.466+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== osd.1 v2:172.21.15.77:6809/1670577123 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd93c040e80 con 0x7fd92c07c190 2024-05-15T19:04:45.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.504+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 --> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd94c075c10 con 0x7fd92c07c190 2024-05-15T19:04:45.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.506+0000 7fd948ff9640 1 -- 172.21.15.77:0/3443949750 <== osd.1 v2:172.21.15.77:6809/1670577123 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd94c075c10 con 0x7fd92c07c190 2024-05-15T19:04:45.509 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:45.510 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:45.510 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fd92c07c190 msgr2=0x7fd92c07e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6809/1670577123,v1:172.21.15.77:6811/1670577123] conn(0x7fd92c07c190 0x7fd92c07e5b0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd92c0762d0 msgr2=0x7fd92c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fd92c0762d0 0x7fd92c078790 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd934000f60 tx=0x7fd934000bc0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0708b0 msgr2=0x7fd94c156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 --2- 172.21.15.77:0/3443949750 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fd94c0708b0 0x7fd94c156ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd93c000c00 tx=0x7fd93c0046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd94bfff640 1 -- 172.21.15.77:0/3443949750 reap_dead start 2024-05-15T19:04:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 shutdown_connections 2024-05-15T19:04:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 >> 172.21.15.77:0/3443949750 conn(0x7fd94c0b3ca0 msgr2=0x7fd94c0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 shutdown_connections 2024-05-15T19:04:45.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.507+0000 7fd95212b640 1 -- 172.21.15.77:0/3443949750 wait complete. 2024-05-15T19:04:45.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-15T19:04:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.803+0000 7f0b63645640 1 Processor -- start 2024-05-15T19:04:45.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.803+0000 7f0b63645640 1 -- start start 2024-05-15T19:04:45.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b63645640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b63645640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f0b5c0d3d60 0x7f0b5c0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b63645640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b5c0d0bf0 con 0x7f0b5c0d0300 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b63645640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f0b5c0d41c0 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b63645640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c0d11b0 con 0x7f0b5c15f780 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b61be2640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0b5c0d0300 0x7f0b5c0d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40760/0 (socket says 172.21.15.77:40760) 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b61be2640 1 -- 172.21.15.77:0/687250833 learned_addr learned my addr 172.21.15.77:0/687250833 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:45.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b60be0640 1 --2- 172.21.15.77:0/687250833 >> v2:172.21.15.83:3300/0 conn(0x7f0b5c0d3d60 0x7f0b5c0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.804+0000 7f0b613e1640 1 --2- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.805+0000 7f0b4ffff640 1 -- 172.21.15.77:0/687250833 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73968952 0 0) 0x7f0b5c0d0bf0 con 0x7f0b5c0d0300 2024-05-15T19:04:45.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.805+0000 7f0b60be0640 1 -- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 msgr2=0x7f0b5c0d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:45.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.805+0000 7f0b60be0640 1 --2- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.805+0000 7f0b60be0640 1 -- 172.21.15.77:0/687250833 >> v1:172.21.15.77:6789/0 conn(0x7f0b5c0d0300 legacy=0x7f0b5c0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.805+0000 7f0b60be0640 1 -- 172.21.15.77:0/687250833 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c0d0ed0 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.807+0000 7f0b60be0640 1 --2- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0cfdc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009d90 tx=0x7f0b5002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f497c4d25dc05d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.808+0000 7f0b4ffff640 1 -- 172.21.15.77:0/687250833 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50031600 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.808+0000 7f0b4ffff640 1 -- 172.21.15.77:0/687250833 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b500317a0 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.808+0000 7f0b4ffff640 1 -- 172.21.15.77:0/687250833 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50031b70 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.809+0000 7f0b63645640 1 -- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d3d60 msgr2=0x7f0b5c0cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.809+0000 7f0b63645640 1 --2- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0cfdc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009d90 tx=0x7f0b5002a5d0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.809+0000 7f0b63645640 1 -- 172.21.15.77:0/687250833 shutdown_connections 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.809+0000 7f0b63645640 1 --2- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0cfdc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.809+0000 7f0b63645640 1 --2- 172.21.15.77:0/687250833 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.809+0000 7f0b63645640 1 -- 172.21.15.77:0/687250833 >> 172.21.15.77:0/687250833 conn(0x7f0b5c09e510 msgr2=0x7f0b5c0d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.810+0000 7f0b63645640 1 -- 172.21.15.77:0/687250833 shutdown_connections 2024-05-15T19:04:45.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.810+0000 7f0b63645640 1 -- 172.21.15.77:0/687250833 wait complete. 2024-05-15T19:04:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.813+0000 7f0b63645640 1 Processor -- start 2024-05-15T19:04:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.813+0000 7f0b63645640 1 -- start start 2024-05-15T19:04:45.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b63645640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d0300 0x7f0b5c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b63645640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b63645640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b63645640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0d0790 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b63645640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5c0b4f80 con 0x7f0b5c0d0300 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b63645640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5c0d0910 con 0x7f0b5c15f780 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b60be0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b613e1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d0300 0x7f0b5c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b60be0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0a25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59622/0 (socket says 172.21.15.77:59622) 2024-05-15T19:04:45.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b60be0640 1 -- 172.21.15.77:0/1259626582 learned_addr learned my addr 172.21.15.77:0/1259626582 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:45.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.815+0000 7f0b61be2640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b60be0640 1 -- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 msgr2=0x7f0b5c0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b60be0640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b60be0640 1 -- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d0300 msgr2=0x7f0b5c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:45.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b60be0640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d0300 0x7f0b5c150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:45.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b60be0640 1 -- 172.21.15.77:0/1259626582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5c0b7e20 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b613e1640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d0300 0x7f0b5c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b61be2640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.816+0000 7f0b60be0640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0a25e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009eb0 tx=0x7f0b50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.817+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50040070 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.817+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b50030be0 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.817+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5c0b8100 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.817+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50009450 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.817+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5c0b86c0 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.820+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b5c0768e0 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.822+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0b50039040 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.823+0000 7f0b4dffb640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0b400762d0 0x7f0b40078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:45.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.823+0000 7f0b613e1640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0b400762d0 0x7f0b40078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:45.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.823+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f0b500b8480 con 0x7f0b5c0d3d60 2024-05-15T19:04:45.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.824+0000 7f0b613e1640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0b400762d0 0x7f0b40078790 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009f30 tx=0x7f0b58009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:45.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:45.836+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0b50081a90 con 0x7f0b5c0d3d60 2024-05-15T19:04:46.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.393+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0b5c0b4700 con 0x7f0b400762d0 2024-05-15T19:04:46.397 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.394+0000 7f0b4dffb640 1 -- 172.21.15.77:0/1259626582 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b5c0b4700 con 0x7f0b400762d0 2024-05-15T19:04:46.397 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 1 to deep-scrub 2024-05-15T19:04:46.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.398+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0b400762d0 msgr2=0x7f0b40078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.398+0000 7f0b63645640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0b400762d0 0x7f0b40078790 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009f30 tx=0x7f0b58009190 comp rx=0 tx=0).stop 2024-05-15T19:04:46.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.398+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 msgr2=0x7f0b5c0a25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.398+0000 7f0b63645640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0a25e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f0b50009eb0 tx=0x7f0b50004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 shutdown_connections 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f0b400762d0 0x7f0b40078790 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f0b5c15f780 0x7f0b5c0ceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b5c0d3d60 0x7f0b5c0a25e0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 --2- 172.21.15.77:0/1259626582 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f0b5c0d0300 0x7f0b5c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 >> 172.21.15.77:0/1259626582 conn(0x7f0b5c09e510 msgr2=0x7f0b5c0d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 shutdown_connections 2024-05-15T19:04:46.403 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.399+0000 7f0b63645640 1 -- 172.21.15.77:0/1259626582 wait complete. 2024-05-15T19:04:46.429 INFO:tasks.ceph:Scrubbing osd.2 2024-05-15T19:04:46.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:46.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.702+0000 7f731e304640 1 Processor -- start 2024-05-15T19:04:46.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.702+0000 7f731e304640 1 -- start start 2024-05-15T19:04:46.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f731e304640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f7318145880 0x7f73181602b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f731e304640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7318162e90 0x7f731806f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f731e304640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f731806f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f731e304640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f731815f840 con 0x7f7318162e90 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f731e304640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f73181607f0 con 0x7f7318145880 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f731e304640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f7318163870 con 0x7f7318163340 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.703+0000 7f730f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7318162e90 0x7f731806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7318162e90 0x7f731806f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59636/0 (socket says 172.21.15.77:59636) 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 -- 172.21.15.77:0/1287227318 learned_addr learned my addr 172.21.15.77:0/1287227318 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f7317fff640 1 --2- 172.21.15.77:0/1287227318 >> v2:172.21.15.83:3300/0 conn(0x7f7318145880 0x7f73181602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f731c8a1640 1 --2- 172.21.15.77:0/1287227318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f731806f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 -- 172.21.15.77:0/1287227318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 msgr2=0x7f731806f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:46.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 --2- 172.21.15.77:0/1287227318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f731806f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 -- 172.21.15.77:0/1287227318 >> v2:172.21.15.83:3300/0 conn(0x7f7318145880 msgr2=0x7f73181602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:46.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 --2- 172.21.15.77:0/1287227318 >> v2:172.21.15.83:3300/0 conn(0x7f7318145880 0x7f73181602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.704+0000 7f730f7fe640 1 -- 172.21.15.77:0/1287227318 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7318163b50 con 0x7f7318162e90 2024-05-15T19:04:46.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.706+0000 7f730f7fe640 1 --2- 172.21.15.77:0/1287227318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318162e90 0x7f731806f390 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7318074870 tx=0x7f730002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a66fac1dc15d90f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:46.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.706+0000 7f73177fe640 1 -- 172.21.15.77:0/1287227318 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300037070 con 0x7f7318162e90 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.706+0000 7f73177fe640 1 -- 172.21.15.77:0/1287227318 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7300032440 con 0x7f7318162e90 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.706+0000 7f73177fe640 1 -- 172.21.15.77:0/1287227318 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300032810 con 0x7f7318162e90 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 -- 172.21.15.77:0/1287227318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318162e90 msgr2=0x7f731806f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 --2- 172.21.15.77:0/1287227318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318162e90 0x7f731806f390 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f7318074870 tx=0x7f730002a1e0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 -- 172.21.15.77:0/1287227318 shutdown_connections 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 --2- 172.21.15.77:0/1287227318 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f731806f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 --2- 172.21.15.77:0/1287227318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318162e90 0x7f731806f390 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 --2- 172.21.15.77:0/1287227318 >> v2:172.21.15.83:3300/0 conn(0x7f7318145880 0x7f73181602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 -- 172.21.15.77:0/1287227318 >> 172.21.15.77:0/1287227318 conn(0x7f73180b2c20 msgr2=0x7f73180b3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:46.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 -- 172.21.15.77:0/1287227318 shutdown_connections 2024-05-15T19:04:46.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.707+0000 7f731e304640 1 -- 172.21.15.77:0/1287227318 wait complete. 2024-05-15T19:04:46.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.708+0000 7f731e304640 1 Processor -- start 2024-05-15T19:04:46.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.708+0000 7f731e304640 1 -- start start 2024-05-15T19:04:46.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.709+0000 7f731e304640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318145880 0x7f73180c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.709+0000 7f731e304640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7318162e90 0x7f731815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.709+0000 7f731e304640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f73180c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.709+0000 7f731e304640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f73180afed0 con 0x7f7318145880 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.709+0000 7f731e304640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f7318145c60 con 0x7f7318162e90 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.709+0000 7f731e304640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f73180b0050 con 0x7f7318163340 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318145880 0x7f73180c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318145880 0x7f73180c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59648/0 (socket says 172.21.15.77:59648) 2024-05-15T19:04:46.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 -- 172.21.15.77:0/1765245660 learned_addr learned my addr 172.21.15.77:0/1765245660 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f730f7fe640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7318162e90 0x7f731815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f731c8a1640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f73180c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 -- 172.21.15.77:0/1765245660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 msgr2=0x7f73180c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f7318163340 0x7f73180c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 -- 172.21.15.77:0/1765245660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7318162e90 msgr2=0x7f731815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f7318162e90 0x7f731815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 -- 172.21.15.77:0/1765245660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731812ff00 con 0x7f7318145880 2024-05-15T19:04:46.716 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.710+0000 7f7317fff640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318145880 0x7f73180c6cb0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f730800e870 tx=0x7f730800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:46.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.711+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7308017070 con 0x7f7318145880 2024-05-15T19:04:46.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.711+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730800ee60 con 0x7f7318145880 2024-05-15T19:04:46.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.711+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73181301e0 con 0x7f7318145880 2024-05-15T19:04:46.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.711+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730800cb80 con 0x7f7318145880 2024-05-15T19:04:46.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.711+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73181307a0 con 0x7f7318145880 2024-05-15T19:04:46.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.713+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f731806a640 con 0x7f7318145880 2024-05-15T19:04:46.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.714+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f730801a070 con 0x7f7318145880 2024-05-15T19:04:46.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.716+0000 7f73157fa640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f72f80762d0 0x7f72f8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.716+0000 7f730f7fe640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f72f80762d0 0x7f72f8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.716+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f73080974f0 con 0x7f7318145880 2024-05-15T19:04:46.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.716+0000 7f73157fa640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7f72f807c190 0x7f72f807e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:46.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.716+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 --> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72f807ec60 con 0x7f72f807c190 2024-05-15T19:04:46.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.716+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f730809e050 con 0x7f7318145880 2024-05-15T19:04:46.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.717+0000 7f731c8a1640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7f72f807c190 0x7f72f807e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:46.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.717+0000 7f730f7fe640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f72f80762d0 0x7f72f8078790 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7300034000 tx=0x7f730002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:46.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.717+0000 7f731c8a1640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7f72f807c190 0x7f72f807e5b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:46.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.719+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== osd.2 v2:172.21.15.77:6808/606387833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72f807ec60 con 0x7f72f807c190 2024-05-15T19:04:46.761 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.757+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 --> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f73180b3a90 con 0x7f72f807c190 2024-05-15T19:04:46.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.758+0000 7f73157fa640 1 -- 172.21.15.77:0/1765245660 <== osd.2 v2:172.21.15.77:6808/606387833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f73180b3a90 con 0x7f72f807c190 2024-05-15T19:04:46.762 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:46.763 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7f72f807c190 msgr2=0x7f72f807e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6808/606387833,v1:172.21.15.77:6810/606387833] conn(0x7f72f807c190 0x7f72f807e5b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f72f80762d0 msgr2=0x7f72f8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f72f80762d0 0x7f72f8078790 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f7300034000 tx=0x7f730002e000 comp rx=0 tx=0).stop 2024-05-15T19:04:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318145880 msgr2=0x7f73180c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:46.764 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 --2- 172.21.15.77:0/1765245660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7318145880 0x7f73180c6cb0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f730800e870 tx=0x7f730800ed30 comp rx=0 tx=0).stop 2024-05-15T19:04:46.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731c8a1640 1 -- 172.21.15.77:0/1765245660 reap_dead start 2024-05-15T19:04:46.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 shutdown_connections 2024-05-15T19:04:46.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 >> 172.21.15.77:0/1765245660 conn(0x7f73180b2c20 msgr2=0x7f73180b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:46.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 shutdown_connections 2024-05-15T19:04:46.765 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:46.759+0000 7f731e304640 1 -- 172.21.15.77:0/1765245660 wait complete. 2024-05-15T19:04:46.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-15T19:04:47.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.046+0000 7f44f4fb6640 1 Processor -- start 2024-05-15T19:04:47.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.046+0000 7f44f4fb6640 1 -- start start 2024-05-15T19:04:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44f4fb6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f44f015f780 0x7f44f00d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44f4fb6640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d3d60 0x7f44f00cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44f4fb6640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44f00d0bf0 con 0x7f44f00d0300 2024-05-15T19:04:47.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44f4fb6640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f44f00d41c0 con 0x7f44f015f780 2024-05-15T19:04:47.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44f4fb6640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00d11b0 con 0x7f44f00d3d60 2024-05-15T19:04:47.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44eed9d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f44f00d0300 0x7f44f00d18e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40770/0 (socket says 172.21.15.77:40770) 2024-05-15T19:04:47.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44ee59c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f44f015f780 0x7f44f00d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44eed9d640 1 -- 172.21.15.77:0/1166837143 learned_addr learned my addr 172.21.15.77:0/1166837143 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:47.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44edd9b640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d3d60 0x7f44f00cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44ee59c640 1 -- 172.21.15.77:0/1166837143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d3d60 msgr2=0x7f44f00cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:47.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.049+0000 7f44ee59c640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d3d60 0x7f44f00cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.050+0000 7f44ee59c640 1 -- 172.21.15.77:0/1166837143 >> v1:172.21.15.77:6789/0 conn(0x7f44f00d0300 legacy=0x7f44f00d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.050+0000 7f44ee59c640 1 -- 172.21.15.77:0/1166837143 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f00d0ed0 con 0x7f44f015f780 2024-05-15T19:04:47.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.050+0000 7f44edd9b640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d3d60 0x7f44f00cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:47.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.051+0000 7f44ee59c640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f015f780 0x7f44f00d3820 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f44e00097a0 tx=0x7f44e002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71e96e2d61133d server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.052+0000 7f44ed59a640 1 -- 172.21.15.77:0/1166837143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0037070 con 0x7f44f015f780 2024-05-15T19:04:47.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.052+0000 7f44ed59a640 1 -- 172.21.15.77:0/1166837143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e002ae50 con 0x7f44f015f780 2024-05-15T19:04:47.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.052+0000 7f44ed59a640 1 -- 172.21.15.77:0/1166837143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0032660 con 0x7f44f015f780 2024-05-15T19:04:47.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.053+0000 7f44f4fb6640 1 -- 172.21.15.77:0/1166837143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f015f780 msgr2=0x7f44f00d3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.053+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f015f780 0x7f44f00d3820 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f44e00097a0 tx=0x7f44e002a100 comp rx=0 tx=0).stop 2024-05-15T19:04:47.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.054+0000 7f44f4fb6640 1 -- 172.21.15.77:0/1166837143 shutdown_connections 2024-05-15T19:04:47.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.054+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d3d60 0x7f44f00cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.054+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/1166837143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f015f780 0x7f44f00d3820 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.054+0000 7f44f4fb6640 1 -- 172.21.15.77:0/1166837143 >> 172.21.15.77:0/1166837143 conn(0x7f44f009e510 msgr2=0x7f44f00d5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:47.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.054+0000 7f44f4fb6640 1 -- 172.21.15.77:0/1166837143 shutdown_connections 2024-05-15T19:04:47.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.054+0000 7f44f4fb6640 1 -- 172.21.15.77:0/1166837143 wait complete. 2024-05-15T19:04:47.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.057+0000 7f44f4fb6640 1 Processor -- start 2024-05-15T19:04:47.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.058+0000 7f44f4fb6640 1 -- start start 2024-05-15T19:04:47.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44f4fb6640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d0300 0x7f44f01f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44f4fb6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 0x7f44f00b7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44f4fb6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f015f780 0x7f44f01f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44f4fb6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00d0790 con 0x7f44f00d3d60 2024-05-15T19:04:47.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44f4fb6640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f44f00b4f80 con 0x7f44f015f780 2024-05-15T19:04:47.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44f4fb6640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f44f00d0910 con 0x7f44f00d0300 2024-05-15T19:04:47.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44edd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 0x7f44f00b7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44edd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 0x7f44f00b7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59668/0 (socket says 172.21.15.77:59668) 2024-05-15T19:04:47.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44edd9b640 1 -- 172.21.15.77:0/4025321561 learned_addr learned my addr 172.21.15.77:0/4025321561 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:47.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44ee59c640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d0300 0x7f44f01f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.060+0000 7f44eed9d640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f015f780 0x7f44f01f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44ee59c640 1 -- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f015f780 msgr2=0x7f44f01f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44ee59c640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f015f780 0x7f44f01f53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44ee59c640 1 -- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 msgr2=0x7f44f00b7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44ee59c640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 0x7f44f00b7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44ee59c640 1 -- 172.21.15.77:0/4025321561 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44f00b85c0 con 0x7f44f00d0300 2024-05-15T19:04:47.066 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44edd9b640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 0x7f44f00b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44eed9d640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f015f780 0x7f44f01f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44ee59c640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d0300 0x7f44f01f9cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f44e0031000 tx=0x7f44e00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0041030 con 0x7f44f00d0300 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.061+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44e002ac50 con 0x7f44f00d0300 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.062+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44e0037040 con 0x7f44f00d0300 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.062+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44f00b88a0 con 0x7f44f00d0300 2024-05-15T19:04:47.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.062+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f44f01f58e0 con 0x7f44f00d0300 2024-05-15T19:04:47.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.064+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44f00768e0 con 0x7f44f00d0300 2024-05-15T19:04:47.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.066+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f44e0044070 con 0x7f44f00d0300 2024-05-15T19:04:47.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.067+0000 7f44deffd640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f44d00762d0 0x7f44d0078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.067+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f44e002ae00 con 0x7f44f00d0300 2024-05-15T19:04:47.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.067+0000 7f44edd9b640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f44d00762d0 0x7f44d0078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.068+0000 7f44edd9b640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f44d00762d0 0x7f44d0078790 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f44f00cc160 tx=0x7f44e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.072+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f44e004b070 con 0x7f44f00d0300 2024-05-15T19:04:47.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.634+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f44f00b8360 con 0x7f44d00762d0 2024-05-15T19:04:47.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.634+0000 7f44deffd640 1 -- 172.21.15.77:0/4025321561 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f44e4004020 con 0x7f44d00762d0 2024-05-15T19:04:47.638 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 2 to deep-scrub 2024-05-15T19:04:47.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.638+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f44d00762d0 msgr2=0x7f44d0078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.638+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f44d00762d0 0x7f44d0078790 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f44f00cc160 tx=0x7f44e4009190 comp rx=0 tx=0).stop 2024-05-15T19:04:47.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d0300 msgr2=0x7f44f01f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d0300 0x7f44f01f9cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f44e0031000 tx=0x7f44e00046c0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 shutdown_connections 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f44d00762d0 0x7f44d0078790 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f44f015f780 0x7f44f01f53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44f00d3d60 0x7f44f00b7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 --2- 172.21.15.77:0/4025321561 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f44f00d0300 0x7f44f01f9cc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 >> 172.21.15.77:0/4025321561 conn(0x7f44f009e510 msgr2=0x7f44f00d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 shutdown_connections 2024-05-15T19:04:47.643 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.639+0000 7f44f4fb6640 1 -- 172.21.15.77:0/4025321561 wait complete. 2024-05-15T19:04:47.669 INFO:tasks.ceph:Scrubbing osd.3 2024-05-15T19:04:47.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:47.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.950+0000 7f925edc1640 1 Processor -- start 2024-05-15T19:04:47.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.950+0000 7f925edc1640 1 -- start start 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.952+0000 7f925edc1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f92580b1560 0x7f92580b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.952+0000 7f925edc1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92580b5040 con 0x7f92580b1120 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.952+0000 7f925edc1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92580b5320 con 0x7f92580b64a0 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.952+0000 7f925edc1640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f92580b5600 con 0x7f92580b1560 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f925cb5d640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f92580b64a0 0x7f92580b6880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:58576/0 (socket says 172.21.15.77:58576) 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f925cb5d640 1 -- 172.21.15.77:0/199325458 learned_addr learned my addr 172.21.15.77:0/199325458 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:47.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f924ffff640 1 --1- 172.21.15.77:0/199325458 >> v1:172.21.15.77:6789/0 conn(0x7f92580b1120 0x7f92580af920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40772/0 (socket says 172.21.15.77:40772) 2024-05-15T19:04:47.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f925d35e640 1 --2- 172.21.15.77:0/199325458 >> v2:172.21.15.83:3300/0 conn(0x7f92580b1560 0x7f92580b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f924f7fe640 1 -- 172.21.15.77:0/199325458 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623902939 0 0) 0x7f92580b5320 con 0x7f92580b64a0 2024-05-15T19:04:47.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f925d35e640 1 -- 172.21.15.77:0/199325458 >> v1:172.21.15.83:6789/0 conn(0x7f92580b64a0 legacy=0x7f92580b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f925d35e640 1 -- 172.21.15.77:0/199325458 >> v1:172.21.15.77:6789/0 conn(0x7f92580b1120 legacy=0x7f92580af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.953+0000 7f925d35e640 1 -- 172.21.15.77:0/199325458 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92580b58e0 con 0x7f92580b1560 2024-05-15T19:04:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.955+0000 7f925d35e640 1 --2- 172.21.15.77:0/199325458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b1560 0x7f92580b0030 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9250009d90 tx=0x7f925002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=635dd5a6bd75a3cc server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.956+0000 7f924f7fe640 1 -- 172.21.15.77:0/199325458 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250007740 con 0x7f92580b1560 2024-05-15T19:04:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.956+0000 7f924f7fe640 1 -- 172.21.15.77:0/199325458 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92500078e0 con 0x7f92580b1560 2024-05-15T19:04:47.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.956+0000 7f924f7fe640 1 -- 172.21.15.77:0/199325458 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9250007cb0 con 0x7f92580b1560 2024-05-15T19:04:47.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 -- 172.21.15.77:0/199325458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b1560 msgr2=0x7f92580b0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 --2- 172.21.15.77:0/199325458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b1560 0x7f92580b0030 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f9250009d90 tx=0x7f925002a5f0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 -- 172.21.15.77:0/199325458 shutdown_connections 2024-05-15T19:04:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 --2- 172.21.15.77:0/199325458 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b1560 0x7f92580b0030 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 -- 172.21.15.77:0/199325458 >> 172.21.15.77:0/199325458 conn(0x7f92580b3ca0 msgr2=0x7f92580b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 -- 172.21.15.77:0/199325458 shutdown_connections 2024-05-15T19:04:47.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.957+0000 7f925edc1640 1 -- 172.21.15.77:0/199325458 wait complete. 2024-05-15T19:04:47.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.961+0000 7f925edc1640 1 Processor -- start 2024-05-15T19:04:47.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.961+0000 7f925edc1640 1 -- start start 2024-05-15T19:04:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.963+0000 7f925edc1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92580b1120 0x7f92580cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.963+0000 7f925edc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92580b1560 0x7f9258161570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.963+0000 7f925edc1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b64a0 0x7f9258156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.963+0000 7f925edc1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f92580746c0 con 0x7f92580b1560 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.963+0000 7f925edc1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9258074540 con 0x7f92580b64a0 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.963+0000 7f925edc1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f925815f6d0 con 0x7f92580b1120 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f924ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92580b1560 0x7f9258161570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925d35e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b64a0 0x7f9258156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925cb5d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92580b1120 0x7f92580cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f924ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92580b1560 0x7f9258161570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59682/0 (socket says 172.21.15.77:59682) 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925d35e640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b64a0 0x7f9258156830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:34284/0 (socket says 172.21.15.77:34284) 2024-05-15T19:04:47.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f924ffff640 1 -- 172.21.15.77:0/816324326 learned_addr learned my addr 172.21.15.77:0/816324326 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925cb5d640 1 -- 172.21.15.77:0/816324326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b64a0 msgr2=0x7f9258156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925cb5d640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b64a0 0x7f9258156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925cb5d640 1 -- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92580b1560 msgr2=0x7f9258161570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925cb5d640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92580b1560 0x7f9258161570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925cb5d640 1 -- 172.21.15.77:0/816324326 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925814bd50 con 0x7f92580b1120 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.964+0000 7f925d35e640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f92580b64a0 0x7f9258156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.965+0000 7f925cb5d640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92580b1120 0x7f92580cfd10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f925400c3c0 tx=0x7f925400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.965+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92540074e0 con 0x7f92580b1120 2024-05-15T19:04:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.965+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92540047e0 con 0x7f92580b1120 2024-05-15T19:04:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.965+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254004bd0 con 0x7f92580b1120 2024-05-15T19:04:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.965+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92580cec70 con 0x7f92580b1120 2024-05-15T19:04:47.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.965+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92580cf230 con 0x7f92580b1120 2024-05-15T19:04:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.967+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92580694d0 con 0x7f92580b1120 2024-05-15T19:04:47.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.968+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9254011070 con 0x7f92580b1120 2024-05-15T19:04:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.969+0000 7f924d7fa640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f92440762d0 0x7f9244078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.969+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9254096ce0 con 0x7f92580b1120 2024-05-15T19:04:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.969+0000 7f924d7fa640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7f924407c190 0x7f924407e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:47.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.969+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 --> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f924407ec60 con 0x7f924407c190 2024-05-15T19:04:47.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.969+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f9254099300 con 0x7f92580b1120 2024-05-15T19:04:47.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.969+0000 7f924ffff640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f92440762d0 0x7f9244078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.970+0000 7f925d35e640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7f924407c190 0x7f924407e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:47.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.970+0000 7f925d35e640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7f924407c190 0x7f924407e5b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.970+0000 7f924ffff640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f92440762d0 0x7f9244078790 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9258156030 tx=0x7f9248000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:47.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:47.971+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== osd.3 v2:172.21.15.77:6824/2819431659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f924407ec60 con 0x7f924407c190 2024-05-15T19:04:48.013 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.010+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 --> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f925806cff0 con 0x7f924407c190 2024-05-15T19:04:48.014 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.010+0000 7f924d7fa640 1 -- 172.21.15.77:0/816324326 <== osd.3 v2:172.21.15.77:6824/2819431659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f925806cff0 con 0x7f924407c190 2024-05-15T19:04:48.014 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:48.014 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:48.014 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.011+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7f924407c190 msgr2=0x7f924407e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.011+0000 7f925edc1640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6824/2819431659,v1:172.21.15.77:6825/2819431659] conn(0x7f924407c190 0x7f924407e5b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.015 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.011+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f92440762d0 msgr2=0x7f9244078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.011+0000 7f925edc1640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f92440762d0 0x7f9244078790 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9258156030 tx=0x7f9248000ed0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92580b1120 msgr2=0x7f92580cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925edc1640 1 --2- 172.21.15.77:0/816324326 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f92580b1120 0x7f92580cfd10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f925400c3c0 tx=0x7f925400c880 comp rx=0 tx=0).stop 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925d35e640 1 -- 172.21.15.77:0/816324326 reap_dead start 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 shutdown_connections 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 >> 172.21.15.77:0/816324326 conn(0x7f92580b3ca0 msgr2=0x7f9258073330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 shutdown_connections 2024-05-15T19:04:48.016 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.012+0000 7f925edc1640 1 -- 172.21.15.77:0/816324326 wait complete. 2024-05-15T19:04:48.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-15T19:04:48.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.307+0000 7f3f47a72640 1 Processor -- start 2024-05-15T19:04:48.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.308+0000 7f3f47a72640 1 -- start start 2024-05-15T19:04:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f47a72640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1d60 0x7f3f400b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f47a72640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f400ceb00 con 0x7f3f400d0b90 2024-05-15T19:04:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f47a72640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f400cede0 con 0x7f3f400d1270 2024-05-15T19:04:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f47a72640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f3f400b2560 con 0x7f3f400d1d60 2024-05-15T19:04:48.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4500d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3f400d0b90 0x7f3f400b2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40786/0 (socket says 172.21.15.77:40786) 2024-05-15T19:04:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4500d640 1 -- 172.21.15.77:0/3756374854 learned_addr learned my addr 172.21.15.77:0/3756374854 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:48.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4600f640 1 --2- 172.21.15.77:0/3756374854 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1d60 0x7f3f400b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347351839 0 0) 0x7f3f400cede0 con 0x7f3f400d1270 2024-05-15T19:04:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f2c003520 con 0x7f3f400d1270 2024-05-15T19:04:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232088488 0 0) 0x7f3f400ceb00 con 0x7f3f400d0b90 2024-05-15T19:04:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.311+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f400cede0 con 0x7f3f400d0b90 2024-05-15T19:04:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.312+0000 7f3f4600f640 1 -- 172.21.15.77:0/3756374854 >> v1:172.21.15.83:6789/0 conn(0x7f3f400d1270 legacy=0x7f3f400d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.312+0000 7f3f4600f640 1 -- 172.21.15.77:0/3756374854 >> v1:172.21.15.77:6789/0 conn(0x7f3f400d0b90 legacy=0x7f3f400b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.312+0000 7f3f4600f640 1 -- 172.21.15.77:0/3756374854 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f400b2840 con 0x7f3f400d1d60 2024-05-15T19:04:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.314+0000 7f3f4600f640 1 --2- 172.21.15.77:0/3756374854 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1d60 0x7f3f400b3470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009dc0 tx=0x7f3f3802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e724b07216e9162f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:48.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.314+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38007740 con 0x7f3f400d1d60 2024-05-15T19:04:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.314+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f380078e0 con 0x7f3f400d1d60 2024-05-15T19:04:48.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.314+0000 7f3f4480c640 1 -- 172.21.15.77:0/3756374854 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f38007cb0 con 0x7f3f400d1d60 2024-05-15T19:04:48.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 -- 172.21.15.77:0/3756374854 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1d60 msgr2=0x7f3f400b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 --2- 172.21.15.77:0/3756374854 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1d60 0x7f3f400b3470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009dc0 tx=0x7f3f3802a6d0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 -- 172.21.15.77:0/3756374854 shutdown_connections 2024-05-15T19:04:48.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 --2- 172.21.15.77:0/3756374854 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1d60 0x7f3f400b3470 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 -- 172.21.15.77:0/3756374854 >> 172.21.15.77:0/3756374854 conn(0x7f3f400d2fc0 msgr2=0x7f3f400d33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:48.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 -- 172.21.15.77:0/3756374854 shutdown_connections 2024-05-15T19:04:48.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.316+0000 7f3f47a72640 1 -- 172.21.15.77:0/3756374854 wait complete. 2024-05-15T19:04:48.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.319+0000 7f3f47a72640 1 Processor -- start 2024-05-15T19:04:48.322 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.319+0000 7f3f47a72640 1 -- start start 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.321+0000 7f3f47a72640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f400d0b90 0x7f3f401552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.321+0000 7f3f47a72640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 0x7f3f400b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.321+0000 7f3f47a72640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f400d1d60 0x7f3f40070b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.321+0000 7f3f47a72640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400b3b30 con 0x7f3f400d0b90 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.321+0000 7f3f47a72640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f3f400b39b0 con 0x7f3f400d1d60 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.321+0000 7f3f47a72640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f3f400b3cb0 con 0x7f3f400d1270 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 0x7f3f400b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4580e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f400d0b90 0x7f3f401552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:48.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 0x7f3f400b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:40110/0 (socket says 172.21.15.77:40110) 2024-05-15T19:04:48.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 -- 172.21.15.77:0/1187029412 learned_addr learned my addr 172.21.15.77:0/1187029412 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:48.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4600f640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f400d1d60 0x7f3f40070b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 -- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f400d1d60 msgr2=0x7f3f40070b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f400d1d60 0x7f3f40070b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 -- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f400d0b90 msgr2=0x7f3f401552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f400d0b90 0x7f3f401552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 -- 172.21.15.77:0/1187029412 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f400b5240 con 0x7f3f400d1270 2024-05-15T19:04:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.322+0000 7f3f4500d640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 0x7f3f400b4780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c500 tx=0x7f3f3000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.323+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30017070 con 0x7f3f400d1270 2024-05-15T19:04:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.323+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30005ce0 con 0x7f3f400d1270 2024-05-15T19:04:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.323+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30007270 con 0x7f3f400d1270 2024-05-15T19:04:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.323+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f400b5520 con 0x7f3f400d1270 2024-05-15T19:04:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.323+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f400b5ae0 con 0x7f3f400d1270 2024-05-15T19:04:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.325+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f3001a070 con 0x7f3f400d1270 2024-05-15T19:04:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.325+0000 7f3f367fc640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f3f240762d0 0x7f3f24078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.325+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f3f30096550 con 0x7f3f400d1270 2024-05-15T19:04:48.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.325+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f400768e0 con 0x7f3f400d1270 2024-05-15T19:04:48.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.325+0000 7f3f4580e640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f3f240762d0 0x7f3f24078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:48.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.326+0000 7f3f4580e640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f3f240762d0 0x7f3f24078790 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c007fd0 tx=0x7f3f3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:48.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.331+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f3005fbf0 con 0x7f3f400d1270 2024-05-15T19:04:48.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:04:48.603 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:04:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.888+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f3f400d0630 con 0x7f3f240762d0 2024-05-15T19:04:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.888+0000 7f3f367fc640 1 -- 172.21.15.77:0/1187029412 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3f400d0630 con 0x7f3f240762d0 2024-05-15T19:04:48.891 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 3 to deep-scrub 2024-05-15T19:04:48.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.892+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f3f240762d0 msgr2=0x7f3f24078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.892+0000 7f3f47a72640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f3f240762d0 0x7f3f24078790 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c007fd0 tx=0x7f3f3c009040 comp rx=0 tx=0).stop 2024-05-15T19:04:48.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 msgr2=0x7f3f400b4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:48.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 0x7f3f400b4780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c500 tx=0x7f3f3000c9c0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 shutdown_connections 2024-05-15T19:04:48.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f3f240762d0 0x7f3f24078790 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f3f400d1270 0x7f3f400b4780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f3f400d1d60 0x7f3f40070b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 --2- 172.21.15.77:0/1187029412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f400d0b90 0x7f3f401552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 >> 172.21.15.77:0/1187029412 conn(0x7f3f400d2fc0 msgr2=0x7f3f400c8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 shutdown_connections 2024-05-15T19:04:48.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:48.893+0000 7f3f47a72640 1 -- 172.21.15.77:0/1187029412 wait complete. 2024-05-15T19:04:48.922 INFO:tasks.ceph:Scrubbing osd.4 2024-05-15T19:04:48.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:49.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.209+0000 7f5c841f7640 1 Processor -- start 2024-05-15T19:04:49.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.210+0000 7f5c841f7640 1 -- start start 2024-05-15T19:04:49.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c841f7640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c7c0d10c0 0x7f5c7c16a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c841f7640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c7c0b55d0 con 0x7f5c7c0b5100 2024-05-15T19:04:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c841f7640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c7c0b58b0 con 0x7f5c7c15f440 2024-05-15T19:04:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c841f7640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5c7c0d30e0 con 0x7f5c7c0d10c0 2024-05-15T19:04:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c81792640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5c7c0b5100 0x7f5c7c0d4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40794/0 (socket says 172.21.15.77:40794) 2024-05-15T19:04:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c81792640 1 -- 172.21.15.77:0/2158080148 learned_addr learned my addr 172.21.15.77:0/2158080148 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:49.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.212+0000 7f5c82794640 1 --2- 172.21.15.77:0/2158080148 >> v2:172.21.15.77:3300/0 conn(0x7f5c7c0d10c0 0x7f5c7c16a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266447793 0 0) 0x7f5c7c0b55d0 con 0x7f5c7c0b5100 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c68003520 con 0x7f5c7c0b5100 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094706926 0 0) 0x7f5c7c0b58b0 con 0x7f5c7c15f440 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 --> v1:172.21.15.83:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c7c0b55d0 con 0x7f5c7c15f440 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c82794640 1 -- 172.21.15.77:0/2158080148 >> v1:172.21.15.83:6789/0 conn(0x7f5c7c15f440 legacy=0x7f5c7c0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c82794640 1 -- 172.21.15.77:0/2158080148 >> v1:172.21.15.77:6789/0 conn(0x7f5c7c0b5100 legacy=0x7f5c7c0d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.213+0000 7f5c82794640 1 -- 172.21.15.77:0/2158080148 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c0b5b90 con 0x7f5c7c0d10c0 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.214+0000 7f5c82794640 1 --2- 172.21.15.77:0/2158080148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c0d10c0 0x7f5c7c16a000 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009d90 tx=0x7f5c7402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ad8a1c11d8a52b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.214+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74031600 con 0x7f5c7c0d10c0 2024-05-15T19:04:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.214+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c740317a0 con 0x7f5c7c0d10c0 2024-05-15T19:04:49.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.214+0000 7f5c80f91640 1 -- 172.21.15.77:0/2158080148 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c74031b70 con 0x7f5c7c0d10c0 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 -- 172.21.15.77:0/2158080148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c0d10c0 msgr2=0x7f5c7c16a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 --2- 172.21.15.77:0/2158080148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c0d10c0 0x7f5c7c16a000 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009d90 tx=0x7f5c7402a5d0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 -- 172.21.15.77:0/2158080148 shutdown_connections 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 --2- 172.21.15.77:0/2158080148 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c0d10c0 0x7f5c7c16a000 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 -- 172.21.15.77:0/2158080148 >> 172.21.15.77:0/2158080148 conn(0x7f5c7c08ebb0 msgr2=0x7f5c7c09e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 -- 172.21.15.77:0/2158080148 shutdown_connections 2024-05-15T19:04:49.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.216+0000 7f5c841f7640 1 -- 172.21.15.77:0/2158080148 wait complete. 2024-05-15T19:04:49.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.219+0000 7f5c841f7640 1 Processor -- start 2024-05-15T19:04:49.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.219+0000 7f5c841f7640 1 -- start start 2024-05-15T19:04:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.221+0000 7f5c841f7640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c7c0b5100 0x7f5c7c1f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.221+0000 7f5c841f7640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c7c0d10c0 0x7f5c7c0ba870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.221+0000 7f5c841f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c15f440 0x7f5c7c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c841f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c0d55a0 con 0x7f5c7c15f440 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c841f7640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7c15f820 con 0x7f5c7c0b5100 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c841f7640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7c0d5720 con 0x7f5c7c0d10c0 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c82794640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c15f440 0x7f5c7c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c81f93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c7c0b5100 0x7f5c7c1f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c81792640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c7c0d10c0 0x7f5c7c0ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c81f93640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c7c0b5100 0x7f5c7c1f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:34306/0 (socket says 172.21.15.77:34306) 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c82794640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c15f440 0x7f5c7c153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59700/0 (socket says 172.21.15.77:59700) 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c81792640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c7c0d10c0 0x7f5c7c0ba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:40116/0 (socket says 172.21.15.77:40116) 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c81f93640 1 -- 172.21.15.77:0/2760437823 learned_addr learned my addr 172.21.15.77:0/2760437823 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.222+0000 7f5c81f93640 1 -- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c7c0d10c0 msgr2=0x7f5c7c0ba870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c81f93640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c7c0d10c0 0x7f5c7c0ba870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c81f93640 1 -- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c15f440 msgr2=0x7f5c7c153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c81f93640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c7c15f440 0x7f5c7c153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c81f93640 1 -- 172.21.15.77:0/2760437823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7c0badb0 con 0x7f5c7c0b5100 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c81792640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5c7c0d10c0 0x7f5c7c0ba870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c81f93640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c7c0b5100 0x7f5c7c1f8f60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c430 tx=0x7f5c7800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78017070 con 0x7f5c7c0b5100 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c780052f0 con 0x7f5c7c0b5100 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c78003830 con 0x7f5c7c0b5100 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7c0b7eb0 con 0x7f5c7c0b5100 2024-05-15T19:04:49.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.223+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c7c159940 con 0x7f5c7c0b5100 2024-05-15T19:04:49.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.225+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5c7c06a640 con 0x7f5c7c0b5100 2024-05-15T19:04:49.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.227+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5c7801a070 con 0x7f5c7c0b5100 2024-05-15T19:04:49.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.227+0000 7f5c727fc640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5c600762d0 0x7f5c60078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.228+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5c78096680 con 0x7f5c7c0b5100 2024-05-15T19:04:49.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.228+0000 7f5c727fc640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7f5c6007c190 0x7f5c6007e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.228+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 --> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c780054a0 con 0x7f5c6007c190 2024-05-15T19:04:49.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.228+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f5c7809d050 con 0x7f5c7c0b5100 2024-05-15T19:04:49.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.228+0000 7f5c81792640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5c600762d0 0x7f5c60078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.228+0000 7f5c82794640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7f5c6007c190 0x7f5c6007e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.229+0000 7f5c81792640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5c600762d0 0x7f5c60078790 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c000c00 tx=0x7f5c6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.229+0000 7f5c82794640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7f5c6007c190 0x7f5c6007e5b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.230+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== osd.4 v2:172.21.15.83:6800/675760629 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c780054a0 con 0x7f5c6007c190 2024-05-15T19:04:49.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.244+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 --> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5c7c06d300 con 0x7f5c6007c190 2024-05-15T19:04:49.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.244+0000 7f5c727fc640 1 -- 172.21.15.77:0/2760437823 <== osd.4 v2:172.21.15.83:6800/675760629 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5c7c06d300 con 0x7f5c6007c190 2024-05-15T19:04:49.248 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:49.248 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:49.248 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:49.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7f5c6007c190 msgr2=0x7f5c6007e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:6800/675760629,v1:172.21.15.83:6801/675760629] conn(0x7f5c6007c190 0x7f5c6007e5b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5c600762d0 msgr2=0x7f5c60078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5c600762d0 0x7f5c60078790 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c000c00 tx=0x7f5c6c009040 comp rx=0 tx=0).stop 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c7c0b5100 msgr2=0x7f5c7c1f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 --2- 172.21.15.77:0/2760437823 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5c7c0b5100 0x7f5c7c1f8f60 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800c430 tx=0x7f5c7800c8f0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c82794640 1 -- 172.21.15.77:0/2760437823 reap_dead start 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 shutdown_connections 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 >> 172.21.15.77:0/2760437823 conn(0x7f5c7c08ebb0 msgr2=0x7f5c7c06d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:49.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 shutdown_connections 2024-05-15T19:04:49.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.245+0000 7f5c841f7640 1 -- 172.21.15.77:0/2760437823 wait complete. 2024-05-15T19:04:49.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-15T19:04:49.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.533+0000 7fcbdca1d640 1 Processor -- start 2024-05-15T19:04:49.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.534+0000 7fcbdca1d640 1 -- start start 2024-05-15T19:04:49.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.536+0000 7fcbdca1d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcbd813ef60 0x7fcbd8073330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.536+0000 7fcbdca1d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcbd815ce20 0x7fcbd80d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.536+0000 7fcbdca1d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbd813f340 con 0x7fcbd8073870 2024-05-15T19:04:49.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.536+0000 7fcbdca1d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd8073cb0 con 0x7fcbd813ef60 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.536+0000 7fcbdca1d640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7fcbd8141840 con 0x7fcbd815ce20 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcbd813ef60 0x7fcbd8073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd5d9b640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fcbd8073870 0x7fcbd815c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40806/0 (socket says 172.21.15.77:40806) 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd6d9d640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7fcbd815ce20 0x7fcbd80d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd5d9b640 1 -- 172.21.15.77:0/3153060369 learned_addr learned my addr 172.21.15.77:0/3153060369 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd559a640 1 -- 172.21.15.77:0/3153060369 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781905489 0 0) 0x7fcbd813f340 con 0x7fcbd8073870 2024-05-15T19:04:49.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd6d9d640 1 -- 172.21.15.77:0/3153060369 >> v2:172.21.15.77:3300/0 conn(0x7fcbd813ef60 msgr2=0x7fcbd8073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:49.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd6d9d640 1 --2- 172.21.15.77:0/3153060369 >> v2:172.21.15.77:3300/0 conn(0x7fcbd813ef60 0x7fcbd8073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd6d9d640 1 -- 172.21.15.77:0/3153060369 >> v1:172.21.15.77:6789/0 conn(0x7fcbd8073870 legacy=0x7fcbd815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.537+0000 7fcbd6d9d640 1 -- 172.21.15.77:0/3153060369 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd8141b20 con 0x7fcbd815ce20 2024-05-15T19:04:49.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.539+0000 7fcbd6d9d640 1 --2- 172.21.15.77:0/3153060369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd80d08d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80d06a0 tx=0x7fcbd002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc801683a88f2ec4 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.539+0000 7fcbd559a640 1 -- 172.21.15.77:0/3153060369 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0007740 con 0x7fcbd815ce20 2024-05-15T19:04:49.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.540+0000 7fcbd559a640 1 -- 172.21.15.77:0/3153060369 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbd00078e0 con 0x7fcbd815ce20 2024-05-15T19:04:49.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.540+0000 7fcbd559a640 1 -- 172.21.15.77:0/3153060369 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0007cb0 con 0x7fcbd815ce20 2024-05-15T19:04:49.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3153060369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 msgr2=0x7fcbd80d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3153060369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd80d08d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80d06a0 tx=0x7fcbd002a680 comp rx=0 tx=0).stop 2024-05-15T19:04:49.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3153060369 shutdown_connections 2024-05-15T19:04:49.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3153060369 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd80d08d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3153060369 >> v2:172.21.15.77:3300/0 conn(0x7fcbd813ef60 0x7fcbd8073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3153060369 >> 172.21.15.77:0/3153060369 conn(0x7fcbd80b3d10 msgr2=0x7fcbd80b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:49.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3153060369 shutdown_connections 2024-05-15T19:04:49.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.541+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3153060369 wait complete. 2024-05-15T19:04:49.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.545+0000 7fcbdca1d640 1 Processor -- start 2024-05-15T19:04:49.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.545+0000 7fcbdca1d640 1 -- start start 2024-05-15T19:04:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbdca1d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 0x7fcbd8149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbdca1d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbd813ef60 0x7fcbd815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbdca1d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd8158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbdca1d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd80d0e10 con 0x7fcbd8073870 2024-05-15T19:04:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbdca1d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd81420e0 con 0x7fcbd815ce20 2024-05-15T19:04:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbdca1d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fcbd80d0f90 con 0x7fcbd813ef60 2024-05-15T19:04:49.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbd659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 0x7fcbd8149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbd659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 0x7fcbd8149ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59724/0 (socket says 172.21.15.77:59724) 2024-05-15T19:04:49.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbd659c640 1 -- 172.21.15.77:0/3762003505 learned_addr learned my addr 172.21.15.77:0/3762003505 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:49.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbd5d9b640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbd813ef60 0x7fcbd815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.547+0000 7fcbd6d9d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd8158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbd659c640 1 -- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbd813ef60 msgr2=0x7fcbd815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbd659c640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbd813ef60 0x7fcbd815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbd659c640 1 -- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 msgr2=0x7fcbd8158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbd659c640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd8158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbd659c640 1 -- 172.21.15.77:0/3762003505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd8157ae0 con 0x7fcbd8073870 2024-05-15T19:04:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbd659c640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 0x7fcbd8149ec0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800e9e0 tx=0x7fcbc800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.548+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc8017070 con 0x7fcbd8073870 2024-05-15T19:04:49.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.549+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd8157dc0 con 0x7fcbd8073870 2024-05-15T19:04:49.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.549+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbc800c9d0 con 0x7fcbd8073870 2024-05-15T19:04:49.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.549+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc800cdc0 con 0x7fcbd8073870 2024-05-15T19:04:49.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.549+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd815a280 con 0x7fcbd8073870 2024-05-15T19:04:49.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.550+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd80768e0 con 0x7fcbd8073870 2024-05-15T19:04:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.553+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcbc801a070 con 0x7fcbd8073870 2024-05-15T19:04:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.553+0000 7fcbc6ffd640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcbb80762d0 0x7fcbb8078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.553+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fcbc80976a0 con 0x7fcbd8073870 2024-05-15T19:04:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.553+0000 7fcbd5d9b640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcbb80762d0 0x7fcbb8078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:49.562 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.554+0000 7fcbd5d9b640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcbb80762d0 0x7fcbb8078790 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80d0a10 tx=0x7fcbcc007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:49.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:49.566+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcbc8060c30 con 0x7fcbd8073870 2024-05-15T19:04:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.123+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcbd8157f90 con 0x7fcbb80762d0 2024-05-15T19:04:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.124+0000 7fcbc6ffd640 1 -- 172.21.15.77:0/3762003505 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcbd8157f90 con 0x7fcbb80762d0 2024-05-15T19:04:50.127 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 4 to deep-scrub 2024-05-15T19:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.128+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcbb80762d0 msgr2=0x7fcbb8078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.128+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcbb80762d0 0x7fcbb8078790 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80d0a10 tx=0x7fcbcc007cf0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.128+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 msgr2=0x7fcbd8149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 0x7fcbd8149ec0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fcbc800e9e0 tx=0x7fcbc800eea0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 shutdown_connections 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fcbb80762d0 0x7fcbb8078790 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fcbd813ef60 0x7fcbd815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fcbd815ce20 0x7fcbd8158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 --2- 172.21.15.77:0/3762003505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd8073870 0x7fcbd8149ec0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 >> 172.21.15.77:0/3762003505 conn(0x7fcbd80b3d10 msgr2=0x7fcbd815ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 shutdown_connections 2024-05-15T19:04:50.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.129+0000 7fcbdca1d640 1 -- 172.21.15.77:0/3762003505 wait complete. 2024-05-15T19:04:50.151 INFO:tasks.ceph:Scrubbing osd.5 2024-05-15T19:04:50.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:50.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.417+0000 7ff17b514640 1 Processor -- start 2024-05-15T19:04:50.421 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.418+0000 7ff17b514640 1 -- start start 2024-05-15T19:04:50.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff17b514640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740d10c0 0x7ff17416a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff17b514640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1740b55d0 con 0x7ff17415f440 2024-05-15T19:04:50.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff17b514640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1740b58b0 con 0x7ff1740b5100 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff17b514640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740d30e0 con 0x7ff1740d10c0 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff1792b0640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff17415f440 0x7ff1740b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40808/0 (socket says 172.21.15.77:40808) 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff1792b0640 1 -- 172.21.15.77:0/1848716899 learned_addr learned my addr 172.21.15.77:0/1848716899 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff179ab1640 1 --2- 172.21.15.77:0/1848716899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740d10c0 0x7ff17416a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff179ab1640 1 -- 172.21.15.77:0/1848716899 >> v1:172.21.15.83:6789/0 conn(0x7ff1740b5100 legacy=0x7ff1740d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff179ab1640 1 -- 172.21.15.77:0/1848716899 >> v1:172.21.15.77:6789/0 conn(0x7ff17415f440 legacy=0x7ff1740b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.420+0000 7ff179ab1640 1 -- 172.21.15.77:0/1848716899 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1740b5b90 con 0x7ff1740d10c0 2024-05-15T19:04:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.421+0000 7ff179ab1640 1 --2- 172.21.15.77:0/1848716899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740d10c0 0x7ff17416a000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009dc0 tx=0x7ff16c02a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36170ad36d34166b server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.421+0000 7ff16bfff640 1 -- 172.21.15.77:0/1848716899 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c02ae60 con 0x7ff1740d10c0 2024-05-15T19:04:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.421+0000 7ff16bfff640 1 -- 172.21.15.77:0/1848716899 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff16c007740 con 0x7ff1740d10c0 2024-05-15T19:04:50.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.421+0000 7ff16bfff640 1 -- 172.21.15.77:0/1848716899 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c007b10 con 0x7ff1740d10c0 2024-05-15T19:04:50.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 -- 172.21.15.77:0/1848716899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740d10c0 msgr2=0x7ff17416a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 --2- 172.21.15.77:0/1848716899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740d10c0 0x7ff17416a000 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009dc0 tx=0x7ff16c02a640 comp rx=0 tx=0).stop 2024-05-15T19:04:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 -- 172.21.15.77:0/1848716899 shutdown_connections 2024-05-15T19:04:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 --2- 172.21.15.77:0/1848716899 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740d10c0 0x7ff17416a000 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 -- 172.21.15.77:0/1848716899 >> 172.21.15.77:0/1848716899 conn(0x7ff17408ebb0 msgr2=0x7ff17409e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 -- 172.21.15.77:0/1848716899 shutdown_connections 2024-05-15T19:04:50.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.423+0000 7ff17b514640 1 -- 172.21.15.77:0/1848716899 wait complete. 2024-05-15T19:04:50.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.426+0000 7ff17b514640 1 Processor -- start 2024-05-15T19:04:50.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.426+0000 7ff17b514640 1 -- start start 2024-05-15T19:04:50.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff17b514640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740b5100 0x7ff174157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff17b514640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1740d10c0 0x7ff1741563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff17b514640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff17415f440 0x7ff1740b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff17b514640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff1740d55a0 con 0x7ff17415f440 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff17b514640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7ff17415f820 con 0x7ff1740d10c0 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff17b514640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7ff1740d5720 con 0x7ff1740b5100 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff1792b0640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740b5100 0x7ff174157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff1792b0640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740b5100 0x7ff174157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:40140/0 (socket says 172.21.15.77:40140) 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff178aaf640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1740d10c0 0x7ff1741563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff1792b0640 1 -- 172.21.15.77:0/3827283729 learned_addr learned my addr 172.21.15.77:0/3827283729 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff179ab1640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff17415f440 0x7ff1740b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff178aaf640 1 -- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740b5100 msgr2=0x7ff174157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff178aaf640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7ff1740b5100 0x7ff174157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff178aaf640 1 -- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff17415f440 msgr2=0x7ff1740b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff178aaf640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff17415f440 0x7ff1740b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff178aaf640 1 -- 172.21.15.77:0/3827283729 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff174156930 con 0x7ff1740d10c0 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.429+0000 7ff179ab1640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff17415f440 0x7ff1740b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.430+0000 7ff178aaf640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1740d10c0 0x7ff1741563f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c3c0 tx=0x7ff16400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.430+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164017070 con 0x7ff1740d10c0 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.430+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1640052f0 con 0x7ff1740d10c0 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.430+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff174161250 con 0x7ff1740d10c0 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.430+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff164003830 con 0x7ff1740d10c0 2024-05-15T19:04:50.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.430+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff174161810 con 0x7ff1740d10c0 2024-05-15T19:04:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.432+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff16401a070 con 0x7ff1740d10c0 2024-05-15T19:04:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.432+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff17406a640 con 0x7ff1740d10c0 2024-05-15T19:04:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.433+0000 7ff169ffb640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff1580762d0 0x7ff158078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.433+0000 7ff1792b0640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff1580762d0 0x7ff158078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.433+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7ff1640964f0 con 0x7ff1740d10c0 2024-05-15T19:04:50.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.434+0000 7ff169ffb640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7ff15807c190 0x7ff15807e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.434+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 --> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1640054a0 con 0x7ff15807c190 2024-05-15T19:04:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.434+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7ff16409d050 con 0x7ff1740d10c0 2024-05-15T19:04:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.434+0000 7ff1792b0640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff1580762d0 0x7ff158078790 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff170000f60 tx=0x7ff170009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.434+0000 7ff179ab1640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7ff15807c190 0x7ff15807e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.435+0000 7ff179ab1640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7ff15807c190 0x7ff15807e5b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.435+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== osd.5 v2:172.21.15.83:6808/2185384150 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1640054a0 con 0x7ff15807c190 2024-05-15T19:04:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.474+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 --> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff17406d300 con 0x7ff15807c190 2024-05-15T19:04:50.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.474+0000 7ff169ffb640 1 -- 172.21.15.77:0/3827283729 <== osd.5 v2:172.21.15.83:6808/2185384150 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff17406d300 con 0x7ff15807c190 2024-05-15T19:04:50.477 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:50.478 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:50.478 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:50.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7ff15807c190 msgr2=0x7ff15807e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:6808/2185384150,v1:172.21.15.83:6810/2185384150] conn(0x7ff15807c190 0x7ff15807e5b0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff1580762d0 msgr2=0x7ff158078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7ff1580762d0 0x7ff158078790 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff170000f60 tx=0x7ff170009040 comp rx=0 tx=0).stop 2024-05-15T19:04:50.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1740d10c0 msgr2=0x7ff1741563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 --2- 172.21.15.77:0/3827283729 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7ff1740d10c0 0x7ff1741563f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c3c0 tx=0x7ff16400c880 comp rx=0 tx=0).stop 2024-05-15T19:04:50.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff179ab1640 1 -- 172.21.15.77:0/3827283729 reap_dead start 2024-05-15T19:04:50.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 shutdown_connections 2024-05-15T19:04:50.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 >> 172.21.15.77:0/3827283729 conn(0x7ff17408ebb0 msgr2=0x7ff1740b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:50.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.475+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 shutdown_connections 2024-05-15T19:04:50.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.476+0000 7ff17b514640 1 -- 172.21.15.77:0/3827283729 wait complete. 2024-05-15T19:04:50.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-15T19:04:50.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.764+0000 7f0572914640 1 Processor -- start 2024-05-15T19:04:50.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.764+0000 7f0572914640 1 -- start start 2024-05-15T19:04:50.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.765+0000 7f0572914640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f056c0b6180 0x7f056c0cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.769 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.765+0000 7f0572914640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f056c0b2bb0 0x7f056c0b3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.765+0000 7f0572914640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f056c06ece0 con 0x7f056c1636a0 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.765+0000 7f0572914640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f056c072860 con 0x7f056c0b2bb0 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.765+0000 7f0572914640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f056c06efc0 con 0x7f056c0b6180 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f056c0b2bb0 0x7f056c0b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f056c0b2bb0 0x7f056c0b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59746/0 (socket says 172.21.15.77:59746) 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 -- 172.21.15.77:0/1386949155 learned_addr learned my addr 172.21.15.77:0/1386949155 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f05637fe640 1 --2- 172.21.15.77:0/1386949155 >> v2:172.21.15.83:3300/0 conn(0x7f056c0b6180 0x7f056c0cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 -- 172.21.15.77:0/1386949155 >> v2:172.21.15.83:3300/0 conn(0x7f056c0b6180 msgr2=0x7f056c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 --2- 172.21.15.77:0/1386949155 >> v2:172.21.15.83:3300/0 conn(0x7f056c0b6180 0x7f056c0cd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 -- 172.21.15.77:0/1386949155 >> v1:172.21.15.83:6789/0 conn(0x7f056c1636a0 legacy=0x7f056c06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f056b7fe640 1 -- 172.21.15.77:0/1386949155 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497373815 0 0) 0x7f056c06ece0 con 0x7f056c1636a0 2024-05-15T19:04:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f0570eb1640 1 -- 172.21.15.77:0/1386949155 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c06f2a0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.766+0000 7f05637fe640 1 --2- 172.21.15.77:0/1386949155 >> v2:172.21.15.83:3300/0 conn(0x7f056c0b6180 0x7f056c0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.768+0000 7f0570eb1640 1 --2- 172.21.15.77:0/1386949155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c0b3040 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f056c0b54e0 tx=0x7f056402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740d2dec4a518e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.769+0000 7f056b7fe640 1 -- 172.21.15.77:0/1386949155 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0564036070 con 0x7f056c0b2bb0 2024-05-15T19:04:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.769+0000 7f056b7fe640 1 -- 172.21.15.77:0/1386949155 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0564031600 con 0x7f056c0b2bb0 2024-05-15T19:04:50.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.769+0000 7f056b7fe640 1 -- 172.21.15.77:0/1386949155 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05640319d0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.769+0000 7f0572914640 1 -- 172.21.15.77:0/1386949155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 msgr2=0x7f056c0b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.769+0000 7f0572914640 1 --2- 172.21.15.77:0/1386949155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c0b3040 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f056c0b54e0 tx=0x7f056402a6a0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.770+0000 7f0572914640 1 -- 172.21.15.77:0/1386949155 shutdown_connections 2024-05-15T19:04:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.770+0000 7f0572914640 1 --2- 172.21.15.77:0/1386949155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c0b3040 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.770+0000 7f0572914640 1 --2- 172.21.15.77:0/1386949155 >> v2:172.21.15.83:3300/0 conn(0x7f056c0b6180 0x7f056c0cd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.770+0000 7f0572914640 1 -- 172.21.15.77:0/1386949155 >> 172.21.15.77:0/1386949155 conn(0x7f056c06c3f0 msgr2=0x7f056c06c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.770+0000 7f0572914640 1 -- 172.21.15.77:0/1386949155 shutdown_connections 2024-05-15T19:04:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.770+0000 7f0572914640 1 -- 172.21.15.77:0/1386949155 wait complete. 2024-05-15T19:04:50.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.771+0000 7f0572914640 1 Processor -- start 2024-05-15T19:04:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.771+0000 7f0572914640 1 -- start start 2024-05-15T19:04:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.772+0000 7f0572914640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c1fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.772+0000 7f0572914640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f056c0b6180 0x7f056c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.772+0000 7f0572914640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f056c1636a0 0x7f056c0cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.772+0000 7f0572914640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f056c072cf0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.772+0000 7f0572914640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f056c163a80 con 0x7f056c0b6180 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.772+0000 7f0572914640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f056c072e70 con 0x7f056c1636a0 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c1fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c1fd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59756/0 (socket says 172.21.15.77:59756) 2024-05-15T19:04:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f0570eb1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f056c1636a0 0x7f056c0cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 -- 172.21.15.77:0/3384113949 learned_addr learned my addr 172.21.15.77:0/3384113949 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f05637fe640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f056c0b6180 0x7f056c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 -- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f056c1636a0 msgr2=0x7f056c0cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f056c1636a0 0x7f056c0cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 -- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f056c0b6180 msgr2=0x7f056c154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f056c0b6180 0x7f056c154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f056bfff640 1 -- 172.21.15.77:0/3384113949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f056c1669e0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f05637fe640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f056c0b6180 0x7f056c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.773+0000 7f0570eb1640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f056c1636a0 0x7f056c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.774+0000 7f056bfff640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c1fd2b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c3f0 tx=0x7f055c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.774+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c017070 con 0x7f056c0b2bb0 2024-05-15T19:04:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.774+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c0035f0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.774+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c0039e0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.774+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f056c1fa020 con 0x7f056c0b2bb0 2024-05-15T19:04:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.774+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f056c1fc7f0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.777+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f056c0768e0 con 0x7f056c0b2bb0 2024-05-15T19:04:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.778+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f055c01a070 con 0x7f056c0b2bb0 2024-05-15T19:04:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.780+0000 7f05697fa640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f054c0762d0 0x7f054c078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:50.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.780+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f055c096600 con 0x7f056c0b2bb0 2024-05-15T19:04:50.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.780+0000 7f05637fe640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f054c0762d0 0x7f054c078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:50.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.781+0000 7f05637fe640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f054c0762d0 0x7f054c078790 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f056c167140 tx=0x7f0554008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:50.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:50.793+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f055c05fc10 con 0x7f056c0b2bb0 2024-05-15T19:04:51.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.354+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f056c06feb0 con 0x7f054c0762d0 2024-05-15T19:04:51.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.355+0000 7f05697fa640 1 -- 172.21.15.77:0/3384113949 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f056c06feb0 con 0x7f054c0762d0 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 5 to deep-scrub 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f054c0762d0 msgr2=0x7f054c078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f054c0762d0 0x7f054c078790 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f056c167140 tx=0x7f0554008040 comp rx=0 tx=0).stop 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 msgr2=0x7f056c1fd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c1fd2b0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c3f0 tx=0x7f055c00c8b0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 shutdown_connections 2024-05-15T19:04:51.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f054c0762d0 0x7f054c078790 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f056c1636a0 0x7f056c0cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f056c0b6180 0x7f056c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 --2- 172.21.15.77:0/3384113949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f056c0b2bb0 0x7f056c1fd2b0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.359+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 >> 172.21.15.77:0/3384113949 conn(0x7f056c06c3f0 msgr2=0x7f056c0cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.360+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 shutdown_connections 2024-05-15T19:04:51.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.360+0000 7f0572914640 1 -- 172.21.15.77:0/3384113949 wait complete. 2024-05-15T19:04:51.451 INFO:tasks.ceph:Scrubbing osd.6 2024-05-15T19:04:51.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.717+0000 7f9664132640 1 Processor -- start 2024-05-15T19:04:51.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.717+0000 7f9664132640 1 -- start start 2024-05-15T19:04:51.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9664132640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 0x7f965c0b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9664132640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f965c0b4f30 0x7f965c0d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9664132640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965c0b55d0 con 0x7f965c0d53d0 2024-05-15T19:04:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9664132640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f965c0d30e0 con 0x7f965c15f440 2024-05-15T19:04:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9664132640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f965c0b53a0 con 0x7f965c0b4f30 2024-05-15T19:04:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9661ece640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 0x7f965c0b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9661ece640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 0x7f965c0b49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59766/0 (socket says 172.21.15.77:59766) 2024-05-15T19:04:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f96616cd640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f965c0b4f30 0x7f965c0d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.720+0000 7f9661ece640 1 -- 172.21.15.77:0/2639163485 learned_addr learned my addr 172.21.15.77:0/2639163485 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.721+0000 7f96616cd640 1 -- 172.21.15.77:0/2639163485 >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 msgr2=0x7f965c0b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.721+0000 7f96616cd640 1 --2- 172.21.15.77:0/2639163485 >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 0x7f965c0b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.721+0000 7f96616cd640 1 -- 172.21.15.77:0/2639163485 >> v1:172.21.15.83:6789/0 conn(0x7f965c0d53d0 legacy=0x7f965c0d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.721+0000 7f9660ecc640 1 -- 172.21.15.77:0/2639163485 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 724027348 0 0) 0x7f965c0b55d0 con 0x7f965c0d53d0 2024-05-15T19:04:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.721+0000 7f96616cd640 1 -- 172.21.15.77:0/2639163485 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c0b58b0 con 0x7f965c0b4f30 2024-05-15T19:04:51.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.721+0000 7f9661ece640 1 --2- 172.21.15.77:0/2639163485 >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 0x7f965c0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.723+0000 7f96616cd640 1 --2- 172.21.15.77:0/2639163485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0b4f30 0x7f965c0d4e90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f965c08f470 tx=0x7f964c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af2420f31d50a015 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:51.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.723+0000 7f9660ecc640 1 -- 172.21.15.77:0/2639163485 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c037070 con 0x7f965c0b4f30 2024-05-15T19:04:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.723+0000 7f9660ecc640 1 -- 172.21.15.77:0/2639163485 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f964c032440 con 0x7f965c0b4f30 2024-05-15T19:04:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.723+0000 7f9660ecc640 1 -- 172.21.15.77:0/2639163485 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964c02ae60 con 0x7f965c0b4f30 2024-05-15T19:04:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.724+0000 7f9664132640 1 -- 172.21.15.77:0/2639163485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0b4f30 msgr2=0x7f965c0d4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.724+0000 7f9664132640 1 --2- 172.21.15.77:0/2639163485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0b4f30 0x7f965c0d4e90 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f965c08f470 tx=0x7f964c02a110 comp rx=0 tx=0).stop 2024-05-15T19:04:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.724+0000 7f9664132640 1 -- 172.21.15.77:0/2639163485 shutdown_connections 2024-05-15T19:04:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.724+0000 7f9664132640 1 --2- 172.21.15.77:0/2639163485 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0b4f30 0x7f965c0d4e90 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.724+0000 7f9664132640 1 --2- 172.21.15.77:0/2639163485 >> v2:172.21.15.77:3300/0 conn(0x7f965c15f440 0x7f965c0b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.724+0000 7f9664132640 1 -- 172.21.15.77:0/2639163485 >> 172.21.15.77:0/2639163485 conn(0x7f965c08ebb0 msgr2=0x7f965c09e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.725+0000 7f9664132640 1 -- 172.21.15.77:0/2639163485 shutdown_connections 2024-05-15T19:04:51.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.725+0000 7f9664132640 1 -- 172.21.15.77:0/2639163485 wait complete. 2024-05-15T19:04:51.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.728+0000 7f9664132640 1 Processor -- start 2024-05-15T19:04:51.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.728+0000 7f9664132640 1 -- start start 2024-05-15T19:04:51.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9664132640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0b4f30 0x7f965c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9664132640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0d53d0 0x7f965c159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9664132640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f965c15f440 0x7f965c1f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9664132640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0d5820 con 0x7f965c0b4f30 2024-05-15T19:04:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9664132640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f965c0b5e70 con 0x7f965c0d53d0 2024-05-15T19:04:51.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9664132640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f965c15f820 con 0x7f965c15f440 2024-05-15T19:04:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.730+0000 7f9661ece640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0b4f30 0x7f965c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0b4f30 0x7f965c1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59774/0 (socket says 172.21.15.77:59774) 2024-05-15T19:04:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 -- 172.21.15.77:0/2307926252 learned_addr learned my addr 172.21.15.77:0/2307926252 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:51.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f96616cd640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0d53d0 0x7f965c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f96626cf640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f965c15f440 0x7f965c1f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 -- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f965c15f440 msgr2=0x7f965c1f81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f965c15f440 0x7f965c1f81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 -- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0d53d0 msgr2=0x7f965c159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f965c0d53d0 0x7f965c159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 -- 172.21.15.77:0/2307926252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c1572b0 con 0x7f965c0b4f30 2024-05-15T19:04:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.731+0000 7f9661ece640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0b4f30 0x7f965c1555f0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f965800ea00 tx=0x7f965800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.732+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9658017070 con 0x7f965c0b4f30 2024-05-15T19:04:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.732+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c157590 con 0x7f965c0b4f30 2024-05-15T19:04:51.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.732+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965800ca60 con 0x7f965c0b4f30 2024-05-15T19:04:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.732+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965800ce10 con 0x7f965c0b4f30 2024-05-15T19:04:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.732+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c0cd830 con 0x7f965c0b4f30 2024-05-15T19:04:51.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.733+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f965c06a640 con 0x7f965c0b4f30 2024-05-15T19:04:51.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.736+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f965801a070 con 0x7f965c0b4f30 2024-05-15T19:04:51.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.736+0000 7f96527fc640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9640076300 0x7f96400787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.736+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9658097530 con 0x7f965c0b4f30 2024-05-15T19:04:51.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.736+0000 7f96527fc640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7f964007c1c0 0x7f964007e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:51.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.736+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 --> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f964007ec90 con 0x7f964007c1c0 2024-05-15T19:04:51.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.736+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f965809e050 con 0x7f965c0b4f30 2024-05-15T19:04:51.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.737+0000 7f96616cd640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9640076300 0x7f96400787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.737+0000 7f96626cf640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7f964007c1c0 0x7f964007e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:51.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.737+0000 7f96626cf640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7f964007c1c0 0x7f964007e5e0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:51.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.737+0000 7f96616cd640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9640076300 0x7f96400787c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f964c034000 tx=0x7f964c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:51.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.738+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== osd.6 v2:172.21.15.83:6809/151067659 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f964007ec90 con 0x7f964007c1c0 2024-05-15T19:04:51.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.776+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 --> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f965c0d4030 con 0x7f964007c1c0 2024-05-15T19:04:51.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.777+0000 7f96527fc640 1 -- 172.21.15.77:0/2307926252 <== osd.6 v2:172.21.15.83:6809/151067659 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f965c0d4030 con 0x7f964007c1c0 2024-05-15T19:04:51.781 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:51.781 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:51.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.777+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7f964007c1c0 msgr2=0x7f964007e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.777+0000 7f9664132640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.83:6809/151067659,v1:172.21.15.83:6811/151067659] conn(0x7f964007c1c0 0x7f964007e5e0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9640076300 msgr2=0x7f96400787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9640076300 0x7f96400787c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f964c034000 tx=0x7f964c02e000 comp rx=0 tx=0).stop 2024-05-15T19:04:51.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0b4f30 msgr2=0x7f965c1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:51.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 --2- 172.21.15.77:0/2307926252 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f965c0b4f30 0x7f965c1555f0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f965800ea00 tx=0x7f965800eec0 comp rx=0 tx=0).stop 2024-05-15T19:04:51.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f96626cf640 1 -- 172.21.15.77:0/2307926252 reap_dead start 2024-05-15T19:04:51.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 shutdown_connections 2024-05-15T19:04:51.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 >> 172.21.15.77:0/2307926252 conn(0x7f965c08ebb0 msgr2=0x7f965c0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:51.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 shutdown_connections 2024-05-15T19:04:51.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:51.778+0000 7f9664132640 1 -- 172.21.15.77:0/2307926252 wait complete. 2024-05-15T19:04:51.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-15T19:04:52.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.070+0000 7fe57cbc1640 1 Processor -- start 2024-05-15T19:04:52.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.070+0000 7fe57cbc1640 1 -- start start 2024-05-15T19:04:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57cbc1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 0x7fe578073330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57cbc1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe57815ce20 0x7fe5780d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57cbc1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe57813f340 con 0x7fe578073870 2024-05-15T19:04:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57cbc1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7fe578073cb0 con 0x7fe57813ef60 2024-05-15T19:04:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57cbc1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe578141840 con 0x7fe57815ce20 2024-05-15T19:04:52.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 0x7fe578073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe56ffff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe578073870 0x7fe57815c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:40814/0 (socket says 172.21.15.77:40814) 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe56ffff640 1 -- 172.21.15.77:0/2116917841 learned_addr learned my addr 172.21.15.77:0/2116917841 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe57659c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 0x7fe578073330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59784/0 (socket says 172.21.15.77:59784) 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.071+0000 7fe576d9d640 1 --2- 172.21.15.77:0/2116917841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe57815ce20 0x7fe5780d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.072+0000 7fe576d9d640 1 -- 172.21.15.77:0/2116917841 >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 msgr2=0x7fe578073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.072+0000 7fe576d9d640 1 --2- 172.21.15.77:0/2116917841 >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 0x7fe578073330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.072+0000 7fe576d9d640 1 -- 172.21.15.77:0/2116917841 >> v1:172.21.15.77:6789/0 conn(0x7fe578073870 legacy=0x7fe57815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.072+0000 7fe576d9d640 1 -- 172.21.15.77:0/2116917841 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe578141b20 con 0x7fe57815ce20 2024-05-15T19:04:52.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.072+0000 7fe57659c640 1 --2- 172.21.15.77:0/2116917841 >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 0x7fe578073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:52.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.073+0000 7fe576d9d640 1 --2- 172.21.15.77:0/2116917841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe57815ce20 0x7fe5780d08d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe570009d90 tx=0x7fe57002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d13a6573dccf16a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.073+0000 7fe575d9b640 1 -- 172.21.15.77:0/2116917841 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570007740 con 0x7fe57815ce20 2024-05-15T19:04:52.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.073+0000 7fe575d9b640 1 -- 172.21.15.77:0/2116917841 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5700078e0 con 0x7fe57815ce20 2024-05-15T19:04:52.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.073+0000 7fe575d9b640 1 -- 172.21.15.77:0/2116917841 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570007cb0 con 0x7fe57815ce20 2024-05-15T19:04:52.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 -- 172.21.15.77:0/2116917841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe57815ce20 msgr2=0x7fe5780d08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/2116917841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe57815ce20 0x7fe5780d08d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe570009d90 tx=0x7fe57002a660 comp rx=0 tx=0).stop 2024-05-15T19:04:52.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 -- 172.21.15.77:0/2116917841 shutdown_connections 2024-05-15T19:04:52.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/2116917841 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe57815ce20 0x7fe5780d08d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/2116917841 >> v2:172.21.15.77:3300/0 conn(0x7fe57813ef60 0x7fe578073330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 -- 172.21.15.77:0/2116917841 >> 172.21.15.77:0/2116917841 conn(0x7fe5780b3d10 msgr2=0x7fe5780b40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:52.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 -- 172.21.15.77:0/2116917841 shutdown_connections 2024-05-15T19:04:52.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.074+0000 7fe57cbc1640 1 -- 172.21.15.77:0/2116917841 wait complete. 2024-05-15T19:04:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.076+0000 7fe57cbc1640 1 Processor -- start 2024-05-15T19:04:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.076+0000 7fe57cbc1640 1 -- start start 2024-05-15T19:04:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57cbc1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe578073870 0x7fe578151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57cbc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe57813ef60 0x7fe5780b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57cbc1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 0x7fe578155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57cbc1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe5780d0e10 con 0x7fe57813ef60 2024-05-15T19:04:52.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57cbc1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7fe5781420e0 con 0x7fe57815ce20 2024-05-15T19:04:52.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57cbc1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7fe5780d0f90 con 0x7fe578073870 2024-05-15T19:04:52.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe576d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 0x7fe578155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe576d9d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 0x7fe578155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:34374/0 (socket says 172.21.15.77:34374) 2024-05-15T19:04:52.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe576d9d640 1 -- 172.21.15.77:0/815618547 learned_addr learned my addr 172.21.15.77:0/815618547 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe56ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe57813ef60 0x7fe5780b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.077+0000 7fe57659c640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe578073870 0x7fe578151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe576d9d640 1 -- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe578073870 msgr2=0x7fe578151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe576d9d640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe578073870 0x7fe578151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe576d9d640 1 -- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe57813ef60 msgr2=0x7fe5780b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe576d9d640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe57813ef60 0x7fe5780b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe576d9d640 1 -- 172.21.15.77:0/815618547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe578154b10 con 0x7fe57815ce20 2024-05-15T19:04:52.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe56ffff640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe57813ef60 0x7fe5780b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe576d9d640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 0x7fe578155960 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe570009e80 tx=0x7fe570004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe570009450 con 0x7fe57815ce20 2024-05-15T19:04:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe570031bf0 con 0x7fe57815ce20 2024-05-15T19:04:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57003b410 con 0x7fe57815ce20 2024-05-15T19:04:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe578154df0 con 0x7fe57815ce20 2024-05-15T19:04:52.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.078+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe578152280 con 0x7fe57815ce20 2024-05-15T19:04:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.080+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe57003b5b0 con 0x7fe57815ce20 2024-05-15T19:04:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.081+0000 7fe56effd640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe5580762d0 0x7fe558078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.081+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fe5700b87a0 con 0x7fe57815ce20 2024-05-15T19:04:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.081+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5780768e0 con 0x7fe57815ce20 2024-05-15T19:04:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.081+0000 7fe57659c640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe5580762d0 0x7fe558078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.081+0000 7fe57659c640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe5580762d0 0x7fe558078790 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe56800b800 tx=0x7fe56800b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.087+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe57003f030 con 0x7fe57815ce20 2024-05-15T19:04:52.645 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.642+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe57815ca60 con 0x7fe5580762d0 2024-05-15T19:04:52.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.642+0000 7fe56effd640 1 -- 172.21.15.77:0/815618547 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe57815ca60 con 0x7fe5580762d0 2024-05-15T19:04:52.646 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 6 to deep-scrub 2024-05-15T19:04:52.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe5580762d0 msgr2=0x7fe558078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.650 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe5580762d0 0x7fe558078790 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe56800b800 tx=0x7fe56800b3a0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 msgr2=0x7fe578155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 0x7fe578155960 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe570009e80 tx=0x7fe570004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 shutdown_connections 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7fe5580762d0 0x7fe558078790 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7fe57815ce20 0x7fe578155960 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe57813ef60 0x7fe5780b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 --2- 172.21.15.77:0/815618547 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7fe578073870 0x7fe578151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 >> 172.21.15.77:0/815618547 conn(0x7fe5780b3d10 msgr2=0x7fe57815e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:52.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 shutdown_connections 2024-05-15T19:04:52.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.647+0000 7fe57cbc1640 1 -- 172.21.15.77:0/815618547 wait complete. 2024-05-15T19:04:52.676 INFO:tasks.ceph:Scrubbing osd.7 2024-05-15T19:04:52.677 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-15T19:04:52.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.966+0000 7f228e32b640 1 Processor -- start 2024-05-15T19:04:52.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.967+0000 7f228e32b640 1 -- start start 2024-05-15T19:04:52.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f228e32b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f22880b5100 0x7f22880d4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f228e32b640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22880b55d0 con 0x7f22880d53d0 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f228e32b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22880b58b0 con 0x7f228815f440 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f228e32b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f22880d30e0 con 0x7f22880b5100 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f22877fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f22880b5100 0x7f22880d4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f22877fe640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f22880b5100 0x7f22880d4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:33868/0 (socket says 172.21.15.77:33868) 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f22877fe640 1 -- 172.21.15.77:0/3990885404 learned_addr learned my addr 172.21.15.77:0/3990885404 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:52.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.969+0000 7f2287fff640 1 --1- 172.21.15.77:0/3990885404 >> v1:172.21.15.83:6789/0 conn(0x7f228815f440 0x7f22880b49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:34276/0 (socket says 172.21.15.77:34276) 2024-05-15T19:04:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.970+0000 7f22877fe640 1 -- 172.21.15.77:0/3990885404 >> v1:172.21.15.83:6789/0 conn(0x7f228815f440 legacy=0x7f22880b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.970+0000 7f22877fe640 1 -- 172.21.15.77:0/3990885404 >> v1:172.21.15.77:6789/0 conn(0x7f22880d53d0 legacy=0x7f22880d00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.970+0000 7f2286ffd640 1 -- 172.21.15.77:0/3990885404 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113633641 0 0) 0x7f22880b58b0 con 0x7f228815f440 2024-05-15T19:04:52.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.970+0000 7f22877fe640 1 -- 172.21.15.77:0/3990885404 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22880b5b90 con 0x7f22880b5100 2024-05-15T19:04:52.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.971+0000 7f22877fe640 1 --2- 172.21.15.77:0/3990885404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22880b5100 0x7f22880d4e90 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f227c009e50 tx=0x7f227c02a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c808a2563d96dd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.971+0000 7f2286ffd640 1 -- 172.21.15.77:0/3990885404 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c036070 con 0x7f22880b5100 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.971+0000 7f2286ffd640 1 -- 172.21.15.77:0/3990885404 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c031600 con 0x7f22880b5100 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.971+0000 7f2286ffd640 1 -- 172.21.15.77:0/3990885404 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c0319d0 con 0x7f22880b5100 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.972+0000 7f228e32b640 1 -- 172.21.15.77:0/3990885404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22880b5100 msgr2=0x7f22880d4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.972+0000 7f228e32b640 1 --2- 172.21.15.77:0/3990885404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22880b5100 0x7f22880d4e90 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f227c009e50 tx=0x7f227c02a730 comp rx=0 tx=0).stop 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.972+0000 7f228e32b640 1 -- 172.21.15.77:0/3990885404 shutdown_connections 2024-05-15T19:04:52.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.972+0000 7f228e32b640 1 --2- 172.21.15.77:0/3990885404 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f22880b5100 0x7f22880d4e90 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.972+0000 7f228e32b640 1 -- 172.21.15.77:0/3990885404 >> 172.21.15.77:0/3990885404 conn(0x7f228808ebb0 msgr2=0x7f228809e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:52.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.972+0000 7f228e32b640 1 -- 172.21.15.77:0/3990885404 shutdown_connections 2024-05-15T19:04:52.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.973+0000 7f228e32b640 1 -- 172.21.15.77:0/3990885404 wait complete. 2024-05-15T19:04:52.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.976+0000 7f228e32b640 1 Processor -- start 2024-05-15T19:04:52.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.976+0000 7f228e32b640 1 -- start start 2024-05-15T19:04:52.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.978+0000 7f228e32b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22880b5100 0x7f22880cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.978+0000 7f228e32b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22880d53d0 0x7f2288159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.978+0000 7f228e32b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f228815f440 0x7f228815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.978+0000 7f228e32b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f228815f820 con 0x7f22880b5100 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.978+0000 7f228e32b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f22880d5800 con 0x7f228815f440 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.978+0000 7f228e32b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f22880d07c0 con 0x7f22880d53d0 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f2287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22880b5100 0x7f22880cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22880d53d0 0x7f2288159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22880d53d0 0x7f2288159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:46374/0 (socket says 172.21.15.77:46374) 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 -- 172.21.15.77:0/2145327469 learned_addr learned my addr 172.21.15.77:0/2145327469 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:52.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f228c8c8640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f228815f440 0x7f228815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 -- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f228815f440 msgr2=0x7f228815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f228815f440 0x7f228815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 -- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22880b5100 msgr2=0x7f22880cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:52.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22880b5100 0x7f22880cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:52.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 -- 172.21.15.77:0/2145327469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22880cc560 con 0x7f22880d53d0 2024-05-15T19:04:52.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.979+0000 7f22877fe640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22880d53d0 0x7f2288159620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f227c034040 tx=0x7f227c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.980+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c036050 con 0x7f22880d53d0 2024-05-15T19:04:52.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.980+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f227c042070 con 0x7f22880d53d0 2024-05-15T19:04:52.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.980+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228815b9c0 con 0x7f22880d53d0 2024-05-15T19:04:52.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.980+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227c009510 con 0x7f22880d53d0 2024-05-15T19:04:52.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.980+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f228815bf80 con 0x7f22880d53d0 2024-05-15T19:04:52.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.982+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f228806a640 con 0x7f22880d53d0 2024-05-15T19:04:52.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.982+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f227c007c70 con 0x7f22880d53d0 2024-05-15T19:04:52.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.983+0000 7f2284ff9640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22740762d0 0x7f2274078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f2287fff640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22740762d0 0x7f2274078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f227c0b81a0 con 0x7f22880d53d0 2024-05-15T19:04:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f2284ff9640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f227407c190 0x7f227407e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 --> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f227407ec60 con 0x7f227407c190 2024-05-15T19:04:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f227c0bf050 con 0x7f22880d53d0 2024-05-15T19:04:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f2287fff640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22740762d0 0x7f2274078790 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2278000f60 tx=0x7f2278007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.984+0000 7f228c8c8640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f227407c190 0x7f227407e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:52.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.985+0000 7f228c8c8640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f227407c190 0x7f227407e5b0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:52.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:52.986+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== osd.7 v2:172.21.15.83:6824/3871315040 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f227407ec60 con 0x7f227407c190 2024-05-15T19:04:53.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.024+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 --> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f22880d1ec0 con 0x7f227407c190 2024-05-15T19:04:53.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.025+0000 7f2284ff9640 1 -- 172.21.15.77:0/2145327469 <== osd.7 v2:172.21.15.83:6824/3871315040 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f22880d1ec0 con 0x7f227407c190 2024-05-15T19:04:53.028 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-05-15T19:04:53.028 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-15T19:04:53.029 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-05-15T19:04:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f227407c190 msgr2=0x7f227407e5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:6824/3871315040,v1:172.21.15.83:6825/3871315040] conn(0x7f227407c190 0x7f227407e5b0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22740762d0 msgr2=0x7f2274078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f22740762d0 0x7f2274078790 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f2278000f60 tx=0x7f2278007e40 comp rx=0 tx=0).stop 2024-05-15T19:04:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22880d53d0 msgr2=0x7f2288159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 --2- 172.21.15.77:0/2145327469 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f22880d53d0 0x7f2288159620 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f227c034040 tx=0x7f227c004a40 comp rx=0 tx=0).stop 2024-05-15T19:04:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228c8c8640 1 -- 172.21.15.77:0/2145327469 reap_dead start 2024-05-15T19:04:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 shutdown_connections 2024-05-15T19:04:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.026+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 >> 172.21.15.77:0/2145327469 conn(0x7f228808ebb0 msgr2=0x7f22880d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.027+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 shutdown_connections 2024-05-15T19:04:53.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.027+0000 7f228e32b640 1 -- 172.21.15.77:0/2145327469 wait complete. 2024-05-15T19:04:53.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-15T19:04:53.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.326+0000 7f5a2b52b640 1 Processor -- start 2024-05-15T19:04:53.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.326+0000 7f5a2b52b640 1 -- start start 2024-05-15T19:04:53.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a2b52b640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a241636a0 0x7f5a240cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:53.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a2b52b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 0x7f5a2406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:53.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a2b52b640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a2406ece0 con 0x7f5a240b2bb0 2024-05-15T19:04:53.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a2b52b640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f5a24072860 con 0x7f5a240b6180 2024-05-15T19:04:53.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a2b52b640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f5a2406efc0 con 0x7f5a241636a0 2024-05-15T19:04:53.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a28ac6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 0x7f5a2406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a292c7640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f5a241636a0 0x7f5a240cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a29ac8640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f5a240b2bb0 0x7f5a24072cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:34278/0 (socket says 172.21.15.77:34278) 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a28ac6640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 0x7f5a2406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57724/0 (socket says 172.21.15.77:57724) 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.327+0000 7f5a29ac8640 1 -- 172.21.15.77:0/147712878 learned_addr learned my addr 172.21.15.77:0/147712878 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.328+0000 7f5a292c7640 1 -- 172.21.15.77:0/147712878 >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 msgr2=0x7f5a2406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.328+0000 7f5a292c7640 1 --2- 172.21.15.77:0/147712878 >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 0x7f5a2406e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.328+0000 7f5a292c7640 1 -- 172.21.15.77:0/147712878 >> v1:172.21.15.83:6789/0 conn(0x7f5a240b2bb0 legacy=0x7f5a24072cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.328+0000 7f5a17fff640 1 -- 172.21.15.77:0/147712878 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 856801086 0 0) 0x7f5a2406ece0 con 0x7f5a240b2bb0 2024-05-15T19:04:53.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.328+0000 7f5a292c7640 1 -- 172.21.15.77:0/147712878 --> v2:172.21.15.83:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2406f2a0 con 0x7f5a241636a0 2024-05-15T19:04:53.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.328+0000 7f5a28ac6640 1 --2- 172.21.15.77:0/147712878 >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 0x7f5a2406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:53.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.330+0000 7f5a292c7640 1 --2- 172.21.15.77:0/147712878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a241636a0 0x7f5a240cd900 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a240704c0 tx=0x7f5a2002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12cfe1d150a5d002 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:53.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.330+0000 7f5a17fff640 1 -- 172.21.15.77:0/147712878 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20007740 con 0x7f5a241636a0 2024-05-15T19:04:53.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.330+0000 7f5a17fff640 1 -- 172.21.15.77:0/147712878 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a200078e0 con 0x7f5a241636a0 2024-05-15T19:04:53.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.330+0000 7f5a17fff640 1 -- 172.21.15.77:0/147712878 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a20007cb0 con 0x7f5a241636a0 2024-05-15T19:04:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 -- 172.21.15.77:0/147712878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a241636a0 msgr2=0x7f5a240cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/147712878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a241636a0 0x7f5a240cd900 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f5a240704c0 tx=0x7f5a2002a5f0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 -- 172.21.15.77:0/147712878 shutdown_connections 2024-05-15T19:04:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/147712878 >> v2:172.21.15.77:3300/0 conn(0x7f5a240b6180 0x7f5a2406e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/147712878 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a241636a0 0x7f5a240cd900 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 -- 172.21.15.77:0/147712878 >> 172.21.15.77:0/147712878 conn(0x7f5a2406c3f0 msgr2=0x7f5a2406c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 -- 172.21.15.77:0/147712878 shutdown_connections 2024-05-15T19:04:53.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.332+0000 7f5a2b52b640 1 -- 172.21.15.77:0/147712878 wait complete. 2024-05-15T19:04:53.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.335+0000 7f5a2b52b640 1 Processor -- start 2024-05-15T19:04:53.338 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.335+0000 7f5a2b52b640 1 -- start start 2024-05-15T19:04:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.337+0000 7f5a2b52b640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a240b2bb0 0x7f5a241656f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.337+0000 7f5a2b52b640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 0x7f5a241f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.337+0000 7f5a2b52b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a241636a0 0x7f5a241f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.337+0000 7f5a2b52b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2406e920 con 0x7f5a241636a0 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.337+0000 7f5a2b52b640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f5a24163a80 con 0x7f5a240b6180 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.337+0000 7f5a2b52b640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2406eaa0 con 0x7f5a240b2bb0 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a29ac8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a241636a0 0x7f5a241f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 0x7f5a241f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 0x7f5a241f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3300/0 says I am v2:172.21.15.77:33888/0 (socket says 172.21.15.77:33888) 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 -- 172.21.15.77:0/2182459086 learned_addr learned my addr 172.21.15.77:0/2182459086 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a29ac8640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a241636a0 0x7f5a241f9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57726/0 (socket says 172.21.15.77:57726) 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a292c7640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a240b2bb0 0x7f5a241656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 -- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a240b2bb0 msgr2=0x7f5a241656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a240b2bb0 0x7f5a241656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 -- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a241636a0 msgr2=0x7f5a241f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a241636a0 0x7f5a241f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 -- 172.21.15.77:0/2182459086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a24165dd0 con 0x7f5a240b6180 2024-05-15T19:04:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.338+0000 7f5a28ac6640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 0x7f5a241f6620 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800e9e0 tx=0x7f5a1800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.339+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a18017070 con 0x7f5a240b6180 2024-05-15T19:04:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.339+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a1800ca30 con 0x7f5a240b6180 2024-05-15T19:04:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.339+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a241660b0 con 0x7f5a240b6180 2024-05-15T19:04:53.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.339+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a1800ce20 con 0x7f5a240b6180 2024-05-15T19:04:53.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.339+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a241fa3b0 con 0x7f5a240b6180 2024-05-15T19:04:53.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.341+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5a1801a070 con 0x7f5a240b6180 2024-05-15T19:04:53.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.342+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a2406feb0 con 0x7f5a240b6180 2024-05-15T19:04:53.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.342+0000 7f5a15ffb640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a080762d0 0x7f5a08078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:53.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.342+0000 7f5a292c7640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a080762d0 0x7f5a08078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:53.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.342+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5a180971c0 con 0x7f5a240b6180 2024-05-15T19:04:53.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.343+0000 7f5a292c7640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a080762d0 0x7f5a08078790 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5a20034000 tx=0x7f5a2002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:53.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.347+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5a180607c0 con 0x7f5a240b6180 2024-05-15T19:04:53.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.899+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5a240768c0 con 0x7f5a080762d0 2024-05-15T19:04:53.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.900+0000 7f5a15ffb640 1 -- 172.21.15.77:0/2182459086 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5a240768c0 con 0x7f5a080762d0 2024-05-15T19:04:53.903 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 7 to deep-scrub 2024-05-15T19:04:53.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.904+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a080762d0 msgr2=0x7f5a08078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.904+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a080762d0 0x7f5a08078790 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5a20034000 tx=0x7f5a2002f000 comp rx=0 tx=0).stop 2024-05-15T19:04:53.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.904+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 msgr2=0x7f5a241f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:53.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.904+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 0x7f5a241f6620 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5a1800e9e0 tx=0x7f5a1800eea0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.904+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 shutdown_connections 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f5a080762d0 0x7f5a08078790 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5a241636a0 0x7f5a241f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f5a240b6180 0x7f5a241f6620 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 --2- 172.21.15.77:0/2182459086 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f5a240b2bb0 0x7f5a241656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 >> 172.21.15.77:0/2182459086 conn(0x7f5a2406c3f0 msgr2=0x7f5a24073e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 shutdown_connections 2024-05-15T19:04:53.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:53.905+0000 7f5a2b52b640 1 -- 172.21.15.77:0/2182459086 wait complete. 2024-05-15T19:04:53.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-15T19:04:54.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.196+0000 7f604df6a640 1 Processor -- start 2024-05-15T19:04:54.200 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.197+0000 7f604df6a640 1 -- start start 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f604df6a640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f604815ad30 0x7f6048073760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f604df6a640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6048070cc0 0x7f60480ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f604df6a640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f60480ce580 0x7f6048160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f604df6a640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f604815e2d0 con 0x7f604815ad30 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f604df6a640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f604815b110 con 0x7f60480ce580 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f604df6a640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f604815d6e0 con 0x7f6048070cc0 2024-05-15T19:04:54.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f60477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f604815ad30 0x7f6048073760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f60477fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f604815ad30 0x7f6048073760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57736/0 (socket says 172.21.15.77:57736) 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f60477fe640 1 -- 172.21.15.77:0/1088704639 learned_addr learned my addr 172.21.15.77:0/1088704639 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f6046ffd640 1 --2- 172.21.15.77:0/1088704639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6048070cc0 0x7f60480ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.199+0000 7f6047fff640 1 --2- 172.21.15.77:0/1088704639 >> v2:172.21.15.83:3300/0 conn(0x7f60480ce580 0x7f6048160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.200+0000 7f60477fe640 1 -- 172.21.15.77:0/1088704639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6048070cc0 msgr2=0x7f60480ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.200+0000 7f60477fe640 1 --2- 172.21.15.77:0/1088704639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6048070cc0 0x7f60480ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.200+0000 7f60477fe640 1 -- 172.21.15.77:0/1088704639 >> v2:172.21.15.83:3300/0 conn(0x7f60480ce580 msgr2=0x7f6048160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:54.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.200+0000 7f60477fe640 1 --2- 172.21.15.77:0/1088704639 >> v2:172.21.15.83:3300/0 conn(0x7f60480ce580 0x7f6048160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.200+0000 7f60477fe640 1 -- 172.21.15.77:0/1088704639 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60480cea10 con 0x7f604815ad30 2024-05-15T19:04:54.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.200+0000 7f6047fff640 1 --2- 172.21.15.77:0/1088704639 >> v2:172.21.15.83:3300/0 conn(0x7f60480ce580 0x7f6048160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-15T19:04:54.205 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.201+0000 7f60477fe640 1 --2- 172.21.15.77:0/1088704639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604815ad30 0x7f6048073760 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6048161d70 tx=0x7f603802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc1a0cbc542f93f server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:54.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.202+0000 7f60467fc640 1 -- 172.21.15.77:0/1088704639 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038037070 con 0x7f604815ad30 2024-05-15T19:04:54.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.202+0000 7f60467fc640 1 -- 172.21.15.77:0/1088704639 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6038032440 con 0x7f604815ad30 2024-05-15T19:04:54.206 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.202+0000 7f60467fc640 1 -- 172.21.15.77:0/1088704639 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038032810 con 0x7f604815ad30 2024-05-15T19:04:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 -- 172.21.15.77:0/1088704639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604815ad30 msgr2=0x7f6048073760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 --2- 172.21.15.77:0/1088704639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604815ad30 0x7f6048073760 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6048161d70 tx=0x7f603802a140 comp rx=0 tx=0).stop 2024-05-15T19:04:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 -- 172.21.15.77:0/1088704639 shutdown_connections 2024-05-15T19:04:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 --2- 172.21.15.77:0/1088704639 >> v2:172.21.15.83:3300/0 conn(0x7f60480ce580 0x7f6048160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 --2- 172.21.15.77:0/1088704639 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f6048070cc0 0x7f60480ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.207 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 --2- 172.21.15.77:0/1088704639 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f604815ad30 0x7f6048073760 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 -- 172.21.15.77:0/1088704639 >> 172.21.15.77:0/1088704639 conn(0x7f6048072b20 msgr2=0x7f6048072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:54.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 -- 172.21.15.77:0/1088704639 shutdown_connections 2024-05-15T19:04:54.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.203+0000 7f604df6a640 1 -- 172.21.15.77:0/1088704639 wait complete. 2024-05-15T19:04:54.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.206+0000 7f604df6a640 1 Processor -- start 2024-05-15T19:04:54.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.207+0000 7f604df6a640 1 -- start start 2024-05-15T19:04:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f604df6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 0x7f60480aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f604df6a640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60480ce580 0x7f6048148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f604df6a640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f604815ad30 0x7f604815c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f604df6a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f604815dc80 con 0x7f6048070cc0 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f604df6a640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f604815d9a0 con 0x7f604815ad30 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f604df6a640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f604815df60 con 0x7f60480ce580 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f60477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 0x7f60480aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f60477fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 0x7f60480aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57744/0 (socket says 172.21.15.77:57744) 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f60477fe640 1 -- 172.21.15.77:0/2181009509 learned_addr learned my addr 172.21.15.77:0/2181009509 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f6047fff640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f604815ad30 0x7f604815c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.209+0000 7f6046ffd640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60480ce580 0x7f6048148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f6047fff640 1 -- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60480ce580 msgr2=0x7f6048148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f6047fff640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60480ce580 0x7f6048148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f6047fff640 1 -- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 msgr2=0x7f60480aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f6047fff640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 0x7f60480aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f6047fff640 1 -- 172.21.15.77:0/2181009509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60480ab390 con 0x7f604815ad30 2024-05-15T19:04:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f60477fe640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 0x7f60480aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:54.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.210+0000 7f6047fff640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f604815ad30 0x7f604815c3f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6040007e60 tx=0x7f604000d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.211+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mon.1 v2:172.21.15.83:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f604001a070 con 0x7f604815ad30 2024-05-15T19:04:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.211+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mon.1 v2:172.21.15.83:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6040003b90 con 0x7f604815ad30 2024-05-15T19:04:54.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.211+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mon.1 v2:172.21.15.83:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6040004030 con 0x7f604815ad30 2024-05-15T19:04:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.211+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60480ae850 con 0x7f604815ad30 2024-05-15T19:04:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.211+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604814b5e0 con 0x7f604815ad30 2024-05-15T19:04:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.213+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60480694d0 con 0x7f604815ad30 2024-05-15T19:04:54.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.214+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mon.1 v2:172.21.15.83:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f604001d070 con 0x7f604815ad30 2024-05-15T19:04:54.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.215+0000 7f602ffff640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f60340762d0 0x7f6034078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:54.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.216+0000 7f60477fe640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f60340762d0 0x7f6034078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:54.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.216+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mon.1 v2:172.21.15.83:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f60400974b0 con 0x7f604815ad30 2024-05-15T19:04:54.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.216+0000 7f60477fe640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f60340762d0 0x7f6034078790 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f60380090b0 tx=0x7f603802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:54.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.220+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mon.1 v2:172.21.15.83:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6040010070 con 0x7f604815ad30 2024-05-15T19:04:54.766 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.763+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 --> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f60480d1300 con 0x7f60340762d0 2024-05-15T19:04:54.768 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.765+0000 7f602ffff640 1 -- 172.21.15.77:0/2181009509 <== mgr.4107 v2:172.21.15.77:6832/3769114186 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13431 (secure 0 0 0) 0x7f60480d1300 con 0x7f60340762d0 2024-05-15T19:04:54.768 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:54.769 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-05-15T19:04:54.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f60340762d0 msgr2=0x7f6034078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f60340762d0 0x7f6034078790 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f60380090b0 tx=0x7f603802e000 comp rx=0 tx=0).stop 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f604815ad30 msgr2=0x7f604815c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f604815ad30 0x7f604815c3f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6040007e60 tx=0x7f604000d4a0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 shutdown_connections 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f60340762d0 0x7f6034078790 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f60480ce580 0x7f6048148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f604815ad30 0x7f604815c3f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 --2- 172.21.15.77:0/2181009509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6048070cc0 0x7f60480aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:54.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.769+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 >> 172.21.15.77:0/2181009509 conn(0x7f6048072b20 msgr2=0x7f60480b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:54.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.770+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 shutdown_connections 2024-05-15T19:04:54.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:54.770+0000 7f604df6a640 1 -- 172.21.15.77:0/2181009509 wait complete. 2024-05-15T19:04:54.800 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":12489,"stamp":"2024-05-15T19:04:53.226103+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11593848,"kb_used_data":4456,"kb_used_omap":3975,"kb_used_meta":11585336,"kb_avail":743380872,"statfs":{"total":773094113280,"available":761222012928,"internally_reserved":0,"allocated":4562944,"data_stored":2511600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4070423,"internal_metadata":11863385065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002697"},"pg_stats":[{"pgid":"1.0","version":"37'74","reported_seq":358,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-05-15T19:04:47.367150+0000","last_change":"2024-05-15T19:04:47.367200+0000","last_active":"2024-05-15T19:04:47.367150+0000","last_peered":"2024-05-15T19:04:47.367150+0000","last_clean":"2024-05-15T19:04:47.367150+0000","last_became_active":"2024-05-15T12:09:32.170737+0000","last_became_peered":"2024-05-15T12:09:32.170737+0000","last_unstale":"2024-05-15T19:04:47.367150+0000","last_undegraded":"2024-05-15T19:04:47.367150+0000","last_fullsized":"2024-05-15T19:04:47.367150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-05-15T19:04:47.367069+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-05-15T19:04:47.367069+0000","last_clean_scrub_stamp":"2024-05-15T19:04:47.367069+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T23:50:55.130969+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719481671,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1435112,"kb_used_data":412,"kb_used_omap":528,"kb_used_meta":1434159,"kb_avail":92936728,"statfs":{"total":96636764160,"available":95167209472,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":541416,"internal_metadata":1468579096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424514428,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1565096,"kb_used_data":412,"kb_used_omap":218,"kb_used_meta":1564453,"kb_avail":92806744,"statfs":{"total":96636764160,"available":95034105856,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":223458,"internal_metadata":1602000670},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424514428,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1715496,"kb_used_data":992,"kb_used_omap":30,"kb_used_meta":1714465,"kb_avail":92656344,"statfs":{"total":96636764160,"available":94880096256,"internally_reserved":0,"allocated":1015808,"data_stored":756726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":30760,"internal_metadata":1755613144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1529900,"kb_used_data":412,"kb_used_omap":126,"kb_used_meta":1529345,"kb_avail":92841940,"statfs":{"total":96636764160,"available":95070146560,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":129857,"internal_metadata":1566049471},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547131,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1569956,"kb_used_data":412,"kb_used_omap":915,"kb_used_meta":1568620,"kb_avail":92801884,"statfs":{"total":96636764160,"available":95029129216,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":937533,"internal_metadata":1606267331},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129547097,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":700964,"kb_used_data":412,"kb_used_omap":1568,"kb_used_meta":698975,"kb_avail":93670876,"statfs":{"total":96636764160,"available":95918977024,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1605839,"internal_metadata":715751217},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129547093,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1599464,"kb_used_data":992,"kb_used_omap":391,"kb_used_meta":1598072,"kb_avail":92772376,"statfs":{"total":96636764160,"available":94998913024,"internally_reserved":0,"allocated":1015808,"data_stored":756726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":400499,"internal_metadata":1636426637},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579786,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1477860,"kb_used_data":412,"kb_used_omap":196,"kb_used_meta":1477243,"kb_avail":92893980,"statfs":{"total":96636764160,"available":95123435520,"internally_reserved":0,"allocated":421888,"data_stored":166358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":201061,"internal_metadata":1512697499},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-15T19:04:54.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-15T19:04:55.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.072+0000 7f5514dc1640 1 Processor -- start 2024-05-15T19:04:55.076 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.072+0000 7f5514dc1640 1 -- start start 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.073+0000 7f5514dc1640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f551015d970 0x7f551015de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.073+0000 7f5514dc1640 1 --2- >> v2:172.21.15.83:3300/0 conn(0x7f55100b44f0 0x7f55100b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.073+0000 7f5514dc1640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f551006e460 con 0x7f55100d10b0 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.073+0000 7f5514dc1640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f551006f050 con 0x7f551015d970 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.073+0000 7f5514dc1640 1 -- --> v2:172.21.15.83:3300/0 -- mon_getmap magic: 0 -- 0x7f551006e720 con 0x7f55100b44f0 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f551015d970 0x7f551015de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f551015d970 0x7f551015de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57756/0 (socket says 172.21.15.77:57756) 2024-05-15T19:04:55.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 -- 172.21.15.77:0/4147287884 learned_addr learned my addr 172.21.15.77:0/4147287884 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:55.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550ed9d640 1 --2- 172.21.15.77:0/4147287884 >> v2:172.21.15.83:3300/0 conn(0x7f55100b44f0 0x7f55100b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 -- 172.21.15.77:0/4147287884 >> v2:172.21.15.83:3300/0 conn(0x7f55100b44f0 msgr2=0x7f55100b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:55.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 --2- 172.21.15.77:0/4147287884 >> v2:172.21.15.83:3300/0 conn(0x7f55100b44f0 0x7f55100b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550d59a640 1 -- 172.21.15.77:0/4147287884 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132772113 0 0) 0x7f551006e460 con 0x7f55100d10b0 2024-05-15T19:04:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 -- 172.21.15.77:0/4147287884 >> v1:172.21.15.83:6789/0 conn(0x7f55100d10b0 legacy=0x7f55100d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.074+0000 7f550dd9b640 1 -- 172.21.15.77:0/4147287884 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f551006ea00 con 0x7f551015d970 2024-05-15T19:04:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.076+0000 7f550dd9b640 1 --2- 172.21.15.77:0/4147287884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f551015d970 0x7f551015de00 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f551006fc20 tx=0x7f550002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189ac72350a515a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.076+0000 7f550d59a640 1 -- 172.21.15.77:0/4147287884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500037070 con 0x7f551015d970 2024-05-15T19:04:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.076+0000 7f550d59a640 1 -- 172.21.15.77:0/4147287884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5500032440 con 0x7f551015d970 2024-05-15T19:04:55.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.076+0000 7f550d59a640 1 -- 172.21.15.77:0/4147287884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5500032810 con 0x7f551015d970 2024-05-15T19:04:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 -- 172.21.15.77:0/4147287884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f551015d970 msgr2=0x7f551015de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 --2- 172.21.15.77:0/4147287884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f551015d970 0x7f551015de00 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f551006fc20 tx=0x7f550002a270 comp rx=0 tx=0).stop 2024-05-15T19:04:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 -- 172.21.15.77:0/4147287884 shutdown_connections 2024-05-15T19:04:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 --2- 172.21.15.77:0/4147287884 >> v2:172.21.15.83:3300/0 conn(0x7f55100b44f0 0x7f55100b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 --2- 172.21.15.77:0/4147287884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f551015d970 0x7f551015de00 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 -- 172.21.15.77:0/4147287884 >> 172.21.15.77:0/4147287884 conn(0x7f551006c5d0 msgr2=0x7f551006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:55.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 -- 172.21.15.77:0/4147287884 shutdown_connections 2024-05-15T19:04:55.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.078+0000 7f5514dc1640 1 -- 172.21.15.77:0/4147287884 wait complete. 2024-05-15T19:04:55.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.081+0000 7f5514dc1640 1 Processor -- start 2024-05-15T19:04:55.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.082+0000 7f5514dc1640 1 -- start start 2024-05-15T19:04:55.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f5514dc1640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55100b44f0 0x7f551014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f5514dc1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55100d10b0 0x7f5510149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f5514dc1640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f551015d970 0x7f551015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f5514dc1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f55100cf650 con 0x7f55100d10b0 2024-05-15T19:04:55.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f5514dc1640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f55101543f0 con 0x7f55100b44f0 2024-05-15T19:04:55.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f5514dc1640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f551015e340 con 0x7f551015d970 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f550e59c640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55100b44f0 0x7f551014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f550dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55100d10b0 0x7f5510149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f550ed9d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f551015d970 0x7f551015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f550dd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55100d10b0 0x7f5510149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57760/0 (socket says 172.21.15.77:57760) 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.084+0000 7f550dd9b640 1 -- 172.21.15.77:0/578369675 learned_addr learned my addr 172.21.15.77:0/578369675 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f550ed9d640 1 -- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55100b44f0 msgr2=0x7f551014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f550ed9d640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55100b44f0 0x7f551014abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f550ed9d640 1 -- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55100d10b0 msgr2=0x7f5510149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f550ed9d640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55100d10b0 0x7f5510149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f550ed9d640 1 -- 172.21.15.77:0/578369675 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55100725d0 con 0x7f551015d970 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f550ed9d640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f551015d970 0x7f551015c040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f550800e7f0 tx=0x7f550800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5508017070 con 0x7f551015d970 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f550800c940 con 0x7f551015d970 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5510072840 con 0x7f551015d970 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f550800cd10 con 0x7f551015d970 2024-05-15T19:04:55.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.085+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5510072e00 con 0x7f551015d970 2024-05-15T19:04:55.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.088+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f551006a640 con 0x7f551015d970 2024-05-15T19:04:55.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.089+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f550801a070 con 0x7f551015d970 2024-05-15T19:04:55.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.090+0000 7f5506ffd640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f54f0076300 0x7f54f00787c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.091+0000 7f550e59c640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f54f0076300 0x7f54f00787c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.091+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f55080970b0 con 0x7f551015d970 2024-05-15T19:04:55.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.091+0000 7f550e59c640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f54f0076300 0x7f54f00787c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f54f80012e0 tx=0x7f54f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:55.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.095+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5508060750 con 0x7f551015d970 2024-05-15T19:04:55.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.652+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f55100b42d0 con 0x7f551015d970 2024-05-15T19:04:55.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.658+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5508060260 con 0x7f551015d970 2024-05-15T19:04:55.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.659+0000 7f5506ffd640 1 -- 172.21.15.77:0/578369675 <== mon.2 v2:172.21.15.83:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f5508064a50 con 0x7f551015d970 2024-05-15T19:04:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.664+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f54f0076300 msgr2=0x7f54f00787c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.664+0000 7f5514dc1640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f54f0076300 0x7f54f00787c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f54f80012e0 tx=0x7f54f8009040 comp rx=0 tx=0).stop 2024-05-15T19:04:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.664+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f551015d970 msgr2=0x7f551015c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.664+0000 7f5514dc1640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f551015d970 0x7f551015c040 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f550800e7f0 tx=0x7f550800ecb0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 shutdown_connections 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f54f0076300 0x7f54f00787c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f551015d970 0x7f551015c040 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55100d10b0 0x7f5510149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 --2- 172.21.15.77:0/578369675 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f55100b44f0 0x7f551014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 >> 172.21.15.77:0/578369675 conn(0x7f551006c5d0 msgr2=0x7f55100d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 shutdown_connections 2024-05-15T19:04:55.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.665+0000 7f5514dc1640 1 -- 172.21.15.77:0/578369675 wait complete. 2024-05-15T19:04:55.694 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-15T19:04:55.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-15T19:04:55.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.970+0000 7f9e7421d640 1 Processor -- start 2024-05-15T19:04:55.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.971+0000 7f9e7421d640 1 -- start start 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.973+0000 7f9e7421d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e6c145b70 0x7f9e6c073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.973+0000 7f9e7421d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 0x7f9e6c0d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.973+0000 7f9e7421d640 1 -- --> v1:172.21.15.83:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c074030 con 0x7f9e6c071550 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.973+0000 7f9e7421d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c073d50 con 0x7f9e6c145b70 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.973+0000 7f9e7421d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0cf9f0 con 0x7f9e6c0738b0 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e71fb9640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e6c145b70 0x7f9e6c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 0x7f9e6c0d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 0x7f9e6c0d04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.83:3301/0 says I am v2:172.21.15.77:46418/0 (socket says 172.21.15.77:46418) 2024-05-15T19:04:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 -- 172.21.15.77:0/3297112845 learned_addr learned my addr 172.21.15.77:0/3297112845 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:55.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e717b8640 1 --1- >> v1:172.21.15.83:6789/0 conn(0x7f9e6c071550 0x7f9e6c0b62c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.83:6789/0 says I am v1:172.21.15.77:34292/0 (socket says 172.21.15.77:34292) 2024-05-15T19:04:55.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 -- 172.21.15.77:0/3297112845 >> v2:172.21.15.77:3300/0 conn(0x7f9e6c145b70 msgr2=0x7f9e6c073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-15T19:04:55.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 --2- 172.21.15.77:0/3297112845 >> v2:172.21.15.77:3300/0 conn(0x7f9e6c145b70 0x7f9e6c073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 -- 172.21.15.77:0/3297112845 >> v1:172.21.15.83:6789/0 conn(0x7f9e6c071550 legacy=0x7f9e6c0b62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e727ba640 1 -- 172.21.15.77:0/3297112845 --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c0cfcd0 con 0x7f9e6c0738b0 2024-05-15T19:04:55.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.974+0000 7f9e70fb7640 1 -- 172.21.15.77:0/3297112845 <== mon.1 v1:172.21.15.83:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150247570 0 0) 0x7f9e6c074030 con 0x7f9e6c071550 2024-05-15T19:04:55.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.975+0000 7f9e727ba640 1 --2- 172.21.15.77:0/3297112845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 0x7f9e6c0d04d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009e50 tx=0x7f9e6402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b2229c0536988e server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:55.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.975+0000 7f9e70fb7640 1 -- 172.21.15.77:0/3297112845 <== mon.2 v2:172.21.15.83:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e64036070 con 0x7f9e6c0738b0 2024-05-15T19:04:55.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.976+0000 7f9e70fb7640 1 -- 172.21.15.77:0/3297112845 <== mon.2 v2:172.21.15.83:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9e64031600 con 0x7f9e6c0738b0 2024-05-15T19:04:55.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.976+0000 7f9e70fb7640 1 -- 172.21.15.77:0/3297112845 <== mon.2 v2:172.21.15.83:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e640319f0 con 0x7f9e6c0738b0 2024-05-15T19:04:55.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 -- 172.21.15.77:0/3297112845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 msgr2=0x7f9e6c0d04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 --2- 172.21.15.77:0/3297112845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 0x7f9e6c0d04d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009e50 tx=0x7f9e6402a680 comp rx=0 tx=0).stop 2024-05-15T19:04:55.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 -- 172.21.15.77:0/3297112845 shutdown_connections 2024-05-15T19:04:55.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 --2- 172.21.15.77:0/3297112845 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c0738b0 0x7f9e6c0d04d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.981 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 --2- 172.21.15.77:0/3297112845 >> v2:172.21.15.77:3300/0 conn(0x7f9e6c145b70 0x7f9e6c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 -- 172.21.15.77:0/3297112845 >> 172.21.15.77:0/3297112845 conn(0x7f9e6c0b3ca0 msgr2=0x7f9e6c0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:55.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 -- 172.21.15.77:0/3297112845 shutdown_connections 2024-05-15T19:04:55.982 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.977+0000 7f9e7421d640 1 -- 172.21.15.77:0/3297112845 wait complete. 2024-05-15T19:04:55.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.981+0000 7f9e7421d640 1 Processor -- start 2024-05-15T19:04:55.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.981+0000 7f9e7421d640 1 -- start start 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e7421d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 0x7f9e6c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e7421d640 1 --2- >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c145b70 0x7f9e6c15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e7421d640 1 --2- >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c1426a0 0x7f9e6c1e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e7421d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0b6b50 con 0x7f9e6c0738b0 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e7421d640 1 -- --> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0b69d0 con 0x7f9e6c1426a0 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e7421d640 1 -- --> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0d0a10 con 0x7f9e6c145b70 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e71fb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 0x7f9e6c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e71fb9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 0x7f9e6c150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:57772/0 (socket says 172.21.15.77:57772) 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e71fb9640 1 -- 172.21.15.77:0/4254451024 learned_addr learned my addr 172.21.15.77:0/4254451024 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e717b8640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c145b70 0x7f9e6c15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.983+0000 7f9e727ba640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c1426a0 0x7f9e6c1e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e71fb9640 1 -- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c145b70 msgr2=0x7f9e6c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e71fb9640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c145b70 0x7f9e6c15dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e71fb9640 1 -- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c1426a0 msgr2=0x7f9e6c1e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e71fb9640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c1426a0 0x7f9e6c1e8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e71fb9640 1 -- 172.21.15.77:0/4254451024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c15d5e0 con 0x7f9e6c0738b0 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e717b8640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c145b70 0x7f9e6c15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e71fb9640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 0x7f9e6c150860 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800e870 tx=0x7f9e6800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.984+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68017070 con 0x7f9e6c0738b0 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.985+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9e6800c940 con 0x7f9e6c0738b0 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.985+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c15c580 con 0x7f9e6c0738b0 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.985+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6800cd50 con 0x7f9e6c0738b0 2024-05-15T19:04:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.985+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c15cb00 con 0x7f9e6c0738b0 2024-05-15T19:04:55.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.988+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c0694d0 con 0x7f9e6c0738b0 2024-05-15T19:04:55.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.989+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9e6801a070 con 0x7f9e6c0738b0 2024-05-15T19:04:55.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.990+0000 7f9e627fc640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9e500762d0 0x7f9e50078790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-15T19:04:55.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.990+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f9e68097160 con 0x7f9e6c0738b0 2024-05-15T19:04:55.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.990+0000 7f9e717b8640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9e500762d0 0x7f9e50078790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-15T19:04:55.993 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:55.991+0000 7f9e717b8640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9e500762d0 0x7f9e50078790 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c15bf70 tx=0x7f9e5c007cf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-15T19:04:56.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.004+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9e680606e0 con 0x7f9e6c0738b0 2024-05-15T19:04:56.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.679+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e6c070b40 con 0x7f9e6c0738b0 2024-05-15T19:04:56.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.680+0000 7f9e627fc640 1 -- 172.21.15.77:0/4254451024 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3866 (secure 0 0 0) 0x7f9e680649e0 con 0x7f9e6c0738b0 2024-05-15T19:04:56.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-05-15T19:04:56.684 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4708,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6834/1580061319","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6832","nonce":1580061319},{"type":"v1","addr":"172.21.15.83:6834","nonce":1580061319}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4711,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.83:6835/103897231","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.83:6833","nonce":103897231},{"type":"v1","addr":"172.21.15.83:6835","nonce":103897231}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4860,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6836/2103032248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2103032248},{"type":"v1","addr":"172.21.15.77:6836","nonce":2103032248}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":9750,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1645935050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6835","nonce":1645935050},{"type":"v1","addr":"172.21.15.77:6837","nonce":1645935050}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-05-15T19:04:56.684 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2024-05-15T19:04:56.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9e500762d0 msgr2=0x7f9e50078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:56.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9e500762d0 0x7f9e50078790 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c15bf70 tx=0x7f9e5c007cf0 comp rx=0 tx=0).stop 2024-05-15T19:04:56.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 msgr2=0x7f9e6c150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 0x7f9e6c150860 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f9e6800e870 tx=0x7f9e6800ed30 comp rx=0 tx=0).stop 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 shutdown_connections 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:6832/3769114186,v1:172.21.15.77:6833/3769114186] conn(0x7f9e500762d0 0x7f9e50078790 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3301/0,v1:172.21.15.83:6790/0] conn(0x7f9e6c145b70 0x7f9e6c15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.83:3300/0,v1:172.21.15.83:6789/0] conn(0x7f9e6c1426a0 0x7f9e6c1e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 --2- 172.21.15.77:0/4254451024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e6c0738b0 0x7f9e6c150860 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-15T19:04:56.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 >> 172.21.15.77:0/4254451024 conn(0x7f9e6c0b3ca0 msgr2=0x7f9e6c144b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-15T19:04:56.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 shutdown_connections 2024-05-15T19:04:56.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-05-15T19:04:56.686+0000 7f9e7421d640 1 -- 172.21.15.77:0/4254451024 wait complete. 2024-05-15T19:04:56.717 DEBUG:tasks.cephfs.filesystem:already dead... 2024-05-15T19:04:56.717 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-15T19:04:56.717 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-15T19:04:56.717 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:04:56.734 INFO:tasks.ceph.mds.a:Stopped 2024-05-15T19:04:56.735 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-15T19:04:56.735 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:04:56.790 INFO:tasks.ceph.mds.c:Stopped 2024-05-15T19:04:56.790 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-15T19:04:56.790 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:04:56.803 INFO:tasks.ceph.mds.b:Stopped 2024-05-15T19:04:56.804 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-15T19:04:56.804 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:04:56.856 INFO:tasks.ceph.mds.d:Stopped 2024-05-15T19:04:56.857 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-15T19:04:56.857 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-15T19:04:56.857 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:00.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-15T19:05:02.959 INFO:tasks.ceph.osd.0:Stopped 2024-05-15T19:05:02.960 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-15T19:05:02.960 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:06.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-15T19:05:06.557 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-15T19:05:09.062 INFO:tasks.ceph.osd.1:Stopped 2024-05-15T19:05:09.062 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-15T19:05:09.063 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:12.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-15T19:05:12.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-15T19:05:15.164 INFO:tasks.ceph.osd.2:Stopped 2024-05-15T19:05:15.165 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-15T19:05:15.165 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:18.473 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-15T19:05:18.474 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-15T19:05:18.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:05:18.729 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:05:21.266 INFO:tasks.ceph.osd.3:Stopped 2024-05-15T19:05:21.267 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-15T19:05:21.267 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:24.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-15T19:05:24.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-15T19:05:27.369 INFO:tasks.ceph.osd.4:Stopped 2024-05-15T19:05:27.369 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-15T19:05:27.369 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.451 INFO:tasks.ceph.osd.5:Stopped 2024-05-15T19:05:27.452 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-15T19:05:27.452 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.528 INFO:tasks.ceph.osd.6:Stopped 2024-05-15T19:05:27.528 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-15T19:05:27.528 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.620 INFO:tasks.ceph.osd.7:Stopped 2024-05-15T19:05:27.620 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-15T19:05:27.620 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-15T19:05:27.620 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.691 INFO:tasks.ceph.mgr.y:Stopped 2024-05-15T19:05:27.692 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-15T19:05:27.692 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.719 INFO:tasks.ceph.mgr.x:Stopped 2024-05-15T19:05:27.719 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-15T19:05:27.720 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-15T19:05:27.720 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.753 INFO:tasks.ceph.mon.a:Stopped 2024-05-15T19:05:27.754 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-15T19:05:27.754 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.779 INFO:tasks.ceph.mon.b:Stopped 2024-05-15T19:05:27.779 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-15T19:05:27.779 INFO:teuthology.orchestra.run:waiting for 300 2024-05-15T19:05:27.838 INFO:tasks.ceph.mon.c:Stopped 2024-05-15T19:05:27.838 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-15T19:05:27.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-05-15T19:05:27.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T19:05:27.993 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-15T19:05:28.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T19:05:28.251 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-15T19:05:28.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T19:05:28.374 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-15T19:05:28.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T19:05:28.478 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-15T19:05:28.586 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T19:05:28.586 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-15T19:05:28.899 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T19:05:28.899 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-15T19:05:29.013 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T19:05:29.013 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-15T19:05:29.109 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T19:05:29.109 DEBUG:teuthology.orchestra.run.smithi083:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-15T19:05:29.224 INFO:tasks.ceph:Archiving mon data... 2024-05-15T19:05:29.225 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/data/mon.a.tgz 2024-05-15T19:05:29.226 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-05-15T19:05:29.274 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.9OTyPnDpGN 2024-05-15T19:05:29.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.9OTyPnDpGN 2024-05-15T19:05:29.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-15T19:05:29.608 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.9OTyPnDpGN 2024-05-15T19:05:29.746 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.9OTyPnDpGN is 581KB 2024-05-15T19:05:29.837 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.9OTyPnDpGN 2024-05-15T19:05:29.871 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/data/mon.b.tgz 2024-05-15T19:05:29.871 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-05-15T19:05:29.888 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.5yCJNEVbCw 2024-05-15T19:05:29.889 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5yCJNEVbCw 2024-05-15T19:05:30.056 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.5yCJNEVbCw 2024-05-15T19:05:30.170 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.5yCJNEVbCw is 585KB 2024-05-15T19:05:30.272 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.5yCJNEVbCw 2024-05-15T19:05:30.287 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/data/mon.c.tgz 2024-05-15T19:05:30.288 DEBUG:teuthology.orchestra.run.smithi083:> mktemp 2024-05-15T19:05:30.343 INFO:teuthology.orchestra.run.smithi083.stdout:/tmp/tmp.R8jRhEfA2N 2024-05-15T19:05:30.343 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.R8jRhEfA2N 2024-05-15T19:05:30.493 DEBUG:teuthology.orchestra.run.smithi083:> sudo chmod 0666 /tmp/tmp.R8jRhEfA2N 2024-05-15T19:05:30.577 DEBUG:teuthology.orchestra.remote:smithi083:/tmp/tmp.R8jRhEfA2N is 585KB 2024-05-15T19:05:30.677 DEBUG:teuthology.orchestra.run.smithi083:> rm -fr /tmp/tmp.R8jRhEfA2N 2024-05-15T19:05:30.692 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-15T19:05:30.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T19:05:30.696 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-15T19:05:30.840 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T19:05:30.856 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-15T19:05:30.856 INFO:tasks.ceph:Archiving crash dumps... 2024-05-15T19:05:30.858 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/remote/smithi077/crash 2024-05-15T19:05:30.859 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T19:05:30.937 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/remote/smithi083/crash 2024-05-15T19:05:30.938 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-15T19:05:30.962 INFO:tasks.ceph:Shutting down logrotate 2024-05-15T19:05:30.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:05:30.967 DEBUG:teuthology.orchestra.run.smithi083:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T19:05:31.056 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-15T19:05:31.105 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-15T19:05:31.138 INFO:tasks.ceph:Compressing logs... 2024-05-15T19:05:31.138 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T19:05:31.142 DEBUG:teuthology.orchestra.run.smithi083:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-15T19:05:31.214 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544809.log 2024-05-15T19:05:31.214 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365108.log 2024-05-15T19:05:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244933.log 2024-05-15T19:05:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.544809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539048.log 2024-05-15T19:05:31.216 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457920.log 2024-05-15T19:05:31.217 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339730.log 2024-05-15T19:05:31.217 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486499.log 2024-05-15T19:05:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530013.log 2024-05-15T19:05:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265342.log 2024-05-15T19:05:31.220 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534081.log 2024-05-15T19:05:31.220 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133680.log 2024-05-15T19:05:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T19:05:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36870.log 2024-05-15T19:05:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-15T19:05:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.36870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37041.log 2024-05-15T19:05:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-15T19:05:31.227 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37041.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37081.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37161.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36950.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42806.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36910.log 2024-05-15T19:05:31.228 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.1.42806.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.36910.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37121.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43260.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.admin.37121.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-15T19:05:31.229 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-client.3.43260.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-05-15T19:05:31.235 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428707.log 2024-05-15T19:05:31.235 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445372.log 2024-05-15T19:05:31.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.365108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249491.log 2024-05-15T19:05:31.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.539048.log: /var/log/ceph/ceph-client.admin.486499.log: /var/log/ceph/ceph-client.admin.530013.log: /var/log/ceph/ceph-client.admin.428707.log: /var/log/ceph/ceph-client.admin.133680.log: /var/log/ceph/ceph-client.admin.534081.log: /var/log/ceph/ceph-client.admin.244933.log: /var/log/ceph/ceph-client.admin.339730.log: /var/log/ceph/ceph-client.admin.457920.log: /var/log/ceph/ceph-client.admin.265342.log: /var/log/ceph/ceph-client.admin.445372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204186.log 2024-05-15T19:05:31.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.249491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402886.log 2024-05-15T19:05:31.235 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389252.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411342.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362972.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47626.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385376.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548343.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380888.log 2024-05-15T19:05:31.236 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243180.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375223.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47891.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379602.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260671.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461972.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147740.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564955.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360366.log 2024-05-15T19:05:31.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257603.log 2024-05-15T19:05:31.238 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346533.log 2024-05-15T19:05:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354863.log 2024-05-15T19:05:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-05-15T19:05:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158210.log 2024-05-15T19:05:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137668.log 2024-05-15T19:05:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127322.log 2024-05-15T19:05:31.240 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499514.log 2024-05-15T19:05:31.240 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30754.log 2024-05-15T19:05:31.241 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465038.log 2024-05-15T19:05:31.241 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497762.log 2024-05-15T19:05:31.241 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404639.log 2024-05-15T19:05:31.241 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157364.log 2024-05-15T19:05:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125973.log 2024-05-15T19:05:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372008.log 2024-05-15T19:05:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561389.log 2024-05-15T19:05:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347398.log 2024-05-15T19:05:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202917.log 2024-05-15T19:05:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43147.log 2024-05-15T19:05:31.246 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556893.log 2024-05-15T19:05:31.246 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381734.log 2024-05-15T19:05:31.246 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261103.log 2024-05-15T19:05:31.247 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475270.log 2024-05-15T19:05:31.247 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146460.log 2024-05-15T19:05:31.248 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436868.log 2024-05-15T19:05:31.249 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535883.log 2024-05-15T19:05:31.249 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192200.log 2024-05-15T19:05:31.250 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477160.log 2024-05-15T19:05:31.250 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180038.log 2024-05-15T19:05:31.250 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461558.log 2024-05-15T19:05:31.251 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515057.log 2024-05-15T19:05:31.251 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.36995.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-15T19:05:31.252 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234493.log 2024-05-15T19:05:31.252 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207993.log 2024-05-15T19:05:31.253 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48357.log 2024-05-15T19:05:31.253 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190853.log 2024-05-15T19:05:31.254 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177366.log 2024-05-15T19:05:31.254 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247306.log 2024-05-15T19:05:31.255 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365956.log 2024-05-15T19:05:31.255 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277104.log 2024-05-15T19:05:31.256 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488239.log 2024-05-15T19:05:31.256 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131136.log 2024-05-15T19:05:31.257 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422688.log 2024-05-15T19:05:31.257 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205455.log 2024-05-15T19:05:31.258 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2024-05-15T19:05:31.258 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126889.log 2024-05-15T19:05:31.259 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343129.log 2024-05-15T19:05:31.259 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347389.log 2024-05-15T19:05:31.260 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259402.log 2024-05-15T19:05:31.260 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434299.log 2024-05-15T19:05:31.261 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540668.log 2024-05-15T19:05:31.262 INFO:teuthology.orchestra.run.smithi083.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37041.log.gz 2024-05-15T19:05:31.263 INFO:teuthology.orchestra.run.smithi083.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37081.log.gz 2024-05-15T19:05:31.263 INFO:teuthology.orchestra.run.smithi083.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37121.log.gz 2024-05-15T19:05:31.263 INFO:teuthology.orchestra.run.smithi083.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37161.log.gz 2024-05-15T19:05:31.271 INFO:teuthology.orchestra.run.smithi083.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36870.log.gz 2024-05-15T19:05:31.271 INFO:teuthology.orchestra.run.smithi083.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36910.log.gz 2024-05-15T19:05:31.271 INFO:teuthology.orchestra.run.smithi083.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36950.log.gz 2024-05-15T19:05:31.271 INFO:teuthology.orchestra.run.smithi083.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531314.log 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129874.log 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111931.log 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.402886.log: /var/log/ceph/ceph-client.admin.548343.log: /var/log/ceph/ceph-client.admin.43021.log: /var/log/ceph/ceph-client.admin.461972.log: /var/log/ceph/ceph-client.admin.564955.log: /var/log/ceph/ceph-client.admin.343129.log: /var/log/ceph/ceph-client.admin.259402.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.265342.log.gz 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.133680.log.gz 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.499514.log: /var/log/ceph/ceph-client.admin.465038.log: /var/log/ceph/ceph-client.admin.497762.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.564955.log.gz 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502752.log 2024-05-15T19:05:31.279 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.561389.log: /var/log/ceph/ceph-client.admin.556893.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.339730.log.gz 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.534081.log.gz 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.475270.log: /var/log/ceph/ceph-client.admin.111931.log: /var/log/ceph/ceph-client.admin.535883.log: /var/log/ceph/ceph-client.admin.477160.log: /var/log/ceph/ceph-client.admin.461558.log: /var/log/ceph/ceph-client.admin.515057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344841.log 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.249491.log.gz 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.502752.log: /var/log/ceph/ceph-client.admin.488239.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.486499.log.gz 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.540668.log: /var/log/ceph/ceph-client.admin.204186.log: /var/log/ceph/ceph-client.admin.47891.log: /var/log/ceph/ceph-client.admin.531314.log: /var/log/ceph/ceph-client.admin.47626.log: /var/log/ceph/ceph-client.admin.207993.log: /var/log/ceph/ceph-client.admin.389252.log: /var/log/ceph/ceph-client.admin.436868.log: /var/log/ceph/ceph-client.admin.257603.log: /var/log/ceph/ceph-client.admin.411342.log: /var/log/ceph/ceph-client.admin.127322.log: /var/log/ceph/ceph-client.admin.381734.log: /var/log/ceph/ceph-client.admin.243180.log: /var/log/ceph/ceph-client.admin.380888.log: /var/log/ceph/ceph-client.admin.354863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381311.log 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.385376.log: /var/log/ceph/ceph-client.admin.192200.log: /var/log/ceph/ceph.tmp-client.admin.30754.log: /var/log/ceph/ceph-client.admin.375223.log: /var/log/ceph/ceph-client.admin.379602.log: /var/log/ceph/ceph-client.admin.146460.log: /var/log/ceph/ceph-client.admin.147740.log: /var/log/ceph/ceph-client.admin.158210.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30754.log.gz 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37059.log: /var/log/ceph/ceph-client.admin.260671.log: /var/log/ceph/ceph-client.admin.180038.log: /var/log/ceph/ceph-client.admin.404639.log: /var/log/ceph/ceph-client.admin.125973.log: /var/log/ceph/ceph-client.admin.137668.log: /var/log/ceph/ceph-client.admin.360366.log: /var/log/ceph/ceph-client.admin.344841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235825.log 2024-05-15T19:05:31.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.190853.log: /var/log/ceph/ceph-client.admin.157364.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.544809.log.gz 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.372008.log: /var/log/ceph/ceph-client.admin.347398.log: /var/log/ceph/ceph-client.admin.261103.log: /var/log/ceph/ceph-client.admin.48357.log: /var/log/ceph/ceph-client.admin.202917.log: /var/log/ceph/ceph-client.admin.131136.log: /var/log/ceph/ceph-client.admin.247306.log: /var/log/ceph/ceph-client.admin.346533.log: /var/log/ceph/ceph-client.admin.126889.log: /var/log/ceph/ceph-client.admin.362972.log: /var/log/ceph/ceph-client.admin.205455.log: /var/log/ceph/ceph-client.admin.177366.log: /var/log/ceph/ceph-client.admin.43147.log: /var/log/ceph/ceph-client.admin.434299.log: /var/log/ceph/ceph-client.admin.347389.log: gzip/var/log/ceph/ceph-client.admin.234493.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.412216.log 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.365956.log: /var/log/ceph/ceph-client.admin.277104.log: /var/log/ceph/ceph-client.admin.422688.log: /var/log/ceph/ceph-client.admin.129874.log: /var/log/ceph/ceph-client.admin.381311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139417.log 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.235825.log: /var/log/ceph/ceph-client.admin.412216.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437291.log 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose 81.1% -- /var/log/ceph/ceph-client.admin.418223.log -- replaced with /var/log/ceph/ceph-client.admin.111931.log.gz 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139417.log: /var/log/ceph/ceph-client.admin.437291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44250.log 2024-05-15T19:05:31.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.418223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195337.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246008.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.195337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465461.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.246008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459655.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.465461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346961.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.459655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467729.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.346961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222642.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.467729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362545.log 2024-05-15T19:05:31.282 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.222642.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.445832.log 2024-05-15T19:05:31.283 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252904.log 2024-05-15T19:05:31.283 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.362545.log: /var/log/ceph/ceph-client.admin.445832.log: gzip -5 78.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.539048.log.gz /var/log/ceph/ceph-client.admin.44253.log 2024-05-15T19:05:31.283 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.283 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.252904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417433.log 2024-05-15T19:05:31.286 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427017.log 2024-05-15T19:05:31.286 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.417433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129865.log 2024-05-15T19:05:31.286 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.207993.log.gz 2024-05-15T19:05:31.286 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.427017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204177.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46391.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.204177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122107.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193537.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149054.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122107.log: /var/log/ceph/ceph-client.admin.193537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261517.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48357.log.gz 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338870.log 2024-05-15T19:05:31.287 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149054.log: /var/log/ceph/ceph-client.admin.261517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193528.log 2024-05-15T19:05:31.288 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532793.log 2024-05-15T19:05:31.288 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.338870.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz 2024-05-15T19:05:31.289 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373952.log 2024-05-15T19:05:31.290 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.193528.log: /var/log/ceph/ceph-client.admin.532793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47415.log 2024-05-15T19:05:31.290 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531766.log 2024-05-15T19:05:31.290 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.373952.log: /var/log/ceph/ceph-client.admin.47415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521957.log 2024-05-15T19:05:31.290 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.531766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390710.log 2024-05-15T19:05:31.292 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.146460.log.gz 2024-05-15T19:05:31.292 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.521957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425748.log 2024-05-15T19:05:31.292 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.147740.log.gz 2024-05-15T19:05:31.292 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259411.log 2024-05-15T19:05:31.292 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.390710.log: /var/log/ceph/ceph-client.admin.425748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467152.log 2024-05-15T19:05:31.292 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.259411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278381.log 2024-05-15T19:05:31.293 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.467152.log: gzip -5 --verbose -- 85.8% -- replaced with /var/log/ceph/ceph-client.admin.402886.log.gz 2024-05-15T19:05:31.293 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.564997.log 2024-05-15T19:05:31.293 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.278381.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.404639.log.gz 2024-05-15T19:05:31.294 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185973.log 2024-05-15T19:05:31.295 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.158210.log.gz 2024-05-15T19:05:31.295 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405534.log 2024-05-15T19:05:31.295 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43567.log 2024-05-15T19:05:31.295 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.185973.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.564997.log.gz 2024-05-15T19:05:31.296 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.405534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407892.log 2024-05-15T19:05:31.296 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235410.log 2024-05-15T19:05:31.297 INFO:teuthology.orchestra.run.smithi077.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.445372.log.gz 2024-05-15T19:05:31.297 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556883.log 2024-05-15T19:05:31.297 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.407892.log: /var/log/ceph/ceph-client.admin.235410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473842.log 2024-05-15T19:05:31.297 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.137668.log.gz 2024-05-15T19:05:31.299 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210210.log 2024-05-15T19:05:31.299 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.556883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472505.log 2024-05-15T19:05:31.299 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.473842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433449.log 2024-05-15T19:05:31.299 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.243180.log.gz 2024-05-15T19:05:31.299 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.210210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390232.log 2024-05-15T19:05:31.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.472505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123855.log 2024-05-15T19:05:31.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.433449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132414.log 2024-05-15T19:05:31.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.390232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564233.log 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.123855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134957.log 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.497762.log.gz 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499946.log 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564233.log: gzip -5/var/log/ceph/ceph-client.admin.134957.log: --verbose -- /var/log/ceph/ceph-client.admin.437714.log 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.502752.log.gz 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.564233.log.gz 2024-05-15T19:05:31.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.499946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440084.log 2024-05-15T19:05:31.305 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.437714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340577.log 2024-05-15T19:05:31.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.440084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44249.log 2024-05-15T19:05:31.308 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.180038.log.gz 2024-05-15T19:05:31.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.340577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346114.log 2024-05-15T19:05:31.308 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526611.log/var/log/ceph/ceph-client.admin.44249.log: /var/log/ceph/ceph-client.admin.346114.log: 2024-05-15T19:05:31.309 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417004.log/var/log/ceph/ceph-client.admin.526611.log: 2024-05-15T19:05:31.309 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527460.log 2024-05-15T19:05:31.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.417004.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47891.log.gz 2024-05-15T19:05:31.309 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494780.log 2024-05-15T19:05:31.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.527460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343980.log 2024-05-15T19:05:31.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.494780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277527.log 2024-05-15T19:05:31.313 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124701.log 2024-05-15T19:05:31.313 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.277527.log: /var/log/ceph/ceph-client.admin.343980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469912.log 2024-05-15T19:05:31.313 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.124701.log: -5 --verbose -- 79.1% -- replaced with /var/log/ceph/ceph-client.admin.244933.log.gz 2024-05-15T19:05:31.314 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.184043.log 2024-05-15T19:05:31.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.469912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354416.log 2024-05-15T19:05:31.314 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.184043.log: --verbose -- /var/log/ceph/ceph-client.admin.364677.log 2024-05-15T19:05:31.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.354416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434727.log 2024-05-15T19:05:31.315 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.364677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348664.log 2024-05-15T19:05:31.316 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.127322.log.gz 2024-05-15T19:05:31.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.434727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210653.log 2024-05-15T19:05:31.316 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.348664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47032.log 2024-05-15T19:05:31.316 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490042.log 2024-05-15T19:05:31.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47032.log: /var/log/ceph/ceph-client.admin.210653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224002.log 2024-05-15T19:05:31.317 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.259402.log.gz 2024-05-15T19:05:31.318 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48105.log 2024-05-15T19:05:31.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.490042.log: /var/log/ceph/ceph-client.admin.224002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384952.log 2024-05-15T19:05:31.318 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422260.log 2024-05-15T19:05:31.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48105.log: /var/log/ceph/ceph-client.admin.384952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558629.log 2024-05-15T19:05:31.319 INFO:teuthology.orchestra.run.smithi083.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.1.42806.log.gz 2024-05-15T19:05:31.320 INFO:teuthology.orchestra.run.smithi083.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.3.43260.log.gz 2024-05-15T19:05:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564717.log 2024-05-15T19:05:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.422260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188540.log 2024-05-15T19:05:31.321 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.488239.log.gz 2024-05-15T19:05:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.558629.log: /var/log/ceph/ceph-client.admin.564717.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.564717.log.gz 2024-05-15T19:05:31.321 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248649.log 2024-05-15T19:05:31.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.188540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156426.log 2024-05-15T19:05:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504891.log 2024-05-15T19:05:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.248649.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.157364.log.gz 2024-05-15T19:05:31.323 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133689.log 2024-05-15T19:05:31.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.504891.log: /var/log/ceph/ceph-client.admin.156426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340586.log 2024-05-15T19:05:31.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151727.log 2024-05-15T19:05:31.325 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505320.log 2024-05-15T19:05:31.325 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.340586.log: /var/log/ceph/ceph-client.admin.151727.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.192200.log.gz 2024-05-15T19:05:31.325 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542630.log 2024-05-15T19:05:31.326 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258056.log 2024-05-15T19:05:31.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.505320.log: gzip -5/var/log/ceph/ceph-client.admin.542630.log: --verbose -- /var/log/ceph/ceph-client.admin.406615.log 2024-05-15T19:05:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.258056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554147.log 2024-05-15T19:05:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.406615.log: --verbose 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202917.log.gz 2024-05-15T19:05:31.329 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.149936.log 2024-05-15T19:05:31.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.554147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484321.log 90.3% -- replaced with /var/log/ceph/ceph-client.admin.204186.log.gz 2024-05-15T19:05:31.329 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183596.log 2024-05-15T19:05:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.484321.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.216831.log 2024-05-15T19:05:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.183596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44617.log 2024-05-15T19:05:31.332 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.379602.log.gz 2024-05-15T19:05:31.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.216831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466308.log 2024-05-15T19:05:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349527.log 2024-05-15T19:05:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158517.log 2024-05-15T19:05:31.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.349527.log: /var/log/ceph/ceph-client.admin.466308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448188.log 2024-05-15T19:05:31.334 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.260671.log.gz 2024-05-15T19:05:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267102.log 2024-05-15T19:05:31.335 INFO:teuthology.orchestra.run.smithi077.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.261517.log.gz 2024-05-15T19:05:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.448188.log: -- /var/log/ceph/ceph-client.admin.231930.log 2024-05-15T19:05:31.335 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.261103.log.gz 2024-05-15T19:05:31.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.267102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185452.log 2024-05-15T19:05:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.231930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43572.log 2024-05-15T19:05:31.337 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.185452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565393.log 2024-05-15T19:05:31.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235834.log 2024-05-15T19:05:31.338 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406624.log 2024-05-15T19:05:31.340 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565393.log: /var/log/ceph/ceph-client.admin.235834.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.131136.log.gz 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487345.log 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.565393.log.gz 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44659.log 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.406624.log: /var/log/ceph/ceph-client.admin.487345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338879.log 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115137.log 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47626.log.gz 2024-05-15T19:05:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44659.log: /var/log/ceph/ceph-client.admin.338879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402020.log 2024-05-15T19:05:31.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.115137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488663.log 2024-05-15T19:05:31.343 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.402020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504900.log 2024-05-15T19:05:31.343 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.436868.log.gz 2024-05-15T19:05:31.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-15T19:05:31.344 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.437291.log.gz 2024-05-15T19:05:31.344 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.488663.log: /var/log/ceph/ceph-client.admin.504900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356987.log 2024-05-15T19:05:31.344 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544382.log 2024-05-15T19:05:31.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359511.log 2024-05-15T19:05:31.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.356987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211542.log 2024-05-15T19:05:31.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.544382.log: /var/log/ceph/ceph-client.admin.359511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275369.log 2024-05-15T19:05:31.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196268.log 2024-05-15T19:05:31.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.211542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344832.log 2024-05-15T19:05:31.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.196268.log: /var/log/ceph/ceph-client.admin.275369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42401.log 2024-05-15T19:05:31.347 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386740.log 2024-05-15T19:05:31.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.344832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249063.log 2024-05-15T19:05:31.348 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.386740.log: /var/log/ceph/ceph-client.admin.42401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191305.log 2024-05-15T19:05:31.348 INFO:teuthology.orchestra.run.smithi077.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.548343.log.gz 2024-05-15T19:05:31.348 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482283.log 2024-05-15T19:05:31.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.249063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551920.log 2024-05-15T19:05:31.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.482283.log: /var/log/ceph/ceph-client.admin.191305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410056.log 2024-05-15T19:05:31.350 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408766.log 2024-05-15T19:05:31.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.551920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239425.log 2024-05-15T19:05:31.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.410056.log: /var/log/ceph/ceph-client.admin.408766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446250.log 2024-05-15T19:05:31.351 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564538.log 2024-05-15T19:05:31.351 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.239425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420960.log 2024-05-15T19:05:31.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.446250.log: /var/log/ceph/ceph-client.admin.564538.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.564538.log.gz 2024-05-15T19:05:31.352 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409212.log 2024-05-15T19:05:31.352 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384520.log 2024-05-15T19:05:31.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.420960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2024-05-15T19:05:31.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.384520.log: /var/log/ceph/ceph-client.admin.409212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435997.log 2024-05-15T19:05:31.354 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478211.log 2024-05-15T19:05:31.355 INFO:teuthology.orchestra.run.smithi077.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.561389.log.gz 2024-05-15T19:05:31.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.435997.log: /var/log/ceph/ceph-client.admin.44251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463748.log 2024-05-15T19:05:31.355 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549691.log 2024-05-15T19:05:31.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.478211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530879.log 2024-05-15T19:05:31.356 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.463748.log: /var/log/ceph/ceph-client.admin.549691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124278.log 2024-05-15T19:05:31.356 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544818.log 2024-05-15T19:05:31.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.530879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564633.log 2024-05-15T19:05:31.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.544818.log: /var/log/ceph/ceph-client.admin.124278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480927.log 2024-05-15T19:05:31.358 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501478.log 2024-05-15T19:05:31.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362067.log 2024-05-15T19:05:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.480927.log: /var/log/ceph/ceph-client.admin.501478.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.564633.log.gz 2024-05-15T19:05:31.363 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221556.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228053.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.362067.log: /var/log/ceph/ceph-client.admin.221556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341864.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.228053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463757.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.341864.log: --verbose -- /var/log/ceph/ceph-client.admin.114714.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.463757.log: /var/log/ceph/ceph-client.admin.114714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197614.log 2024-05-15T19:05:31.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208854.log 2024-05-15T19:05:31.365 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360357.log 2024-05-15T19:05:31.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.197614.log: /var/log/ceph/ceph-client.admin.208854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142490.log 2024-05-15T19:05:31.374 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515067.log 2024-05-15T19:05:31.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.360357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354407.log 2024-05-15T19:05:31.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142490.log: /var/log/ceph/ceph-client.admin.515067.log: gzip -5 --verbose -- 89.8% /var/log/ceph/ceph-client.admin.110078.log 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.530013.log.gz 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.531314.log.gz 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.354407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525349.log 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423586.log 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.525349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553701.log 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.423586.log: /var/log/ceph/ceph-client.admin.46643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367239.log 2024-05-15T19:05:31.375 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.461972.log.gz 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418497.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.553701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371058.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.367239.log: /var/log/ceph/ceph-client.admin.418497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44575.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.371058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129442.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.44575.log: --verbose -- /var/log/ceph/ceph-client.admin.557329.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531323.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129442.log: /var/log/ceph/ceph-client.admin.557329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137659.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.531323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183140.log 2024-05-15T19:05:31.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565561.log 2024-05-15T19:05:31.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137659.log: /var/log/ceph/ceph-client.admin.183140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417865.log 2024-05-15T19:05:31.377 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233203.log 2024-05-15T19:05:31.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.417865.log: /var/log/ceph/ceph-client.admin.565561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479960.log 2024-05-15T19:05:31.380 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407883.log 2024-05-15T19:05:31.380 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.565561.log.gz 2024-05-15T19:05:31.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.479960.log: /var/log/ceph/ceph-client.admin.233203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494789.log 2024-05-15T19:05:31.380 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496487.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.407883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523648.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.496487.log: /var/log/ceph/ceph-client.admin.494789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378326.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348655.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.523648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218585.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.348655.log: /var/log/ceph/ceph-client.admin.378326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263219.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.218585.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.428707.log.gz 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191296.log 2024-05-15T19:05:31.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.263219.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43189.log 2024-05-15T19:05:31.385 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236708.log 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43189.log: /var/log/ceph/ceph-client.admin.191296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542621.log 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.236708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479503.log 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.542621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342715.log 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.364677.log.gz 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127313.log 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.479503.log: /var/log/ceph/ceph-client.admin.342715.log: /var/log/ceph/ceph-client.admin.127313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446478.log 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.224002.log.gz 2024-05-15T19:05:31.386 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536815.log 2024-05-15T19:05:31.387 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.365108.log.gz 2024-05-15T19:05:31.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44449.log 2024-05-15T19:05:31.387 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.446478.log: /var/log/ceph/ceph-client.admin.536815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109632.log 2024-05-15T19:05:31.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486083.log 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109632.log: /var/log/ceph/ceph-client.admin.44449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530888.log 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273050.log 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.530888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434290.log 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.486083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380879.log 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.434290.log: /var/log/ceph/ceph-client.admin.273050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109140.log 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.427017.log.gz 2024-05-15T19:05:31.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.380879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131568.log 2024-05-15T19:05:31.390 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417013.log 2024-05-15T19:05:31.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183587.log 2024-05-15T19:05:31.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.417013.log: /var/log/ceph/ceph-client.admin.131568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238976.log 2024-05-15T19:05:31.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460579.log 2024-05-15T19:05:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.238976.log: /var/log/ceph/ceph-client.admin.183587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43063.log 2024-05-15T19:05:31.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.460579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179182.log 2024-05-15T19:05:31.393 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213255.log 2024-05-15T19:05:31.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228914.log 2024-05-15T19:05:31.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.213255.log: /var/log/ceph/ceph-client.admin.179182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140281.log 2024-05-15T19:05:31.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241432.log 2024-05-15T19:05:31.394 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.228914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342706.log 2024-05-15T19:05:31.395 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140281.log: /var/log/ceph/ceph-client.admin.241432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219854.log 2024-05-15T19:05:31.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42579.log 2024-05-15T19:05:31.395 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180475.log 2024-05-15T19:05:31.398 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.342706.log: /var/log/ceph/ceph-client.admin.42579.log: /var/log/ceph/ceph-client.admin.219854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142037.log 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.380888.log.gz 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.385376.log.gz 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.180475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109641.log 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418272.log 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.389252.log.gz 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109641.log: /var/log/ceph/ceph-client.admin.142037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198074.log 2024-05-15T19:05:31.399 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470812.log 2024-05-15T19:05:31.400 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379188.log 2024-05-15T19:05:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.418272.log: /var/log/ceph/ceph-client.admin.470812.log: /var/log/ceph/ceph-client.admin.198074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351787.log 2024-05-15T19:05:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490879.log 2024-05-15T19:05:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.379188.log: 76.6% -- replaced with /var/log/ceph/ceph-client.admin.540668.log.gz 2024-05-15T19:05:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386731.log 2024-05-15T19:05:31.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265786.log 2024-05-15T19:05:31.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.351787.log: /var/log/ceph/ceph-client.admin.490879.log: /var/log/ceph/ceph-client.admin.386731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464610.log 2024-05-15T19:05:31.402 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473851.log 2024-05-15T19:05:31.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.265786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228044.log 2024-05-15T19:05:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.473851.log: /var/log/ceph/ceph-client.admin.464610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426585.log 2024-05-15T19:05:31.403 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125114.log 2024-05-15T19:05:31.404 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.228044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565729.log 2024-05-15T19:05:31.404 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125114.log: /var/log/ceph/ceph-client.admin.426585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121231.log 2024-05-15T19:05:31.405 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555059.log 2024-05-15T19:05:31.405 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121231.log: /var/log/ceph/ceph-client.admin.565729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485660.log 2024-05-15T19:05:31.407 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130712.log 2024-05-15T19:05:31.408 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.485660.log: /var/log/ceph/ceph-client.admin.555059.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.565729.log.gz 2024-05-15T19:05:31.408 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-15T19:05:31.408 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%/var/log/ceph/ceph-client.admin.130712.log: -- replaced with /var/log/ceph/ceph-client.admin.360366.log.gz 2024-05-15T19:05:31.408 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342292.log 2024-05-15T19:05:31.411 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-05-15T19:05:31.411 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539475.log 2024-05-15T19:05:31.412 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.342292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444101.log 2024-05-15T19:05:31.412 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43231.log: /var/log/ceph/ceph-client.admin.539475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435574.log 2024-05-15T19:05:31.412 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228923.log 2024-05-15T19:05:31.412 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.444101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46112.log 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.435574.log: /var/log/ceph/ceph-client.admin.228923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268435.log 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370644.log 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46112.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.473842.log.gz 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.268435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158526.log 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.370644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501239.log 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441947.log 2024-05-15T19:05:31.416 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47074.log 2024-05-15T19:05:31.417 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.501239.log: /var/log/ceph/ceph-client.admin.441947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446120.log 2024-05-15T19:05:31.418 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176086.log 2024-05-15T19:05:31.418 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495213.log 2024-05-15T19:05:31.418 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.176086.log: /var/log/ceph/ceph-client.admin.446120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347820.log 2024-05-15T19:05:31.418 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245381.log 2024-05-15T19:05:31.419 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.495213.log: /var/log/ceph/ceph-client.admin.245381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132837.log 2024-05-15T19:05:31.419 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7%/var/log/ceph/ceph-client.admin.347820.log: -- replaced with /var/log/ceph/ceph-client.admin.499514.log.gz 2024-05-15T19:05:31.419 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119520.log 2024-05-15T19:05:31.420 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222038.log 2024-05-15T19:05:31.420 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345683.log 2024-05-15T19:05:31.421 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433021.log 2024-05-15T19:05:31.421 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.345683.log: /var/log/ceph/ceph-client.admin.222038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463302.log 2024-05-15T19:05:31.422 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411802.log 2024-05-15T19:05:31.422 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.433021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257180.log 2024-05-15T19:05:31.422 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.411802.log: /var/log/ceph/ceph-client.admin.463302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497338.log 2024-05-15T19:05:31.423 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133262.log 2024-05-15T19:05:31.423 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.497338.log: /var/log/ceph/ceph-client.admin.257180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225927.log 2024-05-15T19:05:31.424 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42895.log 2024-05-15T19:05:31.424 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.133262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543482.log 2024-05-15T19:05:31.425 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.225927.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.457920.log.gz 2024-05-15T19:05:31.425 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349099.log 2024-05-15T19:05:31.425 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517977.log 2024-05-15T19:05:31.427 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.349099.log: /var/log/ceph/ceph-client.admin.543482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263210.log 2024-05-15T19:05:31.427 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T19:05:31.427 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488248.log 2024-05-15T19:05:31.428 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.263210.log: /var/log/ceph/ceph-client.admin.517977.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.556893.log.gz 2024-05-15T19:05:31.428 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48189.log 2024-05-15T19:05:31.428 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461558.log.gz 2024-05-15T19:05:31.428 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535424.log 2024-05-15T19:05:31.429 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48189.log: /var/log/ceph/ceph-client.admin.488248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276251.log 2024-05-15T19:05:31.429 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350486.log 2024-05-15T19:05:31.430 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.535424.log: /var/log/ceph/ceph-client.admin.276251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472983.log 2024-05-15T19:05:31.431 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.350486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468580.log 2024-05-15T19:05:31.431 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483465.log 2024-05-15T19:05:31.432 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.472983.log: /var/log/ceph/ceph-client.admin.468580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435988.log 2024-05-15T19:05:31.433 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108137.log 2024-05-15T19:05:31.433 INFO:teuthology.orchestra.run.smithi077.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.475270.log.gz 2024-05-15T19:05:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.483465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145962.log 2024-05-15T19:05:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.435988.log: /var/log/ceph/ceph-client.admin.108137.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.477160.log.gz 2024-05-15T19:05:31.434 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362554.log 2024-05-15T19:05:31.435 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564404.log 2024-05-15T19:05:31.436 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159669.log 2024-05-15T19:05:31.436 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.362554.log: /var/log/ceph/ceph-client.admin.564404.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.564404.log.gz 2024-05-15T19:05:31.436 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533657.log 2024-05-15T19:05:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155471.log 2024-05-15T19:05:31.438 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462409.log 2024-05-15T19:05:31.438 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.533657.log: /var/log/ceph/ceph-client.admin.155471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501230.log 2024-05-15T19:05:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.462409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471236.log 2024-05-15T19:05:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195798.log 2024-05-15T19:05:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.471236.log: /var/log/ceph/ceph-client.admin.501230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259834.log 2024-05-15T19:05:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447343.log 2024-05-15T19:05:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.195798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436444.log 2024-05-15T19:05:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.447343.log: /var/log/ceph/ceph-client.admin.259834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537729.log 2024-05-15T19:05:31.442 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.436444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232779.log 2024-05-15T19:05:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351778.log 2024-05-15T19:05:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.537729.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.134957.log.gz 2024-05-15T19:05:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.232779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349090.log 2024-05-15T19:05:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.351778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43581.log 2024-05-15T19:05:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380466.log 2024-05-15T19:05:31.444 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.216831.log.gz 2024-05-15T19:05:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.349090.log: /var/log/ceph/ceph-client.admin.43581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481360.log 2024-05-15T19:05:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383607.log 2024-05-15T19:05:31.446 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.380466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555988.log 2024-05-15T19:05:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.383607.log: /var/log/ceph/ceph-client.admin.481360.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.259834.log.gz 2024-05-15T19:05:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493028.log 2024-05-15T19:05:31.447 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.218585.log.gz 2024-05-15T19:05:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565645.log 2024-05-15T19:05:31.448 INFO:teuthology.orchestra.run.smithi077.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.412216.log.gz 2024-05-15T19:05:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.555988.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.379188.log.gz 2024-05-15T19:05:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.493028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256324.log 2024-05-15T19:05:31.449 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47754.log 2024-05-15T19:05:31.449 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565645.log: /var/log/ceph/ceph-client.admin.256324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553692.log 2024-05-15T19:05:31.450 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.565645.log.gz 2024-05-15T19:05:31.450 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462870.log 2024-05-15T19:05:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.553692.log: /var/log/ceph/ceph-client.admin.47754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113140.log 2024-05-15T19:05:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427855.log 2024-05-15T19:05:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.113140.log: /var/log/ceph/ceph-client.admin.462870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193085.log 2024-05-15T19:05:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267093.log 2024-05-15T19:05:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.193085.log: /var/log/ceph/ceph-client.admin.427855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243189.log 2024-05-15T19:05:31.453 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.402020.log.gz 2024-05-15T19:05:31.453 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.406615.log.gz 2024-05-15T19:05:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.267093.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.407883.log.gz 2024-05-15T19:05:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219422.log 2024-05-15T19:05:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510449.log 2024-05-15T19:05:31.455 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.263210.log.gz 2024-05-15T19:05:31.455 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.406624.log.gz 2024-05-15T19:05:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.219422.log: /var/log/ceph/ceph-client.admin.243189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-05-15T19:05:31.455 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.407892.log.gz 2024-05-15T19:05:31.457 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410479.log 2024-05-15T19:05:31.457 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.510449.log: /var/log/ceph/ceph-client.admin.43916.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.235825.log.gz 2024-05-15T19:05:31.457 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.235410.log.gz 2024-05-15T19:05:31.457 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388753.log 2024-05-15T19:05:31.457 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155970.log 2024-05-15T19:05:31.458 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.410479.log: /var/log/ceph/ceph-client.admin.388753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466732.log 2024-05-15T19:05:31.459 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444528.log 2024-05-15T19:05:31.459 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.466732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206303.log 2024-05-15T19:05:31.460 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.444528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113803.log 2024-05-15T19:05:31.460 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46391.log.gz 2024-05-15T19:05:31.460 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.206303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378748.log 2024-05-15T19:05:31.461 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.113803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113366.log 2024-05-15T19:05:31.462 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140709.log 2024-05-15T19:05:31.462 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.378748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142028.log 2024-05-15T19:05:31.463 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140709.log: /var/log/ceph/ceph-client.admin.113366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224465.log 2024-05-15T19:05:31.464 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262363.log 2024-05-15T19:05:31.464 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142028.log: /var/log/ceph/ceph-client.admin.224465.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.124701.log.gz 2024-05-15T19:05:31.464 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503600.log 2024-05-15T19:05:31.465 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.262363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410488.log 2024-05-15T19:05:31.466 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343561.log 2024-05-15T19:05:31.466 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.503600.log: /var/log/ceph/ceph-client.admin.410488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211118.log 2024-05-15T19:05:31.467 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262372.log 2024-05-15T19:05:31.467 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.211118.log: /var/log/ceph/ceph-client.admin.343561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384046.log 2024-05-15T19:05:31.468 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348233.log 2024-05-15T19:05:31.468 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.262372.log: /var/log/ceph/ceph-client.admin.384046.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.109632.log.gz 2024-05-15T19:05:31.468 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480440.log 2024-05-15T19:05:31.469 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527044.log 2024-05-15T19:05:31.470 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.348233.log: /var/log/ceph/ceph-client.admin.480440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546544.log 2024-05-15T19:05:31.470 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490033.log 2024-05-15T19:05:31.471 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.546544.log: /var/log/ceph/ceph-client.admin.527044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277954.log 2024-05-15T19:05:31.472 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.123855.log.gz 2024-05-15T19:05:31.472 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.490033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46028.log 2024-05-15T19:05:31.472 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251624.log 2024-05-15T19:05:31.473 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.277954.log: /var/log/ceph/ceph-client.admin.46028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182265.log 2024-05-15T19:05:31.473 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479070.log 2024-05-15T19:05:31.474 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.251624.log: /var/log/ceph/ceph-client.admin.182265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115552.log 2024-05-15T19:05:31.475 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540910.log 2024-05-15T19:05:31.476 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.479070.log: /var/log/ceph/ceph-client.admin.115552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540677.log 2024-05-15T19:05:31.476 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353138.log 2024-05-15T19:05:31.476 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.540910.log: /var/log/ceph/ceph-client.admin.540677.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.487345.log.gz 2024-05-15T19:05:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47500.log 2024-05-15T19:05:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264487.log 2024-05-15T19:05:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47500.log: /var/log/ceph/ceph-client.admin.353138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244464.log 2024-05-15T19:05:31.479 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.264487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500977.log 2024-05-15T19:05:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219845.log 2024-05-15T19:05:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.500977.log: /var/log/ceph/ceph-client.admin.244464.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.535883.log.gz 2024-05-15T19:05:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470345.log 2024-05-15T19:05:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.219845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120008.log 2024-05-15T19:05:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493942.log 2024-05-15T19:05:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.470345.log: /var/log/ceph/ceph-client.admin.120008.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.483465.log.gz 2024-05-15T19:05:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458766.log 2024-05-15T19:05:31.483 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.493942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255896.log 2024-05-15T19:05:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486931.log 2024-05-15T19:05:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.458766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155462.log 2024-05-15T19:05:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.486931.log: /var/log/ceph/ceph-client.admin.255896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406030.log 2024-05-15T19:05:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360789.log 2024-05-15T19:05:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481839.log 2024-05-15T19:05:31.487 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.406030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138979.log 2024-05-15T19:05:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.360789.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-15T19:05:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.481839.log: /var/log/ceph/ceph-client.admin.138979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255031.log 2024-05-15T19:05:31.489 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535001.log 2024-05-15T19:05:31.489 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.255031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126427.log 2024-05-15T19:05:31.490 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.535001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203331.log 2024-05-15T19:05:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108128.log 2024-05-15T19:05:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126427.log: /var/log/ceph/ceph-client.admin.203331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352200.log 2024-05-15T19:05:31.492 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.108128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232788.log 2024-05-15T19:05:31.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.352200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498669.log 2024-05-15T19:05:31.493 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.232788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223549.log 2024-05-15T19:05:31.494 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.498669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119529.log 2024-05-15T19:05:31.494 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.248649.log.gz 2024-05-15T19:05:31.495 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521948.log 2024-05-15T19:05:31.496 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.223549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125537.log 2024-05-15T19:05:31.496 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119529.log: /var/log/ceph/ceph-client.admin.521948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236699.log 2024-05-15T19:05:31.497 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.380466.log.gz 2024-05-15T19:05:31.497 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.131568.log.gz 2024-05-15T19:05:31.497 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392158.log 2024-05-15T19:05:31.498 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.236699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209297.log 2024-05-15T19:05:31.498 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.133262.log.gz 2024-05-15T19:05:31.499 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.383607.log.gz 2024-05-15T19:05:31.499 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.392158.log: /var/log/ceph/ceph-client.admin.47457.log 2024-05-15T19:05:31.499 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226783.log 2024-05-15T19:05:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.209297.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.426585.log.gz 2024-05-15T19:05:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203340.log 2024-05-15T19:05:31.501 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.425748.log.gz 2024-05-15T19:05:31.501 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.226783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273917.log 2024-05-15T19:05:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479079.log 2024-05-15T19:05:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.273917.log: /var/log/ceph/ceph-client.admin.203340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527892.log 2024-05-15T19:05:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474267.log 2024-05-15T19:05:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.527892.log: /var/log/ceph/ceph-client.admin.479079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229761.log 2024-05-15T19:05:31.504 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.504900.log.gz 2024-05-15T19:05:31.505 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.474267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528307.log 2024-05-15T19:05:31.505 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443649.log 2024-05-15T19:05:31.506 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.528307.log: /var/log/ceph/ceph-client.admin.229761.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.158517.log.gz 2024-05-15T19:05:31.506 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478639.log 2024-05-15T19:05:31.506 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370635.log 2024-05-15T19:05:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.443649.log: /var/log/ceph/ceph-client.admin.478639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224945.log 2024-05-15T19:05:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540413.log 2024-05-15T19:05:31.508 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.224945.log: /var/log/ceph/ceph-client.admin.370635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342283.log 2024-05-15T19:05:31.509 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554138.log 2024-05-15T19:05:31.510 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.342283.log: /var/log/ceph/ceph-client.admin.540413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458343.log 2024-05-15T19:05:31.510 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418175.log 2024-05-15T19:05:31.511 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.458343.log: /var/log/ceph/ceph-client.admin.554138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135822.log 2024-05-15T19:05:31.511 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527035.log 2024-05-15T19:05:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.135822.log: /var/log/ceph/ceph-client.admin.418175.log: 90.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.472505.log.gz -5 2024-05-15T19:05:31.512 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2024-05-15T19:05:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.527035.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.227206.log 2024-05-15T19:05:31.512 INFO:teuthology.orchestra.run.smithi077.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.445832.log.gz 2024-05-15T19:05:31.513 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.446478.log.gz 2024-05-15T19:05:31.513 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537272.log 2024-05-15T19:05:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44252.log: /var/log/ceph/ceph-client.admin.227206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416581.log 2024-05-15T19:05:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.537272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43357.log 2024-05-15T19:05:31.515 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.372008.log.gz 2024-05-15T19:05:31.515 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.373952.log.gz 2024-05-15T19:05:31.516 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193989.log 2024-05-15T19:05:31.516 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.416581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489546.log 2024-05-15T19:05:31.517 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43357.log: /var/log/ceph/ceph-client.admin.193989.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.375223.log.gz 2024-05-15T19:05:31.517 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496067.log 2024-05-15T19:05:31.518 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499523.log 2024-05-15T19:05:31.518 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.489546.log: /var/log/ceph/ceph-client.admin.496067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564362.log 2024-05-15T19:05:31.519 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.499523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469004.log 2024-05-15T19:05:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556449.log 2024-05-15T19:05:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.469004.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.564362.log.gz 2024-05-15T19:05:31.521 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181812.log 2024-05-15T19:05:31.522 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.556449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541771.log 2024-05-15T19:05:31.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.181812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423577.log 2024-05-15T19:05:31.523 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.541771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423155.log 2024-05-15T19:05:31.524 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373474.log 2024-05-15T19:05:31.524 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.423577.log: /var/log/ceph/ceph-client.admin.423155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241880.log 2024-05-15T19:05:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358253.log 2024-05-15T19:05:31.525 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.373474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414778.log 2024-05-15T19:05:31.526 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.358253.log: /var/log/ceph/ceph-client.admin.241880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528741.log 2024-05-15T19:05:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473406.log 2024-05-15T19:05:31.527 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.414778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565519.log 2024-05-15T19:05:31.528 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.528741.log: /var/log/ceph/ceph-client.admin.473406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227197.log 2024-05-15T19:05:31.529 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442369.log 82.8% 2024-05-15T19:05:31.529 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.554138.log.gz 2024-05-15T19:05:31.530 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496058.log 2024-05-15T19:05:31.531 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.227197.log: /var/log/ceph/ceph-client.admin.442369.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.565519.log.gz 2024-05-15T19:05:31.531 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44701.log 2024-05-15T19:05:31.531 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206294.log 2024-05-15T19:05:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.496058.log: /var/log/ceph/ceph-client.admin.44701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46154.log 2024-05-15T19:05:31.533 INFO:teuthology.orchestra.run.smithi077.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.209297.log.gz 2024-05-15T19:05:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543473.log 2024-05-15T19:05:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.206294.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.444528.log.gz 2024-05-15T19:05:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134539.log 2024-05-15T19:05:31.533 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46154.log: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.406030.log.gz 2024-05-15T19:05:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.543473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486922.log 2024-05-15T19:05:31.534 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545254.log 2024-05-15T19:05:31.535 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469921.log 2024-05-15T19:05:31.535 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.486922.log: /var/log/ceph/ceph-client.admin.545254.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.435997.log.gz 2024-05-15T19:05:31.535 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547448.log 2024-05-15T19:05:31.535 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433440.log 2024-05-15T19:05:31.536 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.469921.log: /var/log/ceph/ceph-client.admin.547448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221547.log 2024-05-15T19:05:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.433440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386284.log 2024-05-15T19:05:31.537 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353993.log 2024-05-15T19:05:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.221547.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.142490.log.gz 2024-05-15T19:05:31.539 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.386284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430860.log 2024-05-15T19:05:31.539 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.140281.log.gz 2024-05-15T19:05:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149063.log 2024-05-15T19:05:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.353993.log: /var/log/ceph/ceph-client.admin.430860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186808.log 2024-05-15T19:05:31.541 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379179.log 2024-05-15T19:05:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151249.log 2024-05-15T19:05:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.186808.log: /var/log/ceph/ceph-client.admin.379179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493019.log 2024-05-15T19:05:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107702.log 2024-05-15T19:05:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.493019.log: /var/log/ceph/ceph-client.admin.151249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205878.log 2024-05-15T19:05:31.544 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.107702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202908.log 2024-05-15T19:05:31.544 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.115137.log.gz 2024-05-15T19:05:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275818.log 2024-05-15T19:05:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.205878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246460.log 2024-05-15T19:05:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.275818.log: /var/log/ceph/ceph-client.admin.202908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418166.log 2024-05-15T19:05:31.547 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113812.log 2024-05-15T19:05:31.547 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.246460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202485.log 2024-05-15T19:05:31.548 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.113812.log: /var/log/ceph/ceph-client.admin.418166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244040.log 2024-05-15T19:05:31.548 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47457.log.gz 2024-05-15T19:05:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47754.log.gz 2024-05-15T19:05:31.550 INFO:teuthology.orchestra.run.smithi077.stderr: -5/var/log/ceph/ceph-client.admin.244040.log: --verbose -- /var/log/ceph/ceph-client.admin.367230.log 2024-05-15T19:05:31.550 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.202485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441956.log 2024-05-15T19:05:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.367230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443658.log 2024-05-15T19:05:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.441956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382646.log 2024-05-15T19:05:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.443658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266677.log 2024-05-15T19:05:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.382646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.482847.log 2024-05-15T19:05:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.266677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46469.log/var/log/ceph/ceph-client.admin.482847.log: 2024-05-15T19:05:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538196.log 2024-05-15T19:05:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472082.log 2024-05-15T19:05:31.558 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.113366.log.gz 2024-05-15T19:05:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.538196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551483.log 2024-05-15T19:05:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.472082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184543.log 2024-05-15T19:05:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433868.log 2024-05-15T19:05:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.184543.log: /var/log/ceph/ceph-client.admin.551483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414302.log 2024-05-15T19:05:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136285.log 2024-05-15T19:05:31.559 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.433868.log: /var/log/ceph/ceph-client.admin.414302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273486.log 2024-05-15T19:05:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477169.log 2024-05-15T19:05:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136285.log: /var/log/ceph/ceph-client.admin.273486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235401.log 2024-05-15T19:05:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180484.log 2024-05-15T19:05:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.477169.log: /var/log/ceph/ceph-client.admin.235401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147306.log 2024-05-15T19:05:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.180484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195789.log 2024-05-15T19:05:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147306.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-15T19:05:31.564 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.195789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256743.log 2024-05-15T19:05:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446241.log 2024-05-15T19:05:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252480.log 2024-05-15T19:05:31.565 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.256743.log: /var/log/ceph/ceph-client.admin.446241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349518.log 2024-05-15T19:05:31.566 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252061.log 2024-05-15T19:05:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.252480.log: /var/log/ceph/ceph-client.admin.349518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491318.log 2024-05-15T19:05:31.569 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.252061.log: gzip -5 --verbose -- 81.6% /var/log/ceph/ceph-client.admin.529588.log 2024-05-15T19:05:31.569 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.515057.log.gz 2024-05-15T19:05:31.569 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.491318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355720.log 2024-05-15T19:05:31.570 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.529588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547457.log 2024-05-15T19:05:31.570 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.355720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142499.log 2024-05-15T19:05:31.571 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181388.log 2024-05-15T19:05:31.571 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.547457.log: /var/log/ceph/ceph-client.admin.142499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483888.log 2024-05-15T19:05:31.572 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.262372.log.gz 2024-05-15T19:05:31.572 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186799.log 2024-05-15T19:05:31.572 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.483888.log: /var/log/ceph/ceph-client.admin.181388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274366.log 2024-05-15T19:05:31.573 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202071.log 2024-05-15T19:05:31.574 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.186799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437723.log 2024-05-15T19:05:31.574 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.274366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193980.log 2024-05-15T19:05:31.574 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.202071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543959.log 2024-05-15T19:05:31.575 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.193980.log: /var/log/ceph/ceph-client.admin.437723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476257.log 2024-05-15T19:05:31.575 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.543959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106669.log 2024-05-15T19:05:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.476257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457074.log 2024-05-15T19:05:31.576 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.106669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380457.log 2024-05-15T19:05:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.457074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196711.log 2024-05-15T19:05:31.578 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106660.log/var/log/ceph/ceph-client.admin.380457.log: 2024-05-15T19:05:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.196711.log: gzip 80.8% -- replaced with /var/log/ceph/ceph-client.admin.236699.log.gz 2024-05-15T19:05:31.581 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.366803.log 2024-05-15T19:05:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.106660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263643.log 2024-05-15T19:05:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.366803.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.178249.log 2024-05-15T19:05:31.581 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.125537.log.gz 2024-05-15T19:05:31.581 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.263643.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.425311.log 2024-05-15T19:05:31.582 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464601.log 2024-05-15T19:05:31.585 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.178249.log: /var/log/ceph/ceph-client.admin.425311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533666.log 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.433440.log.gz 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424437.log 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.464601.log: /var/log/ceph/ceph-client.admin.533666.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.227197.log.gz 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107270.log 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.424437.log: --verbose -- /var/log/ceph/ceph-client.admin.233645.log 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.107270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267978.log 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.229761.log.gz 2024-05-15T19:05:31.586 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.233645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278372.log 2024-05-15T19:05:31.587 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.267978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44491.log 2024-05-15T19:05:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.278372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274867.log 2024-05-15T19:05:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469013.log 2024-05-15T19:05:31.588 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.267093.log.gz 2024-05-15T19:05:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44491.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.266677.log.gz 2024-05-15T19:05:31.588 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.274867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350940.log 2024-05-15T19:05:31.589 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.437714.log.gz 2024-05-15T19:05:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432152.log 2024-05-15T19:05:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.469013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178691.log 2024-05-15T19:05:31.590 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.350940.log: /var/log/ceph/ceph-client.admin.432152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122559.log 2024-05-15T19:05:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199421.log 2024-05-15T19:05:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.178691.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.186808.log.gz 2024-05-15T19:05:31.591 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536806.log 2024-05-15T19:05:31.592 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.199421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408757.log 2024-05-15T19:05:31.593 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.536806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184981.log 2024-05-15T19:05:31.594 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.408757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339303.log 2024-05-15T19:05:31.594 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-15T19:05:31.594 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.184981.log: /var/log/ceph/ceph-client.admin.339303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410065.log 2024-05-15T19:05:31.595 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.505320.log.gz 2024-05-15T19:05:31.595 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43578.log 2024-05-15T19:05:31.596 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198978.log 2024-05-15T19:05:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.410065.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-15T19:05:31.597 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43578.log: /var/log/ceph/ceph-client.admin.198978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437300.log 2024-05-15T19:05:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238967.log 2024-05-15T19:05:31.598 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.437300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-05-15T19:05:31.599 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.238967.log: -- /var/log/ceph/ceph-client.admin.565811.log 2024-05-15T19:05:31.599 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187654.log 2024-05-15T19:05:31.600 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535433.log 2024-05-15T19:05:31.601 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244455.log 2024-05-15T19:05:31.601 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.187654.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.565811.log.gz 2024-05-15T19:05:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 84.1% -- replaced with /var/log/ceph/ceph-client.admin.498669.log.gz 2024-05-15T19:05:31.602 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.150359.log 2024-05-15T19:05:31.602 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.535433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155961.log 2024-05-15T19:05:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.244455.log: /var/log/ceph/ceph-client.admin.150359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108638.log 2024-05-15T19:05:31.603 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495204.log 2024-05-15T19:05:31.604 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197171.log 2024-05-15T19:05:31.604 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.108638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513569.log 2024-05-15T19:05:31.605 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.495204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404215.log 2024-05-15T19:05:31.606 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.197171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545676.log 2024-05-15T19:05:31.606 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.513569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344408.log 2024-05-15T19:05:31.607 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.404215.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.527035.log.gz 2024-05-15T19:05:31.607 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353561.log 2024-05-15T19:05:31.608 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.545676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546131.log 2024-05-15T19:05:31.608 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.344408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273059.log 2024-05-15T19:05:31.609 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.353561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225461.log 2024-05-15T19:05:31.609 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.546131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367666.log 2024-05-15T19:05:31.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.273059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159208.log 2024-05-15T19:05:31.610 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.225461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47710.log 2024-05-15T19:05:31.611 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.367666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529579.log 2024-05-15T19:05:31.612 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159208.log: /var/log/ceph/ceph-client.admin.47710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416121.log 2024-05-15T19:05:31.612 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231506.log 2024-05-15T19:05:31.613 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.529579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134530.log 2024-05-15T19:05:31.613 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.416121.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.382646.log.gz 2024-05-15T19:05:31.614 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139408.log 2024-05-15T19:05:31.614 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.231506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535892.log 2024-05-15T19:05:31.615 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339294.log 2024-05-15T19:05:31.615 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139408.log: /var/log/ceph/ceph-client.admin.535892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416130.log 2024-05-15T19:05:31.616 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377895.log 2024-05-15T19:05:31.616 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.339294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264073.log 2024-05-15T19:05:31.617 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.416130.log: /var/log/ceph/ceph-client.admin.377895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516544.log 2024-05-15T19:05:31.618 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565165.log 2024-05-15T19:05:31.618 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.264073.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-15T19:05:31.620 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.516544.log: /var/log/ceph/ceph-client.admin.565165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359934.log 2024-05-15T19:05:31.620 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.366803.log.gz 2024-05-15T19:05:31.620 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42663.log 2024-05-15T19:05:31.621 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9%/var/log/ceph/ceph-client.admin.359934.log: -- replaced with /var/log/ceph/ceph-client.admin.565165.log.gz 2024-05-15T19:05:31.621 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115561.log 2024-05-15T19:05:31.623 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.42663.log: /var/log/ceph/ceph-client.admin.176942.log 2024-05-15T19:05:31.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.115561.log: gzip -5 --verbose 84.1% -- replaced with /var/log/ceph/ceph-client.admin.354863.log.gz 2024-05-15T19:05:31.624 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.237670.log 2024-05-15T19:05:31.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.176942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188955.log 2024-05-15T19:05:31.624 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.237670.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.231515.log 2024-05-15T19:05:31.624 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184052.log 2024-05-15T19:05:31.624 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.188955.log: /var/log/ceph/ceph-client.admin.231515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230607.log 2024-05-15T19:05:31.625 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175663.log 2024-05-15T19:05:31.625 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.343129.log.gz/var/log/ceph/ceph-client.admin.184052.log: 2024-05-15T19:05:31.626 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.230607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208426.log 2024-05-15T19:05:31.626 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253328.log 2024-05-15T19:05:31.627 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.175663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249500.log 2024-05-15T19:05:31.627 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.253328.log: /var/log/ceph/ceph-client.admin.208426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456188.log 2024-05-15T19:05:31.628 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.344841.log.gz 2024-05-15T19:05:31.628 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.249500.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.346961.log.gz 2024-05-15T19:05:31.628 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249072.log 2024-05-15T19:05:31.628 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.456188.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.347389.log.gz 2024-05-15T19:05:31.629 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481848.log 2024-05-15T19:05:31.629 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341440.log 2024-05-15T19:05:31.630 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.249072.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.348664.log.gz 2024-05-15T19:05:31.630 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375232.log 2024-05-15T19:05:31.631 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.347398.log.gz 2024-05-15T19:05:31.631 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.481848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510458.log 2024-05-15T19:05:31.631 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.341440.log: /var/log/ceph/ceph-client.admin.375232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376112.log 2024-05-15T19:05:31.632 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190844.log 2024-05-15T19:05:31.632 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.510458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357822.log 2024-05-15T19:05:31.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.376112.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.417433.log.gz 2024-05-15T19:05:31.633 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.417013.log.gz 2024-05-15T19:05:31.633 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.190844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430421.log 2024-05-15T19:05:31.635 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402895.log 2024-05-15T19:05:31.635 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.357822.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.423586.log.gz 2024-05-15T19:05:31.635 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387732.log 2024-05-15T19:05:31.635 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.430421.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.416121.log.gz 2024-05-15T19:05:31.636 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177797.log 2024-05-15T19:05:31.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.402895.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.416581.log.gz 2024-05-15T19:05:31.636 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.387732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188077.log 2024-05-15T19:05:31.636 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.424437.log.gz --verbose -- 2024-05-15T19:05:31.637 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.199884.log 2024-05-15T19:05:31.637 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.177797.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.381734.log.gz 2024-05-15T19:05:31.638 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552365.log 2024-05-15T19:05:31.638 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.188077.log: /var/log/ceph/ceph-client.admin.199884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416590.log 2024-05-15T19:05:31.639 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247721.log 2024-05-15T19:05:31.640 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.552365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485234.log 90.0% -- replaced with /var/log/ceph/ceph-client.admin.246460.log.gz 2024-05-15T19:05:31.640 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.640 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.416590.log: /var/log/ceph/ceph-client.admin.247721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115984.log 2024-05-15T19:05:31.641 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.485234.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.149503.log 2024-05-15T19:05:31.642 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.521957.log.gz 2024-05-15T19:05:31.642 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.115984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351364.log 2024-05-15T19:05:31.642 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208002.log 2024-05-15T19:05:31.643 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378757.log 2024-05-15T19:05:31.643 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.351364.log: /var/log/ceph/ceph-client.admin.208002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134966.log 2024-05-15T19:05:31.643 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225936.log 2024-05-15T19:05:31.644 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.378757.log: /var/log/ceph/ceph-client.admin.134966.log: /var/log/ceph/ceph-client.admin.225936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410912.log 2024-05-15T19:05:31.644 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356987.log.gz 2024-05-15T19:05:31.645 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485225.log 2024-05-15T19:05:31.645 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.410912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130298.log 2024-05-15T19:05:31.647 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.485225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47933.log 2024-05-15T19:05:31.647 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.130298.log: /var/log/ceph/ceph-client.admin.147315.log/var/log/ceph/ceph-client.admin.47933.log: 2024-05-15T19:05:31.650 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220710.log 77.6% -- replaced with /var/log/ceph/ceph-client.admin.414778.log.gz 2024-05-15T19:05:31.651 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.147315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374799.log 2024-05-15T19:05:31.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.220710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260680.log 2024-05-15T19:05:31.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.374799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2024-05-15T19:05:31.651 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.260680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457506.log 2024-05-15T19:05:31.653 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245999.log 2024-05-15T19:05:31.653 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.457506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484745.log 2024-05-15T19:05:31.653 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256315.log 2024-05-15T19:05:31.653 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.422260.log.gz 2024-05-15T19:05:31.653 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.422688.log.gz 2024-05-15T19:05:31.654 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.484745.log: /var/log/ceph/ceph-client.admin.245999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522799.log 2024-05-15T19:05:31.654 INFO:teuthology.orchestra.run.smithi077.stderr: 78.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.404215.log.gz -5 --verbose 2024-05-15T19:05:31.654 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.356133.log 2024-05-15T19:05:31.655 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.256315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68834.log 2024-05-15T19:05:31.655 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.522799.log: /var/log/ceph/ceph-client.admin.356133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468589.log 2024-05-15T19:05:31.656 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146877.log 2024-05-15T19:05:31.657 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228500.log 2024-05-15T19:05:31.657 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.468589.log: /var/log/ceph/ceph-client.admin.146877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429565.log 2024-05-15T19:05:31.658 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.467152.log.gz 2024-05-15T19:05:31.658 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565081.log 2024-05-15T19:05:31.658 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%/var/log/ceph/ceph-client.admin.228500.log: -- replaced with /var/log/ceph/ceph-client.admin.465038.log.gzgzip 2024-05-15T19:05:31.658 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46238.log 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565081.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.178691.log.gz 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.565081.log.gz 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376971.log 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.429565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472992.log 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.134966.log.gz 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.376971.log: /var/log/ceph/ceph-client.admin.46238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564591.log 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.193980.log.gz 2024-05-15T19:05:31.660 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.193528.log.gz 2024-05-15T19:05:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.472992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535010.log 2024-05-15T19:05:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217254.log 2024-05-15T19:05:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543968.log 2024-05-15T19:05:31.662 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.187654.log.gz 2024-05-15T19:05:31.662 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.535010.log: /var/log/ceph/ceph-client.admin.217254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565123.log 2024-05-15T19:05:31.663 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.564591.log.gz 2024-05-15T19:05:31.663 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.543968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434718.log 2024-05-15T19:05:31.665 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527469.log 2024-05-15T19:05:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234069.log 2024-05-15T19:05:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.434718.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.565123.log.gz 2024-05-15T19:05:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111940.log 2024-05-15T19:05:31.666 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.527469.log: /var/log/ceph/ceph-client.admin.234069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359520.log 2024-05-15T19:05:31.669 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131982.log 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111940.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.359520.log: /var/log/ceph/ceph-client.admin.536358.log 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.131982.log: /var/log/ceph/ceph-client.admin.554593.log 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124692.log 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.536358.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.221547.log.gz 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486508.log 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.554593.log: gzip -5 --verbose -- 80.8% -- replaced with /var/log/ceph/ceph-client.admin.249063.log.gz 2024-05-15T19:05:31.670 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.383616.log 2024-05-15T19:05:31.671 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.124692.log: /var/log/ceph/ceph-client.admin.486508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351355.log 2024-05-15T19:05:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555068.log 2024-05-15T19:05:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.383616.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.233645.log.gz 2024-05-15T19:05:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.351355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46720.log 2024-05-15T19:05:31.672 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156940.log 2024-05-15T19:05:31.673 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.252904.log.gz 2024-05-15T19:05:31.673 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.555068.log: /var/log/ceph/ceph-client.admin.46720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246451.log 2024-05-15T19:05:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527883.log 2024-05-15T19:05:31.674 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156940.log: /var/log/ceph/ceph-client.admin.246451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210201.log 2024-05-15T19:05:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135394.log 2024-05-15T19:05:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.527883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467719.log 2024-05-15T19:05:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.210201.log: /var/log/ceph/ceph-client.admin.135394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502743.log 2024-05-15T19:05:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524080.log 2024-05-15T19:05:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.467719.log: /var/log/ceph/ceph-client.admin.502743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468157.log 2024-05-15T19:05:31.678 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.529579.log.gz 2024-05-15T19:05:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-05-15T19:05:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.524080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201221.log 2024-05-15T19:05:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.468157.log: /var/log/ceph/ceph-client.admin.47542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236262.log 2024-05-15T19:05:31.679 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.529588.log.gz 2024-05-15T19:05:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445381.log 2024-05-15T19:05:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.201221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224936.log 2024-05-15T19:05:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.236262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348242.log 2024-05-15T19:05:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.445381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400666.log 2024-05-15T19:05:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.348242.log: /var/log/ceph/ceph-client.admin.224936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444959.log 2024-05-15T19:05:31.682 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.538196.log.gz 2024-05-15T19:05:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539908.log 2024-05-15T19:05:31.683 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.249500.log.gz 2024-05-15T19:05:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.400666.log: /var/log/ceph/ceph-client.admin.444959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357400.log 2024-05-15T19:05:31.684 INFO:teuthology.orchestra.run.smithi083.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-15T19:05:31.686 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.539908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202062.log 2024-05-15T19:05:31.686 INFO:teuthology.orchestra.run.smithi077.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.463748.log.gz 2024-05-15T19:05:31.686 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418116.log/var/log/ceph/ceph-client.admin.357400.log: 2024-05-15T19:05:31.686 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565435.log 2024-05-15T19:05:31.686 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.202062.log: /var/log/ceph/ceph-client.admin.418116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145953.log 2024-05-15T19:05:31.689 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224456.log 2024-05-15T19:05:31.689 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565435.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.219422.log.gz 2024-05-15T19:05:31.689 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.145953.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.565435.log.gz 2024-05-15T19:05:31.689 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.530427.log 2024-05-15T19:05:31.689 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411333.log 2024-05-15T19:05:31.689 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.224456.log: /var/log/ceph/ceph-client.admin.530427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176505.log 2024-05-15T19:05:31.690 INFO:teuthology.orchestra.run.smithi077.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.244455.log.gz 2024-05-15T19:05:31.691 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.244040.log.gz 2024-05-15T19:05:31.691 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136714.log 2024-05-15T19:05:31.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.411333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192209.log 2024-05-15T19:05:31.691 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.176505.log: /var/log/ceph/ceph-client.admin.136714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418214.log 2024-05-15T19:05:31.693 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.192209.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.552365.log.gz 2024-05-15T19:05:31.694 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.557752.log 2024-05-15T19:05:31.694 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.418214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196259.log 2024-05-15T19:05:31.694 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.357822.log.gz 2024-05-15T19:05:31.694 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.277527.log.gz 2024-05-15T19:05:31.694 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457929.log 2024-05-15T19:05:31.694 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.557752.log: /var/log/ceph/ceph-client.admin.196259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274375.log 2024-05-15T19:05:31.695 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389261.log 2024-05-15T19:05:31.696 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.457929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505329.log 2024-05-15T19:05:31.696 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.274375.log: /var/log/ceph/ceph-client.admin.389261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180936.log 2024-05-15T19:05:31.696 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47979.log 2024-05-15T19:05:31.696 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.505329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223104.log 2024-05-15T19:05:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.180936.log: /var/log/ceph/ceph-client.admin.47979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565769.log 2024-05-15T19:05:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492166.log 2024-05-15T19:05:31.698 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.223104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375655.log 2024-05-15T19:05:31.698 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565769.log: /var/log/ceph/ceph-client.admin.492166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119999.log 2024-05-15T19:05:31.699 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.565769.log.gz 2024-05-15T19:05:31.699 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260248.log 2024-05-15T19:05:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.375655.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484321.log.gz 2024-05-15T19:05:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.119999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258979.log 2024-05-15T19:05:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495628.log 2024-05-15T19:05:31.701 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.260248.log: /var/log/ceph/ceph-client.admin.258979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185964.log 2024-05-15T19:05:31.702 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428716.log 2024-05-15T19:05:31.702 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.495628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458775.log 2024-05-15T19:05:31.703 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.185964.log: /var/log/ceph/ceph-client.admin.428716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43568.log 2024-05-15T19:05:31.703 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.458775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548805.log 2024-05-15T19:05:31.704 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267969.log 2024-05-15T19:05:31.705 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521101.log 2024-05-15T19:05:31.705 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.548805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496916.log 2024-05-15T19:05:31.705 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.267969.log: /var/log/ceph/ceph-client.admin.521101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555532.log 2024-05-15T19:05:31.706 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134104.log 2024-05-15T19:05:31.707 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.496916.log: /var/log/ceph/ceph-client.admin.555532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262786.log 2024-05-15T19:05:31.707 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563774.log 2024-05-15T19:05:31.708 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445841.log 2024-05-15T19:05:31.709 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.262786.log: /var/log/ceph/ceph-client.admin.563774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218153.log 2024-05-15T19:05:31.709 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.231506.log.gz 2024-05-15T19:05:31.710 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.445841.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.231930.log.gz 2024-05-15T19:05:31.710 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139837.log 2024-05-15T19:05:31.711 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.231515.log.gz 2024-05-15T19:05:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.218153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255468.log 2024-05-15T19:05:31.711 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.563774.log.gz 2024-05-15T19:05:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122098.log 2024-05-15T19:05:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.139837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361215.log 2024-05-15T19:05:31.713 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.255468.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.126889.log.gz 2024-05-15T19:05:31.713 INFO:teuthology.orchestra.run.smithi077.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.490033.log.gz 2024-05-15T19:05:31.713 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226351.log 2024-05-15T19:05:31.714 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174389.log 2024-05-15T19:05:31.714 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.361215.log: /var/log/ceph/ceph-client.admin.226351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424014.log 2024-05-15T19:05:31.714 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.469013.log.gz 2024-05-15T19:05:31.715 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563319.log 2024-05-15T19:05:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.174389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158785.log 2024-05-15T19:05:31.716 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.472992.log.gz 2024-05-15T19:05:31.716 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.424014.log: /var/log/ceph/ceph-client.admin.563319.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.563319.log.gz 2024-05-15T19:05:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430430.log 2024-05-15T19:05:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183131.log 2024-05-15T19:05:31.717 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44491.log.gz/var/log/ceph/ceph-client.admin.158785.log: 2024-05-15T19:05:31.717 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558638.log 2024-05-15T19:05:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.183131.log: /var/log/ceph/ceph-client.admin.430430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226360.log 2024-05-15T19:05:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427440.log 2024-05-15T19:05:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.558638.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.256315.log.gz 2024-05-15T19:05:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415705.log/var/log/ceph/ceph-client.admin.226360.log: 2024-05-15T19:05:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.427440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362076.log 2024-05-15T19:05:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560456.log 2024-05-15T19:05:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.415705.log: /var/log/ceph/ceph-client.admin.362076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532802.log 2024-05-15T19:05:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142919.log 2024-05-15T19:05:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.560456.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.532802.log: -- /var/log/ceph/ceph-client.admin.427008.log 2024-05-15T19:05:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46511.log 2024-05-15T19:05:31.724 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.377895.log.gz 2024-05-15T19:05:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.427008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435142.log 2024-05-15T19:05:31.728 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522372.log 2024-05-15T19:05:31.728 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46511.log: gzip -5/var/log/ceph/ceph-client.admin.435142.log: --verbose -- /var/log/ceph/ceph-client.admin.248640.log 2024-05-15T19:05:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.522372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125546.log 2024-05-15T19:05:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.248640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490465.log 2024-05-15T19:05:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420532.log 2024-05-15T19:05:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357831.log 2024-05-15T19:05:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.490465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236271.log 2024-05-15T19:05:31.729 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.420532.log: /var/log/ceph/ceph-client.admin.357831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44533.log 2024-05-15T19:05:31.732 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.236271.log: /var/log/ceph/ceph-client.admin.44533.log: gzip 85.0% -- replaced with /var/log/ceph/ceph-client.admin.206294.log.gz 2024-05-15T19:05:31.732 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.128164.log 2024-05-15T19:05:31.732 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- 90.1% -- replaced with /var/log/ceph/ceph-client.admin.205878.log.gz 2024-05-15T19:05:31.732 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.560949.log 2024-05-15T19:05:31.732 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500521.log 2024-05-15T19:05:31.733 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128164.log: /var/log/ceph/ceph-client.admin.560949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376962.log 2024-05-15T19:05:31.735 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.500521.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44242.log 2024-05-15T19:05:31.735 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431737.log 2024-05-15T19:05:31.735 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.376962.log: /var/log/ceph/ceph-client.admin.44242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178240.log 2024-05-15T19:05:31.735 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530004.log 2024-05-15T19:05:31.736 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.431737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139846.log 2024-05-15T19:05:31.736 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.178240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173952.log 2024-05-15T19:05:31.738 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.530004.log: /var/log/ceph/ceph-client.admin.139846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480449.log 2024-05-15T19:05:31.738 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36798.log 2024-05-15T19:05:31.739 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.173952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366379.log 2024-05-15T19:05:31.739 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.480449.log: /var/log/ceph/ceph-client.admin.36798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384961.log 2024-05-15T19:05:31.739 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421388.log 2024-05-15T19:05:31.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.366379.log: gzip 81.4% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.478211.log.gz /var/log/ceph/ceph-client.admin.340147.log 2024-05-15T19:05:31.740 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.384961.log: /var/log/ceph/ceph-client.admin.421388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138084.log 2024-05-15T19:05:31.740 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221124.log 2024-05-15T19:05:31.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.340147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110965.log 2024-05-15T19:05:31.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538620.log 2024-05-15T19:05:31.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.221124.log: /var/log/ceph/ceph-client.admin.110965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490456.log 2024-05-15T19:05:31.742 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426162.log 2024-05-15T19:05:31.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.538620.log: /var/log/ceph/ceph-client.admin.490456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238094.log 2024-05-15T19:05:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226774.log 2024-05-15T19:05:31.744 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68834.log.gz 2024-05-15T19:05:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.426162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182717.log 2024-05-15T19:05:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.238094.log: /var/log/ceph/ceph-client.admin.226774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526187.log 2024-05-15T19:05:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264064.log 2024-05-15T19:05:31.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.182717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131145.log 2024-05-15T19:05:31.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.526187.log: /var/log/ceph/ceph-client.admin.264064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258556.log 2024-05-15T19:05:31.747 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-15T19:05:31.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215994.log 2024-05-15T19:05:31.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.258556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552800.log 2024-05-15T19:05:31.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.215994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340157.log 2024-05-15T19:05:31.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.552800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264496.log 2024-05-15T19:05:31.750 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487777.log 2024-05-15T19:05:31.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.340157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261094.log 2024-05-15T19:05:31.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.264496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232364.log 2024-05-15T19:05:31.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.487777.log: /var/log/ceph/ceph-client.admin.261094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257171.log 2024-05-15T19:05:31.752 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187645.log 2024-05-15T19:05:31.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.232364.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47415.log.gz 2024-05-15T19:05:31.753 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198517.log 2024-05-15T19:05:31.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.257171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417442.log 2024-05-15T19:05:31.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.187645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374385.log 2024-05-15T19:05:31.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.198517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370212.log 2024-05-15T19:05:31.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.417442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384037.log 2024-05-15T19:05:31.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.374385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356142.log 2024-05-15T19:05:31.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.370212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420969.log 2024-05-15T19:05:31.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.384037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499092.log 2024-05-15T19:05:31.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.420969.log: /var/log/ceph/ceph-client.admin.356142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555523.log 2024-05-15T19:05:31.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540404.log 2024-05-15T19:05:31.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.499092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231030.log 2024-05-15T19:05:31.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.555523.log: /var/log/ceph/ceph-client.admin.540404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229770.log 2024-05-15T19:05:31.759 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524926.log 2024-05-15T19:05:31.760 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.231030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128591.log 2024-05-15T19:05:31.760 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.229770.log: /var/log/ceph/ceph-client.admin.524926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363405.log 2024-05-15T19:05:31.761 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43105.log 2024-05-15T19:05:31.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431728.log 2024-05-15T19:05:31.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.363405.log: /var/log/ceph/ceph-client.admin.43105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177788.log 2024-05-15T19:05:31.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122973.log 2024-05-15T19:05:31.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.431728.log: /var/log/ceph/ceph-client.admin.177788.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44242.log.gz 2024-05-15T19:05:31.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414787.log 2024-05-15T19:05:31.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412926.log 2024-05-15T19:05:31.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122973.log: /var/log/ceph/ceph-client.admin.414787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465029.log 2024-05-15T19:05:31.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.412926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388238.log 2024-05-15T19:05:31.765 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209306.log 2024-05-15T19:05:31.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.465029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345269.log 2024-05-15T19:05:31.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.388238.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44533.log.gz 2024-05-15T19:05:31.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.209306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126436.log 2024-05-15T19:05:31.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218999.log 2024-05-15T19:05:31.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.345269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519432.log 2024-05-15T19:05:31.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.126436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42937.log 2024-05-15T19:05:31.769 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43568.log.gz 2024-05-15T19:05:31.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.218999.log: /var/log/ceph/ceph-client.admin.519432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175226.log 2024-05-15T19:05:31.770 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.146877.log.gz 2024-05-15T19:05:31.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524503.log 2024-05-15T19:05:31.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374376.log 2024-05-15T19:05:31.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.175226.log: /var/log/ceph/ceph-client.admin.524503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551028.log 2024-05-15T19:05:31.771 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.158785.log.gz 2024-05-15T19:05:31.771 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.230607.log.gz 2024-05-15T19:05:31.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552374.log 2024-05-15T19:05:31.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.374376.log: /var/log/ceph/ceph-client.admin.551028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254612.log 2024-05-15T19:05:31.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.552374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507470.log 2024-05-15T19:05:31.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174380.log 2024-05-15T19:05:31.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.254612.log: 90.0% 82.6% -- replaced with /var/log/ceph/ceph-client.admin.145953.log.gz 2024-05-15T19:05:31.775 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.228500.log.gz 2024-05-15T19:05:31.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.507470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246883.log 2024-05-15T19:05:31.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.174380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412935.log 2024-05-15T19:05:31.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.246883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470803.log 2024-05-15T19:05:31.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390241.log 2024-05-15T19:05:31.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.412935.log: gzip/var/log/ceph/ceph-client.admin.470803.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.435565.log 2024-05-15T19:05:31.779 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.232364.log.gz 2024-05-15T19:05:31.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.390241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159660.log 2024-05-15T19:05:31.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.435565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177375.log 2024-05-15T19:05:31.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229337.log 2024-05-15T19:05:31.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.177375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443220.log 2024-05-15T19:05:31.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136294.log 2024-05-15T19:05:31.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.229337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402448.log 2024-05-15T19:05:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.443220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194885.log 2024-05-15T19:05:31.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354872.log 2024-05-15T19:05:31.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.402448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482274.log 2024-05-15T19:05:31.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.194885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150778.log 2024-05-15T19:05:31.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.354872.log: /var/log/ceph/ceph-client.admin.482274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121664.log 2024-05-15T19:05:31.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2024-05-15T19:05:31.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150778.log: /var/log/ceph/ceph-client.admin.121664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489096.log 2024-05-15T19:05:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45918.log 2024-05-15T19:05:31.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521110.log 2024-05-15T19:05:31.787 INFO:teuthology.orchestra.run.smithi077.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.490456.log.gz 2024-05-15T19:05:31.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217677.log 2024-05-15T19:05:31.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.489096.log: gzip -5 --verbose 81.2% -- /var/log/ceph/ceph-client.admin.564320.log 2024-05-15T19:05:31.788 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.496487.log.gz 2024-05-15T19:05:31.789 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.521110.log: /var/log/ceph/ceph-client.admin.217677.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.551028.log.gz 2024-05-15T19:05:31.790 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.501478.log.gz 2024-05-15T19:05:31.790 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.502743.log.gz 2024-05-15T19:05:31.790 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421832.log 2024-05-15T19:05:31.790 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122550.log 2024-05-15T19:05:31.790 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564320.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.128591.log.gz 2024-05-15T19:05:31.791 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.421832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255459.log 2024-05-15T19:05:31.792 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.564320.log.gz 2024-05-15T19:05:31.792 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.122550.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.494789.log.gz 2024-05-15T19:05:31.792 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.46864.log 2024-05-15T19:05:31.793 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.255459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380034.log 2024-05-15T19:05:31.794 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.560456.log.gz 2024-05-15T19:05:31.794 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.457929.log.gz 2024-05-15T19:05:31.794 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46864.log: gzip -5 --verbose -- 80.3% /var/log/ceph/ceph-client.admin.550591.log 2024-05-15T19:05:31.794 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.530427.log.gz 2024-05-15T19:05:31.794 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341855.log 2024-05-15T19:05:31.799 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.380034.log: /var/log/ceph/ceph-client.admin.550591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201639.log 2024-05-15T19:05:31.800 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121673.log 2024-05-15T19:05:31.800 INFO:teuthology.orchestra.run.smithi077.stderr: 77.9%/var/log/ceph/ceph-client.admin.341855.log: -- replaced with /var/log/ceph/ceph-client.admin.465029.log.gz 2024-05-15T19:05:31.800 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555997.log 2024-05-15T19:05:31.800 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.201639.log: /var/log/ceph/ceph-client.admin.121673.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.340157.log.gz 2024-05-15T19:05:31.800 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.361215.log.gz 2024-05-15T19:05:31.800 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498209.log 2024-05-15T19:05:31.801 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137188.log 2024-05-15T19:05:31.801 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.555997.log: /var/log/ceph/ceph-client.admin.498209.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.345269.log.gz 2024-05-15T19:05:31.801 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556440.log 2024-05-15T19:05:31.801 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.381311.log.gz 2024-05-15T19:05:31.801 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128600.log 2024-05-15T19:05:31.802 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.556440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495637.log 2024-05-15T19:05:31.803 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418126.log 2024-05-15T19:05:31.803 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.128600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2024-05-15T19:05:31.803 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.495637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349965.log 2024-05-15T19:05:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.418126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209758.log 2024-05-15T19:05:31.811 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68876.log 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.209758.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.446250.log.gz 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.349965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549253.log 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501469.log 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.68876.log: /var/log/ceph/ceph-client.admin.549253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560958.log 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542206.log 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.501469.log: /var/log/ceph/ceph-client.admin.560958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130721.log 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238518.log/var/log/ceph/ceph-client.admin.542206.log: 2024-05-15T19:05:31.812 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2024-05-15T19:05:31.813 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121240.log 2024-05-15T19:05:31.813 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.238518.log: /var/log/ceph/ceph-client.admin.47798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353570.log 2024-05-15T19:05:31.813 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228491.log 2024-05-15T19:05:31.813 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.121240.log: /var/log/ceph/ceph-client.admin.353570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548352.log 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189970.log 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.228491.log: /var/log/ceph/ceph-client.admin.548352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174812.log 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412225.log 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.189970.log: /var/log/ceph/ceph-client.admin.174812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521533.log 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187222.log 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.412225.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.500977.log.gz 2024-05-15T19:05:31.816 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.521533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537720.log 2024-05-15T19:05:31.817 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.187222.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46154.log.gz 2024-05-15T19:05:31.817 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46112.log.gz 2024-05-15T19:05:31.817 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392149.log 2024-05-15T19:05:31.818 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46238.log.gz 2024-05-15T19:05:31.818 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.537720.log: -- /var/log/ceph/ceph-client.admin.214956.log 2024-05-15T19:05:31.819 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.392149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346105.log 2024-05-15T19:05:31.819 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352209.log 2024-05-15T19:05:31.819 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.214956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494357.log 2024-05-15T19:05:31.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.346105.log: /var/log/ceph/ceph-client.admin.352209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475759.log 2024-05-15T19:05:31.821 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557320.log 2024-05-15T19:05:31.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.494357.log: /var/log/ceph/ceph-client.admin.475759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194432.log 2024-05-15T19:05:31.822 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563765.log 2024-05-15T19:05:31.822 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.557320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47116.log 2024-05-15T19:05:31.822 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.194432.log: /var/log/ceph/ceph-client.admin.563765.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.563765.log.gz 2024-05-15T19:05:31.822 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159217.log 2024-05-15T19:05:31.823 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467161.log 2024-05-15T19:05:31.824 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372486.log 2024-05-15T19:05:31.824 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.159217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405119.log 2024-05-15T19:05:31.824 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.467161.log: /var/log/ceph/ceph-client.admin.372486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200785.log 2024-05-15T19:05:31.825 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350931.log 2024-05-15T19:05:31.825 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.405119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497347.log 2024-05-15T19:05:31.826 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.200785.log: /var/log/ceph/ceph-client.admin.350931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364668.log 2024-05-15T19:05:31.826 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245390.log 2024-05-15T19:05:31.827 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.497347.log: /var/log/ceph/ceph-client.admin.364668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150787.log 2024-05-15T19:05:31.828 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558186.log 2024-05-15T19:05:31.828 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.245390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492598.log 2024-05-15T19:05:31.829 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150787.log: /var/log/ceph/ceph-client.admin.558186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485651.log 2024-05-15T19:05:31.829 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461060.log 2024-05-15T19:05:31.830 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.492598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113375.log 2024-05-15T19:05:31.831 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.485651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254179.log 2024-05-15T19:05:31.831 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.461060.log: /var/log/ceph/ceph-client.admin.113375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218576.log 2024-05-15T19:05:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537263.log 2024-05-15T19:05:31.832 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.254179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550136.log 2024-05-15T19:05:31.833 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.218576.log: /var/log/ceph/ceph-client.admin.537263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273926.log 2024-05-15T19:05:31.833 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.254612.log.gz 2024-05-15T19:05:31.834 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203763.log 2024-05-15T19:05:31.834 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.550136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494366.log 2024-05-15T19:05:31.834 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.273926.log: /var/log/ceph/ceph-client.admin.203763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517968.log 2024-05-15T19:05:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353147.log 2024-05-15T19:05:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.494366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456650.log 2024-05-15T19:05:31.836 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.517968.log: /var/log/ceph/ceph-client.admin.353147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529165.log 2024-05-15T19:05:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.456650.log: /var/log/ceph/ceph-client.admin.459211.log 2024-05-15T19:05:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.529165.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.249072.log.gz 2024-05-15T19:05:31.838 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487768.log 2024-05-15T19:05:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468166.log 2024-05-15T19:05:31.839 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.459211.log: /var/log/ceph/ceph-client.admin.487768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207144.log 2024-05-15T19:05:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420111.log 2024-05-15T19:05:31.840 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.468166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255040.log 2024-05-15T19:05:31.841 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.207144.log: /var/log/ceph/ceph-client.admin.420111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222633.log 2024-05-15T19:05:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409635.log 2024-05-15T19:05:31.842 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%/var/log/ceph/ceph-client.admin.255040.log: -- replaced with /var/log/ceph/ceph-client.admin.175663.log.gz 2024-05-15T19:05:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365533.log 2024-05-15T19:05:31.842 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.222633.log: /var/log/ceph/ceph-client.admin.409635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110069.log 2024-05-15T19:05:31.843 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471659.log 2024-05-15T19:05:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.365533.log: /var/log/ceph/ceph-client.admin.110069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141132.log 2024-05-15T19:05:31.844 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405543.log 2024-05-15T19:05:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.471659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380043.log 2024-05-15T19:05:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141132.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.139837.log.gz 2024-05-15T19:05:31.845 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.405543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110511.log 2024-05-15T19:05:31.846 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211988.log 2024-05-15T19:05:31.847 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.380043.log: /var/log/ceph/ceph-client.admin.110511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44247.log 2024-05-15T19:05:31.847 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.121664.log.gz 2024-05-15T19:05:31.848 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.122098.log.gz 2024-05-15T19:05:31.848 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413349.log 2024-05-15T19:05:31.848 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.211988.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.122550.log.gz 2024-05-15T19:05:31.849 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461549.log 2024-05-15T19:05:31.849 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.413349.log: /var/log/ceph/ceph-client.admin.44247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48315.log 2024-05-15T19:05:31.850 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349956.log 2024-05-15T19:05:31.850 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.461549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448179.log 2024-05-15T19:05:31.851 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48315.log: /var/log/ceph/ceph-client.admin.349956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110502.log 2024-05-15T19:05:31.851 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43580.log 2024-05-15T19:05:31.852 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.448179.log: /var/log/ceph/ceph-client.admin.110502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423146.log 2024-05-15T19:05:31.853 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401592.log 2024-05-15T19:05:31.853 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148167.log 2024-05-15T19:05:31.854 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.423146.log: /var/log/ceph/ceph-client.admin.401592.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.374376.log.gz 2024-05-15T19:05:31.854 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424857.log 2024-05-15T19:05:31.854 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.374385.log.gz 2024-05-15T19:05:31.855 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47158.log 2024-05-15T19:05:31.856 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138556.log 2024-05-15T19:05:31.856 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8%/var/log/ceph/ceph-client.admin.47158.log: -- replaced with /var/log/ceph/ceph-client.admin.211988.log.gz 2024-05-15T19:05:31.856 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.424857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147749.log 2024-05-15T19:05:31.858 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372987.log 2024-05-15T19:05:31.858 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.217677.log.gz 2024-05-15T19:05:31.858 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138556.log: /var/log/ceph/ceph-client.admin.147749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465875.log 2024-05-15T19:05:31.859 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219431.log 2024-05-15T19:05:31.859 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.372987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493507.log 2024-05-15T19:05:31.859 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.465875.log: /var/log/ceph/ceph-client.admin.219431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372978.log 2024-05-15T19:05:31.860 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564446.log 2024-05-15T19:05:31.861 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.493507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216417.log 2024-05-15T19:05:31.862 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.372978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509057.log 2024-05-15T19:05:31.863 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212842.log 2024-05-15T19:05:31.863 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.216417.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.564446.log.gz 2024-05-15T19:05:31.863 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149927.log 2024-05-15T19:05:31.864 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.212842.log: /var/log/ceph/ceph-client.admin.509057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253760.log 2024-05-15T19:05:31.865 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343552.log 2024-05-15T19:05:31.865 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237661.log 2024-05-15T19:05:31.866 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.253760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547011.log 2024-05-15T19:05:31.866 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.343552.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.444101.log.gz 2024-05-15T19:05:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.237661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277095.log 2024-05-15T19:05:31.867 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401592.log.gz 2024-05-15T19:05:31.867 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.547011.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.277104.log.gz 2024-05-15T19:05:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546553.log 2024-05-15T19:05:31.868 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2024-05-15T19:05:31.869 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.277095.log: /var/log/ceph/ceph-client.admin.546553.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.106660.log.gz 2024-05-15T19:05:31.869 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343989.log 2024-05-15T19:05:31.870 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421397.log 2024-05-15T19:05:31.872 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109149.log 2024-05-15T19:05:31.872 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.421397.log: /var/log/ceph/ceph-client.admin.343989.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.115561.log.gz 2024-05-15T19:05:31.872 INFO:teuthology.orchestra.run.smithi077.stderr: 77.6% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.413349.log.gz 2024-05-15T19:05:31.873 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.412926.log.gz 2024-05-15T19:05:31.873 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48315.log.gz 2024-05-15T19:05:31.873 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458352.log 2024-05-15T19:05:31.873 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.405119.log.gz 2024-05-15T19:05:31.874 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.109149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188964.log 2024-05-15T19:05:31.874 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.412935.log.gz 2024-05-15T19:05:31.874 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.458352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377886.log 2024-05-15T19:05:31.875 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123432.log 2024-05-15T19:05:31.875 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.188964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360780.log 2024-05-15T19:05:31.876 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.377886.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.470803.log.gz 2024-05-15T19:05:31.876 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.123432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227621.log 2024-05-15T19:05:31.876 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523223.log 2024-05-15T19:05:31.877 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.360780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564867.log 2024-05-15T19:05:31.878 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.227621.log: /var/log/ceph/ceph-client.admin.523223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47584.log 2024-05-15T19:05:31.878 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203754.log 2024-05-15T19:05:31.879 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564867.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.542206.log.gz 2024-05-15T19:05:31.879 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403791.log 2024-05-15T19:05:31.880 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430851.log 2024-05-15T19:05:31.880 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.564867.log.gz 2024-05-15T19:05:31.880 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.403791.log: /var/log/ceph/ceph-client.admin.203754.log: gzip 92.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.509066.log 2024-05-15T19:05:31.880 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.402895.log.gz 2024-05-15T19:05:31.881 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472496.log 2024-05-15T19:05:31.882 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.430851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459202.log 2024-05-15T19:05:31.883 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.472496.log: /var/log/ceph/ceph-client.admin.509066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276666.log 2024-05-15T19:05:31.884 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.459202.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.565207.log 2024-05-15T19:05:31.884 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.276666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45754.log 2024-05-15T19:05:31.886 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407038.log 2024-05-15T19:05:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565207.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.187222.log.gz 2024-05-15T19:05:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.2.45754.log: -5/var/log/ceph/ceph-client.admin.407038.log: --verbose -- /var/log/ceph/ceph-client.admin.365524.log 2024-05-15T19:05:31.887 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.191296.log.gz 2024-05-15T19:05:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382168.log 2024-05-15T19:05:31.887 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.565207.log.gz 2024-05-15T19:05:31.887 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155042.log 2024-05-15T19:05:31.890 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.365524.log: /var/log/ceph/ceph-client.admin.382168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176514.log 2024-05-15T19:05:31.890 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43580.log.gz 2024-05-15T19:05:31.890 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.534578.log 2024-05-15T19:05:31.890 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155042.log: /var/log/ceph/ceph-client.admin.176514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559596.log 2024-05-15T19:05:31.890 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.534578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193076.log 2024-05-15T19:05:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471227.log 2024-05-15T19:05:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.559596.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2024-05-15T19:05:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.193076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546122.log 2024-05-15T19:05:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.471227.log: --verbose -- /var/log/ceph/ceph-client.admin.132828.log 2024-05-15T19:05:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 83.1% -- replaced with /var/log/ceph/ceph-client.admin.150778.log.gz 2024-05-15T19:05:31.893 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose/var/log/ceph/ceph-client.admin.546122.log: -- /var/log/ceph/ceph-client.admin.530436.log 2024-05-15T19:05:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415696.log 2024-05-15T19:05:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376103.log/var/log/ceph/ceph-client.admin.530436.log: 2024-05-15T19:05:31.896 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2024-05-15T19:05:31.896 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.415696.log: /var/log/ceph/ceph-client.admin.376103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478648.log 2024-05-15T19:05:31.898 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267526.log 2024-05-15T19:05:31.898 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46762.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.219854.log.gz 2024-05-15T19:05:31.898 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43917.log 84.1% 2024-05-15T19:05:31.898 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.265786.log.gz 2024-05-15T19:05:31.898 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.478648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189519.log 2024-05-15T19:05:31.898 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.267526.log: /var/log/ceph/ceph-client.admin.43917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48021.log 2024-05-15T19:05:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.189519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504447.log 2024-05-15T19:05:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253751.log 2024-05-15T19:05:31.900 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48021.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.504447.log: -- /var/log/ceph/ceph-client.admin.373465.log 2024-05-15T19:05:31.901 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.253751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362981.log 2024-05-15T19:05:31.901 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503166.log 2024-05-15T19:05:31.902 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.373465.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.362981.log: -- /var/log/ceph/ceph-client.admin.477769.log 2024-05-15T19:05:31.904 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.503166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146886.log 2024-05-15T19:05:31.904 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114226.log 2024-05-15T19:05:31.904 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.477769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544391.log 2024-05-15T19:05:31.906 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.146886.log: /var/log/ceph/ceph-client.admin.114226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428279.log 2024-05-15T19:05:31.906 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250358.log 2024-05-15T19:05:31.907 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.544391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565333.log 2024-05-15T19:05:31.907 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.428279.log: /var/log/ceph/ceph-client.admin.250358.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.434290.log.gz 2024-05-15T19:05:31.907 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442792.log 2024-05-15T19:05:31.908 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413358.log 2024-05-15T19:05:31.908 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504025.log 2024-05-15T19:05:31.909 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.413358.log: /var/log/ceph/ceph-client.admin.442792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142928.log 2024-05-15T19:05:31.909 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.565333.log.gz 2024-05-15T19:05:31.910 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.504025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355289.log 2024-05-15T19:05:31.910 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.209306.log.gz 2024-05-15T19:05:31.911 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.142928.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435574.log.gz 2024-05-15T19:05:31.911 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214533.log 2024-05-15T19:05:31.911 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.255459.log.gz 2024-05-15T19:05:31.911 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.555059.log.gz -- replaced with /var/log/ceph/ceph-client.admin.497347.log.gz 2024-05-15T19:05:31.911 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:31.911 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545245.log 2024-05-15T19:05:31.912 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.355289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560023.log 2024-05-15T19:05:31.912 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.214533.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.341855.log.gz 2024-05-15T19:05:31.913 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.342706.log.gz 2024-05-15T19:05:31.913 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427431.log 2024-05-15T19:05:31.913 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.560023.log: /var/log/ceph/ceph-client.admin.545245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432161.log 2024-05-15T19:05:31.914 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.461060.log.gz 2024-05-15T19:05:31.914 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460081.log 2024-05-15T19:05:31.914 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.427431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204609.log 2024-05-15T19:05:31.915 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.460081.log: /var/log/ceph/ceph-client.admin.432161.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.493507.log.gz 2024-05-15T19:05:31.915 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463293.log 81.1% 2024-05-15T19:05:31.915 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.465875.log.gz 2024-05-15T19:05:31.916 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.465461.log.gz 2024-05-15T19:05:31.916 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.204609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543058.log 2024-05-15T19:05:31.917 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444950.log 2024-05-15T19:05:31.917 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.463293.log: /var/log/ceph/ceph-client.admin.543058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157796.log 2024-05-15T19:05:31.918 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265795.log 2024-05-15T19:05:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.444950.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.343552.log.gz 2024-05-15T19:05:31.919 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564488.log 2024-05-15T19:05:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157796.log: /var/log/ceph/ceph-client.admin.265795.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.343989.log.gz 2024-05-15T19:05:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268426.log 2024-05-15T19:05:31.920 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564488.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.564488.log.gz 2024-05-15T19:05:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247730.log 2024-05-15T19:05:31.921 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48399.log 2024-05-15T19:05:31.922 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.268426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426594.log 2024-05-15T19:05:31.923 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.247730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549700.log 2024-05-15T19:05:31.924 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525340.log 2024-05-15T19:05:31.924 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.426594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126898.log 2024-05-15T19:05:31.925 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.549700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551474.log 2024-05-15T19:05:31.926 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.525340.log: gzip -5/var/log/ceph/ceph-client.admin.126898.log: --verbose -- /var/log/ceph/ceph-client.admin.229346.log 2024-05-15T19:05:31.926 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.364668.log.gz 2024-05-15T19:05:31.927 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.427431.log.gz 2024-05-15T19:05:31.927 INFO:teuthology.orchestra.run.smithi077.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.365524.log.gz 2024-05-15T19:05:31.927 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524917.log 2024-05-15T19:05:31.928 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.551474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212411.log 2024-05-15T19:05:31.928 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.229346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405110.log 2024-05-15T19:05:31.929 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.212411.log: /var/log/ceph/ceph-client.admin.524917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528732.log 2024-05-15T19:05:31.930 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417856.log 2024-05-15T19:05:31.932 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.405110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420541.log 2024-05-15T19:05:31.932 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.528732.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.253751.log.gz 2024-05-15T19:05:31.932 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243617.log 2024-05-15T19:05:31.932 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.417856.log: /var/log/ceph/ceph-client.admin.420541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522381.log 2024-05-15T19:05:31.935 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.253760.log.gz 2024-05-15T19:05:31.935 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152175.log 2024-05-15T19:05:31.935 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.243617.log: /var/log/ceph/ceph-client.admin.522381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547906.log 2024-05-15T19:05:31.935 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234502.log 2024-05-15T19:05:31.935 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.152175.log: /var/log/ceph/ceph-client.admin.547906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45256.log 2024-05-15T19:05:31.937 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456659.log/var/log/ceph/ceph-client.admin.234502.log: 2024-05-15T19:05:31.938 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438142.log 2024-05-15T19:05:31.938 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.456659.log: /var/log/ceph/ceph-client.0.45256.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2024-05-15T19:05:31.938 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474276.log 2024-05-15T19:05:31.940 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428288.log 2024-05-15T19:05:31.940 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.438142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195346.log 2024-05-15T19:05:31.940 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0%/var/log/ceph/ceph-client.admin.428288.log: -- replaced with /var/log/ceph/ceph-client.admin.126898.log.gz 2024-05-15T19:05:31.940 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.474276.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.445381.log.gz 2024-05-15T19:05:31.940 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523232.log 2024-05-15T19:05:31.942 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406039.log 2024-05-15T19:05:31.942 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.195346.log: /var/log/ceph/ceph-client.admin.523232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220268.log 2024-05-15T19:05:31.942 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425320.log 2024-05-15T19:05:31.943 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.406039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389745.log 2024-05-15T19:05:31.943 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.220268.log: /var/log/ceph/ceph-client.admin.425320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456179.log 2024-05-15T19:05:31.943 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551929.log 2024-05-15T19:05:31.944 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.389745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477760.log 2024-05-15T19:05:31.944 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.486083.log.gz 2024-05-15T19:05:31.945 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.456179.log: /var/log/ceph/ceph-client.admin.551929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277945.log 2024-05-15T19:05:31.945 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233212.log 2024-05-15T19:05:31.946 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.477760.log: /var/log/ceph/ceph-client.admin.277945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447765.log 2024-05-15T19:05:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521524.log/var/log/ceph/ceph-client.admin.233212.log: 2024-05-15T19:05:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.447765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254188.log 2024-05-15T19:05:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.521524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44845.log 2024-05-15T19:05:31.949 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533231.log 2024-05-15T19:05:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.254188.log: /var/log/ceph/ceph-client.admin.44845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212833.log 2024-05-15T19:05:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.533231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358244.log 2024-05-15T19:05:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374808.log 2024-05-15T19:05:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.212833.log: /var/log/ceph/ceph-client.admin.358244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133253.log 2024-05-15T19:05:31.953 INFO:teuthology.orchestra.run.smithi077.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.138556.log.gz 2024-05-15T19:05:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382655.log 2024-05-15T19:05:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.374808.log: /var/log/ceph/ceph-client.admin.133253.log: gzip -5 93.5% -- replaced with /var/log/ceph/ceph-client.admin.193537.log.gz 2024-05-15T19:05:31.955 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.564913.log 2024-05-15T19:05:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191748.log 2024-05-15T19:05:31.956 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.382655.log: /var/log/ceph/ceph-client.admin.564913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211109.log 2024-05-15T19:05:31.956 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.564913.log.gz 2024-05-15T19:05:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194894.log 2024-05-15T19:05:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.191748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158794.log 2024-05-15T19:05:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.211109.log: /var/log/ceph/ceph-client.admin.194894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387227.log 2024-05-15T19:05:31.958 INFO:teuthology.orchestra.run.smithi077.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.546122.log.gz 2024-05-15T19:05:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262795.log 2024-05-15T19:05:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353984.log 2024-05-15T19:05:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.387227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220701.log 2024-05-15T19:05:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.353984.log: /var/log/ceph/ceph-client.admin.262795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173961.log 2024-05-15T19:05:31.962 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.471659.log.gz 2024-05-15T19:05:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.220701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479951.log 2024-05-15T19:05:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.173961.log: --verbose -- /var/log/ceph/ceph-client.admin.539484.log 2024-05-15T19:05:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224011.log/var/log/ceph/ceph-client.admin.479951.log: 2024-05-15T19:05:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.539484.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2024-05-15T19:05:31.966 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.478648.log.gz 2024-05-15T19:05:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47211.log 2024-05-15T19:05:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.224011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175235.log 2024-05-15T19:05:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231039.log 2024-05-15T19:05:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48231.log 2024-05-15T19:05:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.175235.log: /var/log/ceph/ceph-client.admin.231039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2024-05-15T19:05:31.968 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401105.log 2024-05-15T19:05:31.969 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48231.log: /var/log/ceph/ceph-client.admin.47668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175654.log 2024-05-15T19:05:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363829.log 2024-05-15T19:05:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.401105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276242.log 2024-05-15T19:05:31.971 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.175654.log: /var/log/ceph/ceph-client.admin.363829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359097.log 2024-05-15T19:05:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.276242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123846.log 2024-05-15T19:05:31.973 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.477760.log.gz 2024-05-15T19:05:31.973 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422269.log 2024-05-15T19:05:31.974 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.123846.log: /var/log/ceph/ceph-client.admin.359097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540901.log 2024-05-15T19:05:31.974 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.477769.log.gz 2024-05-15T19:05:31.975 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48273.log 2024-05-15T19:05:31.975 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.422269.log: /var/log/ceph/ceph-client.admin.540901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181803.log 2024-05-15T19:05:31.976 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491309.log 2024-05-15T19:05:31.977 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.181803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519441.log 2024-05-15T19:05:31.978 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.491309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115975.log 2024-05-15T19:05:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241871.log 2024-05-15T19:05:31.979 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.519441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2024-05-15T19:05:31.980 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.115975.log: /var/log/ceph/ceph-client.admin.241871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131991.log 2024-05-15T19:05:31.981 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.370644.log.gz 2024-05-15T19:05:31.981 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525773.log 2024-05-15T19:05:31.982 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.131991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432594.log 2024-05-15T19:05:31.983 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356978.log 2024-05-15T19:05:31.983 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.525773.log: /var/log/ceph/ceph-client.admin.432594.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43147.log.gz 2024-05-15T19:05:31.984 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108647.log 2024-05-15T19:05:31.985 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.211109.log.gz 2024-05-15T19:05:31.985 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370221.log 2024-05-15T19:05:31.985 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.374808.log.gz 2024-05-15T19:05:31.986 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.356978.log: /var/log/ceph/ceph-client.admin.108647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539058.log 2024-05-15T19:05:31.986 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2024-05-15T19:05:31.987 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425739.log 2024-05-15T19:05:31.987 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.370221.log: /var/log/ceph/ceph-client.admin.539058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352723.log 2024-05-15T19:05:31.988 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.425739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520850.log 2024-05-15T19:05:31.989 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.352723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221133.log 2024-05-15T19:05:31.990 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.520850.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.276242.log.gz 2024-05-15T19:05:31.990 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263634.log 2024-05-15T19:05:31.990 INFO:teuthology.orchestra.run.smithi077.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.277095.log.gz 2024-05-15T19:05:31.991 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.276666.log.gz 2024-05-15T19:05:31.991 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.221133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233654.log 2024-05-15T19:05:31.992 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.263634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137197.log 2024-05-15T19:05:31.993 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.233654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541762.log 2024-05-15T19:05:31.994 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.137197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180927.log 2024-05-15T19:05:31.995 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46070.log/var/log/ceph/ceph-client.admin.541762.log: /var/log/ceph/ceph-client.admin.180927.log: 2024-05-15T19:05:31.995 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.444950.log.gz 2024-05-15T19:05:31.996 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-05-15T19:05:31.997 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525764.log 2024-05-15T19:05:31.998 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.43579.log: -5 --verbose/var/log/ceph/ceph-client.admin.525764.log: -- /var/log/ceph/ceph-client.admin.192652.log 2024-05-15T19:05:31.999 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.212833.log.gz 2024-05-15T19:05:31.999 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.476248.log 2024-05-15T19:05:32.000 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.192652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500497.log 2024-05-15T19:05:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.476248.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.214533.log.gz 2024-05-15T19:05:32.001 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474754.log 2024-05-15T19:05:32.002 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.407038.log.gz 2024-05-15T19:05:32.002 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215985.log 2024-05-15T19:05:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.500497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413861.log 2024-05-15T19:05:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.474754.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.442792.log.gz 2024-05-15T19:05:32.003 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543049.log 2024-05-15T19:05:32.004 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.215985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357409.log 2024-05-15T19:05:32.005 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.413861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363396.log 2024-05-15T19:05:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.543049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356556.log 2024-05-15T19:05:32.006 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.357409.log: /var/log/ceph/ceph-client.admin.363396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273477.log 2024-05-15T19:05:32.007 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376548.log 2024-05-15T19:05:32.008 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.356556.log: /var/log/ceph/ceph-client.admin.273477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201648.log 2024-05-15T19:05:32.008 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218162.log 2024-05-15T19:05:32.009 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.376548.log: /var/log/ceph/ceph-client.admin.201648.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48273.log.gz 2024-05-15T19:05:32.009 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose 89.3% -- /var/log/ceph/ceph-client.admin.547897.log 2024-05-15T19:05:32.009 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48231.log.gz 2024-05-15T19:05:32.010 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.218162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2024-05-15T19:05:32.011 INFO:teuthology.orchestra.run.smithi077.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.119520.log.gz 2024-05-15T19:05:32.011 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.547897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420102.log 2024-05-15T19:05:32.011 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47584.log.gz 2024-05-15T19:05:32.011 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.130712.log.gz 2024-05-15T19:05:32.012 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189961.log 2024-05-15T19:05:32.013 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45876.log: 83.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491742.log 2024-05-15T19:05:32.013 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.541762.log.gz 2024-05-15T19:05:32.013 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.189961.log: /var/log/ceph/ceph-client.admin.420102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371067.log 2024-05-15T19:05:32.013 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2%/var/log/ceph/ceph-client.admin.491742.log: -- replaced with /var/log/ceph/ceph-client.admin.157796.log.gz 2024-05-15T19:05:32.014 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413870.log 2024-05-15T19:05:32.014 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559096.log 2024-05-15T19:05:32.015 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.371067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209749.log 2024-05-15T19:05:32.016 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.413870.log: /var/log/ceph/ceph-client.admin.559096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190397.log 2024-05-15T19:05:32.016 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.559596.log.gz 2024-05-15T19:05:32.016 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198526.log 2024-05-15T19:05:32.017 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.209749.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.560023.log.gz 2024-05-15T19:05:32.017 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217686.log 2024-05-15T19:05:32.018 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.190397.log: /var/log/ceph/ceph-client.admin.198526.log: gzip -5 81.2% -- replaced with /var/log/ceph/ceph-client.admin.180927.log.gz 2024-05-15T19:05:32.018 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.199430.log 2024-05-15T19:05:32.019 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.217686.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.228044.log.gz 2024-05-15T19:05:32.019 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409626.log 2024-05-15T19:05:32.020 INFO:teuthology.orchestra.run.smithi077.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.192652.log.gz 2024-05-15T19:05:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462879.log 2024-05-15T19:05:32.020 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.199430.log: /var/log/ceph/ceph-client.admin.409626.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.201648.log.gz 2024-05-15T19:05:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466723.log 2024-05-15T19:05:32.021 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.462879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43273.log 2024-05-15T19:05:32.022 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.466723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408329.log 2024-05-15T19:05:32.023 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213687.log 2024-05-15T19:05:32.024 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43273.log: /var/log/ceph/ceph-client.admin.408329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500967.log 2024-05-15T19:05:32.024 INFO:teuthology.orchestra.run.smithi077.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.232779.log.gz 2024-05-15T19:05:32.025 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.213687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238509.log 2024-05-15T19:05:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200328.log 2024-05-15T19:05:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.500967.log: /var/log/ceph/ceph-client.admin.238509.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.457506.log.gz 2024-05-15T19:05:32.026 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254603.log 2024-05-15T19:05:32.028 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.200328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264910.log 2024-05-15T19:05:32.028 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.254603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274858.log 2024-05-15T19:05:32.029 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207153.log 2024-05-15T19:05:32.030 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.264910.log: /var/log/ceph/ceph-client.admin.274858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258047.log 2024-05-15T19:05:32.032 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.469921.log.gz 2024-05-15T19:05:32.032 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.481351.log/var/log/ceph/ceph-client.admin.207153.log: 2024-05-15T19:05:32.032 INFO:teuthology.orchestra.run.smithi077.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.555988.log.gz 2024-05-15T19:05:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457497.log 2024-05-15T19:05:32.033 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.258047.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.436444.log.gz 2024-05-15T19:05:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.481351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251200.log 2024-05-15T19:05:32.034 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.435988.log.gz 2024-05-15T19:05:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251633.log 2024-05-15T19:05:32.034 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.251200.log: 77.1%/var/log/ceph/ceph-client.admin.457497.log: -- replaced with /var/log/ceph/ceph-client.admin.523223.log.gz 2024-05-15T19:05:32.034 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.504025.log.gz 2024-05-15T19:05:32.035 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504016.log 2024-05-15T19:05:32.035 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565249.log 2024-05-15T19:05:32.036 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.251633.log: /var/log/ceph/ceph-client.admin.504016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507461.log 2024-05-15T19:05:32.037 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475279.log 2024-05-15T19:05:32.038 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.507461.log: /var/log/ceph/ceph-client.admin.475279.log: /var/log/ceph/ceph-client.admin.559087.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.565249.log.gz 2024-05-15T19:05:32.038 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.039 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.481351.log.gz 2024-05-15T19:05:32.039 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216840.log 2024-05-15T19:05:32.041 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.559087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264919.log 2024-05-15T19:05:32.042 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.216840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42979.log 2024-05-15T19:05:32.042 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.264919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524071.log 2024-05-15T19:05:32.043 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42979.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.421832.log.gz 2024-05-15T19:05:32.044 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244031.log 2024-05-15T19:05:32.044 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.421397.log.gz 2024-05-15T19:05:32.044 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.524071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446129.log 2024-05-15T19:05:32.045 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561398.log 2024-05-15T19:05:32.046 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.244031.log: gzip/var/log/ceph/ceph-client.admin.446129.log: -5 --verbose --/var/log/ceph/ceph-client.admin.561398.log: /var/log/ceph/ceph-client.admin.384511.log 2024-05-15T19:05:32.047 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256752.log 2024-05-15T19:05:32.048 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.384511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465452.log 2024-05-15T19:05:32.049 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.256752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345692.log 2024-05-15T19:05:32.050 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.465452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470336.log 2024-05-15T19:05:32.050 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.345692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422697.log 2024-05-15T19:05:32.051 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377422.log 2024-05-15T19:05:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.470336.log: /var/log/ceph/ceph-client.admin.422697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444110.log 2024-05-15T19:05:32.052 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.377422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411793.log 2024-05-15T19:05:32.052 INFO:teuthology.orchestra.run.smithi077.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.460081.log.gz 2024-05-15T19:05:32.053 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.462870.log.gz/var/log/ceph/ceph-client.admin.444110.log: 2024-05-15T19:05:32.053 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208845.log 2024-05-15T19:05:32.054 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.411793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461069.log 2024-05-15T19:05:32.055 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.462879.log.gz 2024-05-15T19:05:32.055 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138093.log 2024-05-15T19:05:32.056 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.208845.log: /var/log/ceph/ceph-client.admin.461069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152184.log 2024-05-15T19:05:32.057 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276675.log 2024-05-15T19:05:32.057 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432585.log 2024-05-15T19:05:32.058 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.276675.log: /var/log/ceph/ceph-client.admin.152184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211997.log 2024-05-15T19:05:32.059 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.432585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371999.log 2024-05-15T19:05:32.061 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252489.log/var/log/ceph/ceph-client.admin.211997.log: 2024-05-15T19:05:32.061 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.371999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124269.log 2024-05-15T19:05:32.062 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430002.log 2024-05-15T19:05:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.252489.log: /var/log/ceph/ceph-client.admin.124269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250786.log 2024-05-15T19:05:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.430002.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.429565.log.gz 2024-05-15T19:05:32.064 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358666.log 2024-05-15T19:05:32.064 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% 84.0% -- replaced with /var/log/ceph/ceph-client.admin.430851.log.gz 2024-05-15T19:05:32.064 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.430421.log.gz 2024-05-15T19:05:32.065 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176933.log 2024-05-15T19:05:32.065 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.250786.log: /var/log/ceph/ceph-client.admin.358666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446487.log 2024-05-15T19:05:32.066 INFO:teuthology.orchestra.run.smithi077.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.524071.log.gz 2024-05-15T19:05:32.066 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.176933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125964.log 2024-05-15T19:05:32.067 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.446487.log: gzip 90.2% -- replaced with /var/log/ceph/ceph-client.admin.366379.log.gz 2024-05-15T19:05:32.067 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.243608.log 2024-05-15T19:05:32.069 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207578.log 2024-05-15T19:05:32.070 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.243608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230616.log 2024-05-15T19:05:32.071 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.207578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248153.log 2024-05-15T19:05:32.072 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.230616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42853.log 2024-05-15T19:05:32.073 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.248153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48063.log 2024-05-15T19:05:32.074 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.346533.log.gz 2024-05-15T19:05:32.074 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42309.log 2024-05-15T19:05:32.074 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.521110.log.gz 2024-05-15T19:05:32.074 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48063.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.521533.log.gz 2024-05-15T19:05:32.075 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140272.log 2024-05-15T19:05:32.075 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204600.log 2024-05-15T19:05:32.076 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42309.log: /var/log/ceph/ceph-client.admin.140272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359943.log 2024-05-15T19:05:32.076 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498218.log 2024-05-15T19:05:32.077 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.204600.log: /var/log/ceph/ceph-client.admin.359943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536349.log 2024-05-15T19:05:32.078 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205032.log 2024-05-15T19:05:32.079 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.498218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542197.log 2024-05-15T19:05:32.079 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.205032.log: /var/log/ceph/ceph-client.admin.536349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140700.log 2024-05-15T19:05:32.080 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242337.log 2024-05-15T19:05:32.081 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.542197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503591.log 2024-05-15T19:05:32.081 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.140700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46804.log 2024-05-15T19:05:32.082 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.242337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385385.log 2024-05-15T19:05:32.082 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.503591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418263.log 2024-05-15T19:05:32.083 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.528732.log.gz 2024-05-15T19:05:32.083 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.385385.log: /var/log/ceph/ceph-client.admin.46804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190388.log 2024-05-15T19:05:32.084 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460090.log 2024-05-15T19:05:32.085 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.418263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358675.log 2024-05-15T19:05:32.086 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.190388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182708.log 2024-05-15T19:05:32.086 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.460090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388762.log 2024-05-15T19:05:32.087 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.358675.log: /var/log/ceph/ceph-client.admin.182708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219008.log 2024-05-15T19:05:32.087 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.469912.log.gz 2024-05-15T19:05:32.088 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46333.log 2024-05-15T19:05:32.088 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.388762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516553.log 2024-05-15T19:05:32.089 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.219008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377431.log 2024-05-15T19:05:32.089 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46333.log: /var/log/ceph/ceph-client.admin.516553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149512.log 2024-05-15T19:05:32.090 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.377431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415205.log 2024-05-15T19:05:32.091 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.149512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474763.log 2024-05-15T19:05:32.091 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429129.log 2024-05-15T19:05:32.092 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.415205.log: /var/log/ceph/ceph-client.admin.474763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48507.log 2024-05-15T19:05:32.093 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.356978.log.gz 2024-05-15T19:05:32.093 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208417.log 2024-05-15T19:05:32.093 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.429129.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.388753.log.gz 2024-05-15T19:05:32.094 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355298.log 2024-05-15T19:05:32.095 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550582.log 2024-05-15T19:05:32.095 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.208417.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.358666.log.gz 2024-05-15T19:05:32.096 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.355298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520840.log 2024-05-15T19:05:32.096 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.550582.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.364244.log 2024-05-15T19:05:32.096 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505773.log 2024-05-15T19:05:32.098 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.520840.log: /var/log/ceph/ceph-client.admin.364244.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.358675.log.gz 2024-05-15T19:05:32.099 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128173.log 2024-05-15T19:05:32.099 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407047.log 2024-05-15T19:05:32.099 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.505773.log: /var/log/ceph/ceph-client.admin.128173.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.353147.log.gz 2024-05-15T19:05:32.099 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365099.log 2024-05-15T19:05:32.100 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252913.log 2024-05-15T19:05:32.100 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.407047.log: /var/log/ceph/ceph-client.admin.365099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174803.log 2024-05-15T19:05:32.102 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383128.log 2024-05-15T19:05:32.102 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.252913.log: /var/log/ceph/ceph-client.admin.174803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473415.log 2024-05-15T19:05:32.102 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214947.log 2024-05-15T19:05:32.103 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.383128.log: /var/log/ceph/ceph-client.admin.473415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210662.log 2024-05-15T19:05:32.104 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565687.log 2024-05-15T19:05:32.104 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.214947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387741.log 2024-05-15T19:05:32.105 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.210662.log: /var/log/ceph/ceph-client.admin.565687.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.565687.log.gz 2024-05-15T19:05:32.105 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404648.log 2024-05-15T19:05:32.106 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214110.log 2024-05-15T19:05:32.106 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.387741.log: /var/log/ceph/ceph-client.admin.404648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192661.log 2024-05-15T19:05:32.107 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565603.log 2024-05-15T19:05:32.108 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.214110.log: /var/log/ceph/ceph-client.admin.192661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446906.log 2024-05-15T19:05:32.108 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.468580.log.gz 2024-05-15T19:05:32.109 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130289.log 2024-05-15T19:05:32.109 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565603.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.539484.log.gz 2024-05-15T19:05:32.109 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.446906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409203.log 2024-05-15T19:05:32.110 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.565603.log.gz 2024-05-15T19:05:32.110 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223558.log 2024-05-15T19:05:32.111 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.130289.log: /var/log/ceph/ceph-client.admin.409203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267517.log 2024-05-15T19:05:32.111 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341012.log 2024-05-15T19:05:32.112 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.223558.log: /var/log/ceph/ceph-client.admin.267517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42621.log 2024-05-15T19:05:32.113 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156417.log 2024-05-15T19:05:32.113 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.341012.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.349099.log.gz 2024-05-15T19:05:32.114 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42621.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.351778.log.gz 2024-05-15T19:05:32.114 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367657.log 2024-05-15T19:05:32.115 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176077.log 2024-05-15T19:05:32.115 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156417.log: /var/log/ceph/ceph-client.admin.367657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471650.log 2024-05-15T19:05:32.116 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242765.log 2024-05-15T19:05:32.117 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.176077.log: /var/log/ceph/ceph-client.admin.471650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131559.log 2024-05-15T19:05:32.117 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257594.log 2024-05-15T19:05:32.118 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.242765.log: /var/log/ceph/ceph-client.admin.131559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138988.log 2024-05-15T19:05:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429993.log 2024-05-15T19:05:32.120 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.257594.log: /var/log/ceph/ceph-client.admin.138988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436877.log 2024-05-15T19:05:32.120 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225470.log 2024-05-15T19:05:32.121 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.429993.log: /var/log/ceph/ceph-client.admin.436877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371512.log 2024-05-15T19:05:32.122 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.225470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502329.log 2024-05-15T19:05:32.123 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.371512.log: --verbose -- /var/log/ceph/ceph-client.admin.200794.log 2024-05-15T19:05:32.124 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.502329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403331.log 2024-05-15T19:05:32.125 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253337.log 2024-05-15T19:05:32.126 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.200794.log: /var/log/ceph/ceph-client.admin.403331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528316.log 2024-05-15T19:05:32.127 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185461.log 2024-05-15T19:05:32.128 INFO:teuthology.orchestra.run.smithi077.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42621.log.gz/var/log/ceph/ceph-client.admin.528316.log: 2024-05-15T19:05:32.128 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.253337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135813.log 2024-05-15T19:05:32.128 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524494.log 2024-05-15T19:05:32.128 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.208417.log.gz 2024-05-15T19:05:32.128 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.185461.log: /var/log/ceph/ceph-client.admin.135813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344417.log 2024-05-15T19:05:32.129 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427864.log 2024-05-15T19:05:32.129 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.524494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460570.log 2024-05-15T19:05:32.130 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.427864.log: /var/log/ceph/ceph-client.admin.344417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483897.log 2024-05-15T19:05:32.131 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.460570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266243.log 2024-05-15T19:05:32.131 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43399.log 2024-05-15T19:05:32.132 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.483897.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.456659.log.gz 2024-05-15T19:05:32.133 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.266243.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.209749.log.gz 2024-05-15T19:05:32.133 INFO:teuthology.orchestra.run.smithi077.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.457497.log.gz 2024-05-15T19:05:32.133 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155033.log 2024-05-15T19:05:32.133 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43399.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.211118.log.gz 2024-05-15T19:05:32.134 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178700.log 2024-05-15T19:05:32.135 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205869.log 2024-05-15T19:05:32.135 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.155033.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.446906.log.gz 2024-05-15T19:05:32.137 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.230616.log.gz 2024-05-15T19:05:32.137 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42793.log 2024-05-15T19:05:32.137 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48063.log.gz 2024-05-15T19:05:32.137 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43399.log.gz 2024-05-15T19:05:32.137 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9%/var/log/ceph/ceph-client.admin.178700.log: -- replaced with /var/log/ceph/ceph-client.admin.48105.log.gz 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213687.log.gz 2024-05-15T19:05:32.138 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.138 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-05-15T19:05:32.138 INFO:teuthology.orchestra.run.smithi077.stderr: 82.7%/var/log/ceph/ceph-client.admin.205869.log: -- replaced with /var/log/ceph/ceph-client.admin.479951.log.gz 2024-05-15T19:05:32.138 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355711.log 2024-05-15T19:05:32.138 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42793.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446487.log.gz 2024-05-15T19:05:32.140 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 80.3% -- replaced with /var/log/ceph/ceph-client.admin.124269.log.gz 2024-05-15T19:05:32.140 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose --/var/log/ceph/ceph-client.admin.355711.log: /var/log/ceph/ceph-client.admin.120487.log 2024-05-15T19:05:32.140 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.547897.log.gz 2024-05-15T19:05:32.140 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.559087.log.gz 2024-05-15T19:05:32.140 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429138.log 2024-05-15T19:05:32.141 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486074.log 2024-05-15T19:05:32.141 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.429138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372495.log 2024-05-15T19:05:32.142 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.486074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429574.log 2024-05-15T19:05:32.143 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.372495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-05-15T19:05:32.144 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.429574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129027.log 2024-05-15T19:05:32.145 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2024-05-15T19:05:32.146 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43908.log: /var/log/ceph/ceph-client.admin.129027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533222.log 2024-05-15T19:05:32.147 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461981.log 2024-05-15T19:05:32.147 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47373.log: /var/log/ceph/ceph-client.admin.533222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489087.log 2024-05-15T19:05:32.148 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.461981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554584.log 2024-05-15T19:05:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387218.log 2024-05-15T19:05:32.150 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.489087.log: /var/log/ceph/ceph-client.admin.554584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435151.log 2024-05-15T19:05:32.151 INFO:teuthology.orchestra.run.smithi077.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.377422.log.gz 2024-05-15T19:05:32.151 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.387218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346542.log 2024-05-15T19:05:32.152 INFO:teuthology.orchestra.run.smithi077.stderr: 79.5% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.378748.log.gz 2024-05-15T19:05:32.152 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.238509.log.gz 2024-05-15T19:05:32.152 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.435151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382159.log 2024-05-15T19:05:32.153 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.346542.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.262363.log.gz 2024-05-15T19:05:32.153 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415214.log 2024-05-15T19:05:32.154 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237238.log 2024-05-15T19:05:32.154 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.382159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564277.log 2024-05-15T19:05:32.154 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.237238.log: /var/log/ceph/ceph-client.admin.415214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484312.log 2024-05-15T19:05:32.156 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.182708.log.gz 2024-05-15T19:05:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534090.log 2024-05-15T19:05:32.157 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424428.log 2024-05-15T19:05:32.157 INFO:teuthology.orchestra.run.smithi077.stderr: 86.9%/var/log/ceph/ceph-client.admin.534090.log: -- replaced with /var/log/ceph/ceph-client.admin.564277.log.gz 2024-05-15T19:05:32.158 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.484312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343138.log 2024-05-15T19:05:32.158 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390701.log 2024-05-15T19:05:32.159 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.424428.log: /var/log/ceph/ceph-client.admin.343138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-05-15T19:05:32.159 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.390701.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.129027.log.gz 2024-05-15T19:05:32.160 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose 84.7% -- /var/log/ceph/ceph-client.admin.212420.log -- replaced with /var/log/ceph/ceph-client.admin.266243.log.gz 2024-05-15T19:05:32.160 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43913.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.212420.log: /var/log/ceph/ceph-client.admin.531757.log 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.264487.log.gz 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.503591.log.gz 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247297.log 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.436877.log.gz 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435151.log.gz 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.531757.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.505773.log.gz 2024-05-15T19:05:32.163 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43912.log 2024-05-15T19:05:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.247297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426171.log 2024-05-15T19:05:32.165 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182256.log 2024-05-15T19:05:32.165 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.432594.log.gz 2024-05-15T19:05:32.165 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.481839.log.gz 2024-05-15T19:05:32.166 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.426171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364253.log 2024-05-15T19:05:32.167 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.182256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479494.log 2024-05-15T19:05:32.167 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.364253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489555.log 2024-05-15T19:05:32.167 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.479494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478220.log 2024-05-15T19:05:32.168 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.489555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48767.log 2024-05-15T19:05:32.169 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.478220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222047.log 2024-05-15T19:05:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244942.log 2024-05-15T19:05:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.48767.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.409626.log.gz 2024-05-15T19:05:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.222047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179173.log 2024-05-15T19:05:32.172 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.244942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403322.log 2024-05-15T19:05:32.173 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365947.log 2024-05-15T19:05:32.173 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.179173.log: /var/log/ceph/ceph-client.admin.403322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339721.log 2024-05-15T19:05:32.174 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560465.log 2024-05-15T19:05:32.175 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.365947.log: /var/log/ceph/ceph-client.admin.339721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356565.log 2024-05-15T19:05:32.176 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.560465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441532.log 2024-05-15T19:05:32.177 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492175.log 2024-05-15T19:05:32.177 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.356565.log: /var/log/ceph/ceph-client.admin.441532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156949.log 2024-05-15T19:05:32.179 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.492175.log: /var/log/ceph/ceph-client.admin.43914.log 2024-05-15T19:05:32.179 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.130289.log.gz 2024-05-15T19:05:32.179 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.156949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359088.log 2024-05-15T19:05:32.180 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401583.log 2024-05-15T19:05:32.181 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385861.log 2024-05-15T19:05:32.182 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.359088.log: /var/log/ceph/ceph-client.admin.401583.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-15T19:05:32.183 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261949.log 2024-05-15T19:05:32.184 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.385861.log: /var/log/ceph/ceph-mds.a.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.493942.log.gz 2024-05-15T19:05:32.184 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.189961.log.gz 2024-05-15T19:05:32.184 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258565.log 2024-05-15T19:05:32.184 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248144.log 2024-05-15T19:05:32.185 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.261949.log: gzip/var/log/ceph/ceph-client.admin.258565.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.223095.log 2024-05-15T19:05:32.186 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.248144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230194.log 2024-05-15T19:05:32.186 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242756.log 2024-05-15T19:05:32.187 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.230194.log: /var/log/ceph/ceph-client.admin.223095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261940.log 2024-05-15T19:05:32.188 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.242756.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.466732.log.gz 2024-05-15T19:05:32.188 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197623.log 2024-05-15T19:05:32.188 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464182.log 2024-05-15T19:05:32.189 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.261940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107693.log 2024-05-15T19:05:32.190 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.197623.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2024-05-15T19:05:32.190 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48147.log 2024-05-15T19:05:32.191 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.464182.log: gzip/var/log/ceph/ceph-client.admin.107693.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43575.log 2024-05-15T19:05:32.191 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48147.log: 88.8% -- replaced with /var/log/ceph/ceph-client.2.45754.log.gz 2024-05-15T19:05:32.192 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385870.log 2024-05-15T19:05:32.193 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146451.log 2024-05-15T19:05:32.194 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.385870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215393.log 2024-05-15T19:05:32.194 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.146451.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.361224.log 2024-05-15T19:05:32.196 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.215393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42497.log 2024-05-15T19:05:32.197 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242328.log 2024-05-15T19:05:32.197 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.361224.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.346542.log.gz 2024-05-15T19:05:32.197 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447756.log 2024-05-15T19:05:32.198 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.242328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250349.log 2024-05-15T19:05:32.199 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.447756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275360.log 2024-05-15T19:05:32.200 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549244.log 2024-05-15T19:05:32.201 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.250349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184552.log 2024-05-15T19:05:32.202 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.275360.log: /var/log/ceph/ceph-client.admin.549244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189510.log 2024-05-15T19:05:32.203 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.358253.log.gz 2024-05-15T19:05:32.203 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418506.log 2024-05-15T19:05:32.204 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.184552.log: /var/log/ceph/ceph-client.admin.189510.log: 90.1%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.361224.log.gz 2024-05-15T19:05:32.204 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.366794.log 2024-05-15T19:05:32.205 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.385861.log.gz 2024-05-15T19:05:32.205 INFO:teuthology.orchestra.run.smithi077.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.274858.log.gz 2024-05-15T19:05:32.205 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.418506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213264.log 2024-05-15T19:05:32.206 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.387218.log.gz 2024-05-15T19:05:32.206 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.366794.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.426171.log.gz 2024-05-15T19:05:32.207 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.429129.log.gz 2024-05-15T19:05:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261526.log 2024-05-15T19:05:32.207 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.385870.log.gz 2024-05-15T19:05:32.207 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.213264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483474.log 2024-05-15T19:05:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.261526.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.429138.log.gz 2024-05-15T19:05:32.208 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441523.log 2024-05-15T19:05:32.209 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.483474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487354.log 2024-05-15T19:05:32.210 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.441523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205023.log 2024-05-15T19:05:32.211 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.487354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255887.log 2024-05-15T19:05:32.212 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251209.log 2024-05-15T19:05:32.212 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.205023.log: /var/log/ceph/ceph-client.admin.255887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259825.log 2024-05-15T19:05:32.213 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151258.log 2024-05-15T19:05:32.214 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.251209.log: gzip/var/log/ceph/ceph-client.admin.259825.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.379611.log 2024-05-15T19:05:32.215 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.151258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565291.log 2024-05-15T19:05:32.216 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.379611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181379.log 2024-05-15T19:05:32.216 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231939.log 2024-05-15T19:05:32.217 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565291.log: /var/log/ceph/ceph-client.admin.181379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545667.log 2024-05-15T19:05:32.218 INFO:teuthology.orchestra.run.smithi077.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.565291.log.gz 2024-05-15T19:05:32.218 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.231939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217263.log 2024-05-15T19:05:32.219 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.545667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466299.log 2024-05-15T19:05:32.220 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.217263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559605.log 2024-05-15T19:05:32.221 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234958.log 2024-05-15T19:05:32.222 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.466299.log: /var/log/ceph/ceph-client.admin.559605.log: gzip -5 --verbose 79.4% -- /var/log/ceph/ceph-client.admin.403800.log -- replaced with /var/log/ceph/ceph-client.admin.478639.log.gz 2024-05-15T19:05:32.222 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.222 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.234958.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.479494.log.gz 2024-05-15T19:05:32.223 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383119.log 2024-05-15T19:05:32.223 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47032.log.gz 2024-05-15T19:05:32.224 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.478220.log.gz 2024-05-15T19:05:32.224 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277518.log 2024-05-15T19:05:32.225 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.403800.log: /var/log/ceph/ceph-client.admin.383119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241423.log 2024-05-15T19:05:32.226 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.277518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206719.log 2024-05-15T19:05:32.226 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.498209.log.gz 2024-05-15T19:05:32.226 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.241423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431314.log 2024-05-15T19:05:32.227 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127745.log 2024-05-15T19:05:32.228 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.206719.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.184552.log.gz 2024-05-15T19:05:32.228 INFO:teuthology.orchestra.run.smithi077.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.223549.log.gz 2024-05-15T19:05:32.228 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.431314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389754.log 2024-05-15T19:05:32.230 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% 85.7% -- replaced with /var/log/ceph/ceph-client.admin.206719.log.gz 2024-05-15T19:05:32.230 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127745.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.212420.log.gz 2024-05-15T19:05:32.230 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110974.log 78.2% -- replaced with /var/log/ceph/ceph-client.admin.442369.log.gz 2024-05-15T19:05:32.230 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.230 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.230194.log.gz 2024-05-15T19:05:32.232 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.389754.log: -- replaced with /var/log/ceph/ceph-client.admin.42497.log.gzgzip 2024-05-15T19:05:32.232 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.381725.log 2024-05-15T19:05:32.232 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.110974.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.213264.log.gz 2024-05-15T19:05:32.232 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.217263.log.gz 2024-05-15T19:05:32.233 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111455.log 2024-05-15T19:05:32.233 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.527460.log.gz 2024-05-15T19:05:32.233 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.381725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127736.log 2024-05-15T19:05:32.234 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501897.log 2024-05-15T19:05:32.234 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558177.log 2024-05-15T19:05:32.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.127736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482856.log 2024-05-15T19:05:32.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.558177.log: /var/log/ceph/ceph-client.admin.501897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120478.log 2024-05-15T19:05:32.235 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.482856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275827.log 2024-05-15T19:05:32.237 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151718.log 2024-05-15T19:05:32.237 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.120478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132405.log 2024-05-15T19:05:32.237 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.275827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216408.log 2024-05-15T19:05:32.238 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.132405.log: /var/log/ceph/ceph-client.admin.151718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538187.log 2024-05-15T19:05:32.239 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211533.log 2024-05-15T19:05:32.240 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.216408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431305.log 2024-05-15T19:05:32.241 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.538187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476737.log 2024-05-15T19:05:32.242 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.211533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475768.log 2024-05-15T19:05:32.242 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.431305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-05-15T19:05:32.243 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.476737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553255.log 2024-05-15T19:05:32.243 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43915.log: /var/log/ceph/ceph-client.admin.475768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563328.log 2024-05-15T19:05:32.244 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539917.log 2024-05-15T19:05:32.245 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.553255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548796.log 2024-05-15T19:05:32.246 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.563328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490888.log 2024-05-15T19:05:32.246 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.548796.log: /var/log/ceph/ceph-client.admin.539917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424005.log 2024-05-15T19:05:32.247 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.490888.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43912.log.gz 2024-05-15T19:05:32.249 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43914.log.gzgzip 2024-05-15T19:05:32.249 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.148176.log 2024-05-15T19:05:32.249 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43357.log.gz 2024-05-15T19:05:32.249 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.563328.log.gz/var/log/ceph/ceph-client.admin.424005.log: 2024-05-15T19:05:32.249 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347811.log/var/log/ceph/ceph-client.admin.148176.log: 2024-05-15T19:05:32.250 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122982.log 2024-05-15T19:05:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.347811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373961.log 2024-05-15T19:05:32.252 INFO:teuthology.orchestra.run.smithi077.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.548796.log.gz 2024-05-15T19:05:32.252 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.122982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404224.log 2024-05-15T19:05:32.253 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.559605.log.gz 2024-05-15T19:05:32.254 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.227206.log.gz 2024-05-15T19:05:32.254 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.373961.log: gzip 90.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.133689.log.gz -- 2024-05-15T19:05:32.254 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.499937.log 2024-05-15T19:05:32.255 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136723.log 2024-05-15T19:05:32.255 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.404224.log: /var/log/ceph/ceph-client.admin.499937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205446.log 2024-05-15T19:05:32.256 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.136723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148632.log 2024-05-15T19:05:32.257 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.205446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138565.log 2024-05-15T19:05:32.259 INFO:teuthology.orchestra.run.smithi077.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.355711.log.gz 2024-05-15T19:05:32.259 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148632.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.355298.log.gz 2024-05-15T19:05:32.259 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341431.log 2024-05-15T19:05:32.259 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.341012.log.gz 2024-05-15T19:05:32.260 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502320.log 2024-05-15T19:05:32.260 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.138565.log: /var/log/ceph/ceph-client.admin.341431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400675.log 2024-05-15T19:05:32.261 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239416.log 2024-05-15T19:05:32.262 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.502320.log: /var/log/ceph/ceph-client.admin.400675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200337.log 2024-05-15T19:05:32.262 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442378.log 2024-05-15T19:05:32.263 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.239416.log: /var/log/ceph/ceph-client.admin.200337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141605.log 2024-05-15T19:05:32.264 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.442378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352714.log 2024-05-15T19:05:32.265 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206728.log 2024-05-15T19:05:32.266 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.352714.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.127736.log.gz 2024-05-15T19:05:32.266 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113130.log 2024-05-15T19:05:32.267 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.206728.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.108128.log.gz 2024-05-15T19:05:32.267 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2024-05-15T19:05:32.268 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157373.log 2024-05-15T19:05:32.268 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.113130.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.127745.log.gz 2024-05-15T19:05:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43904.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.525764.log.gz 2024-05-15T19:05:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469472.log 2024-05-15T19:05:32.269 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157373.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.261940.log.gz 2024-05-15T19:05:32.270 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.525773.log.gz 2024-05-15T19:05:32.270 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.261526.log.gz 2024-05-15T19:05:32.271 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.489546.log.gz 2024-05-15T19:05:32.272 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.489555.log.gz 2024-05-15T19:05:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440075.log 2024-05-15T19:05:32.272 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.469472.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.261949.log.gz 2024-05-15T19:05:32.273 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433449.log.gz 2024-05-15T19:05:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135385.log 2024-05-15T19:05:32.273 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522808.log 2024-05-15T19:05:32.274 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.440075.log: /var/log/ceph/ceph-client.admin.135385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505782.log 2024-05-15T19:05:32.275 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501906.log 2024-05-15T19:05:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.522808.log: /var/log/ceph/ceph-client.admin.505782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447334.log 2024-05-15T19:05:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.501906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141614.log 2024-05-15T19:05:32.277 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498678.log 2024-05-15T19:05:32.278 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.447334.log: /var/log/ceph/ceph-client.admin.141614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442801.log 2024-05-15T19:05:32.279 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.498678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48441.log 2024-05-15T19:05:32.280 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.442801.log: 77.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491751.log 2024-05-15T19:05:32.281 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.474754.log.gz 2024-05-15T19:05:32.281 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410903.log 2024-05-15T19:05:32.282 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469481.log 2024-05-15T19:05:32.283 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.491751.log: /var/log/ceph/ceph-client.admin.410903.log: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.484312.log.gz 2024-05-15T19:05:32.283 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459646.log 2024-05-15T19:05:32.284 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.469481.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.486074.log.gz 2024-05-15T19:05:32.284 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557761.log 2024-05-15T19:05:32.284 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.483897.log.gz 2024-05-15T19:05:32.285 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.459646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480936.log 2024-05-15T19:05:32.286 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376539.log 2024-05-15T19:05:32.286 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.557761.log: /var/log/ceph/ceph-client.admin.480936.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.483474.log.gz 2024-05-15T19:05:32.287 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493516.log 2024-05-15T19:05:32.288 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.376539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443229.log 2024-05-15T19:05:32.289 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.493516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46906.log 2024-05-15T19:05:32.290 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188068.log 2024-05-15T19:05:32.290 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.443229.log: /var/log/ceph/ceph-client.admin.46906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496496.log 2024-05-15T19:05:32.291 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.188068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345260.log 2024-05-15T19:05:32.292 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150350.log 2024-05-15T19:05:32.293 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.496496.log: /var/log/ceph/ceph-client.admin.345260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476746.log 2024-05-15T19:05:32.295 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.150350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148623.log 2024-05-15T19:05:32.296 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.476746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361643.log 2024-05-15T19:05:32.296 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.490888.log.gz 2024-05-15T19:05:32.297 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.148623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187231.log 2024-05-15T19:05:32.298 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.361643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158219.log 2024-05-15T19:05:32.299 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.187231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375646.log 2024-05-15T19:05:32.300 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438151.log 2024-05-15T19:05:32.300 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.158219.log: /var/log/ceph/ceph-client.admin.375646.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.188540.log.gz 2024-05-15T19:05:32.301 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534587.log 2024-05-15T19:05:32.301 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.438151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388247.log 2024-05-15T19:05:32.302 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.338870.log.gz 2024-05-15T19:05:32.302 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350477.log 2024-05-15T19:05:32.303 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.534587.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.459646.log.gz 2024-05-15T19:05:32.303 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.388247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550145.log 2024-05-15T19:05:32.304 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213678.log 2024-05-15T19:05:32.304 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.205023.log.gz 2024-05-15T19:05:32.304 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.350477.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.474267.log.gz 2024-05-15T19:05:32.304 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252052.log 2024-05-15T19:05:32.305 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.466299.log.gz 2024-05-15T19:05:32.305 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.213678.log: /var/log/ceph/ceph-client.admin.550145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402439.log 2024-05-15T19:05:32.306 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565039.log 2024-05-15T19:05:32.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.252052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180047.log 2024-05-15T19:05:32.307 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.402439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237247.log 2024-05-15T19:05:32.308 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.180047.log: /var/log/ceph/ceph-client.admin.565039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214524.log 2024-05-15T19:05:32.308 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565477.log 2024-05-15T19:05:32.309 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.565039.log.gz 2024-05-15T19:05:32.309 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.214524.log: /var/log/ceph/ceph-client.admin.237247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401096.log 2024-05-15T19:05:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.565477.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.565477.log.gz 2024-05-15T19:05:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266252.log 2024-05-15T19:05:32.311 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.401096.log: -- /var/log/ceph/ceph-client.admin.184972.log 2024-05-15T19:05:32.312 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196720.log 2024-05-15T19:05:32.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.266252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504438.log 2024-05-15T19:05:32.312 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.196720.log: /var/log/ceph/ceph-client.admin.184972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552809.log 2024-05-15T19:05:32.313 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553246.log 2024-05-15T19:05:32.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.552809.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.350477.log.gz 2024-05-15T19:05:32.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.504438.log: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.352714.log.gz 2024-05-15T19:05:32.314 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.553246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492589.log 2024-05-15T19:05:32.315 INFO:teuthology.orchestra.run.smithi077.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.155033.log.gz 2024-05-15T19:05:32.315 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.361643.log.gz 2024-05-15T19:05:32.315 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188531.log 2024-05-15T19:05:32.316 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.492589.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.201212.log 2024-05-15T19:05:32.317 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.188531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194441.log 2024-05-15T19:05:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.201212.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.366794.log.gz 2024-05-15T19:05:32.318 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446915.log 2024-05-15T19:05:32.319 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.386284.log.gz 2024-05-15T19:05:32.319 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.194441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111464.log 2024-05-15T19:05:32.320 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.190397.log.gz 2024-05-15T19:05:32.320 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.381725.log.gz 2024-05-15T19:05:32.320 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.446915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129451.log 2024-05-15T19:05:32.321 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.111464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346970.log 2024-05-15T19:05:32.322 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.129451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214101.log 2024-05-15T19:05:32.322 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.248144.log.gz 2024-05-15T19:05:32.323 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191757.log 2024-05-15T19:05:32.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.346970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249928.log 2024-05-15T19:05:32.324 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.191757.log: /var/log/ceph/ceph-client.admin.214101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114705.log 2024-05-15T19:05:32.325 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526196.log 2024-05-15T19:05:32.326 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.249928.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.558177.log.gz 2024-05-15T19:05:32.326 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129018.log 2024-05-15T19:05:32.326 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.373961.log.gz 2024-05-15T19:05:32.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.114705.log: gzip 80.8% -- replaced with /var/log/ceph/ceph-client.admin.213678.log.gz 89.8% 2024-05-15T19:05:32.327 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.539917.log.gz -- 2024-05-15T19:05:32.327 INFO:teuthology.orchestra.run.smithi077.stderr: /var/log/ceph/ceph-client.admin.238085.log 2024-05-15T19:05:32.327 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.526196.log: /var/log/ceph/ceph-client.admin.129018.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.235401.log.gz 2024-05-15T19:05:32.328 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513578.log 2024-05-15T19:05:32.328 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.206728.log.gz 2024-05-15T19:05:32.328 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.238085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488672.log 2024-05-15T19:05:32.329 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.513578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134113.log 2024-05-15T19:05:32.329 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44701.log.gz 2024-05-15T19:05:32.330 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.488672.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446915.log.gz 2024-05-15T19:05:32.330 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363820.log 2024-05-15T19:05:32.331 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.114705.log.gz 2024-05-15T19:05:32.331 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.442801.log.gz 2024-05-15T19:05:32.331 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.134113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207569.log 2024-05-15T19:05:32.332 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.363820.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.136285.log.gz 2024-05-15T19:05:32.332 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386293.log 2024-05-15T19:05:32.333 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.207569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462400.log 2024-05-15T19:05:32.334 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.386293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371521.log 2024-05-15T19:05:32.335 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258988.log 2024-05-15T19:05:32.336 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.462400.log: /var/log/ceph/ceph-client.admin.371521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45378.log 2024-05-15T19:05:32.338 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.258988.log: /var/log/ceph/ceph-client.admin.45378.log: /var/log/ceph/ceph-client.admin.230185.log 2024-05-15T19:05:32.338 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.148623.log.gz 2024-05-15T19:05:32.338 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.157373.log.gz 80.9% -- replaced with /var/log/ceph/ceph-client.admin.195789.log.gz 2024-05-15T19:05:32.338 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.338 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.542630.log.gz 2024-05-15T19:05:32.339 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.379179.log.gz 2024-05-15T19:05:32.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266668.log 2024-05-15T19:05:32.341 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.230185.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.201212.log.gz 2024-05-15T19:05:32.341 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46196.log 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44845.log.gz 90.3% -- replaced with /var/log/ceph/ceph-client.admin.148632.log.gz 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.266668.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.187231.log.gz 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541329.log 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.0.45256.log.gz 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.188068.log.gz 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421841.log 2024-05-15T19:05:32.342 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.113130.log.gz 2024-05-15T19:05:32.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46196.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.266668.log.gz 2024-05-15T19:05:32.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.541329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234949.log 2024-05-15T19:05:32.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.421841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215384.log 2024-05-15T19:05:32.345 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.234949.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.266252.log.gz 2024-05-15T19:05:32.345 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246874.log 2024-05-15T19:05:32.345 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.488672.log.gz 2024-05-15T19:05:32.346 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.215384.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.504438.log.gz 2024-05-15T19:05:32.346 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361652.log 2024-05-15T19:05:32.347 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.246874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457083.log 2024-05-15T19:05:32.348 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.193085.log.gz 2024-05-15T19:05:32.348 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46948.log 2024-05-15T19:05:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.361652.log: /var/log/ceph/ceph-client.admin.457083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538629.log 2024-05-15T19:05:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44743.log 2024-05-15T19:05:32.350 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46948.log: /var/log/ceph/ceph-client.admin.538629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260257.log 2024-05-15T19:05:32.351 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496925.log 2024-05-15T19:05:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.260257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381302.log 2024-05-15T19:05:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499101.log 2024-05-15T19:05:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.496925.log: /var/log/ceph/ceph-client.admin.381302.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.251200.log.gz 2024-05-15T19:05:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197162.log 2024-05-15T19:05:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408338.log 2024-05-15T19:05:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.499101.log: /var/log/ceph/ceph-client.admin.197162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199875.log 2024-05-15T19:05:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.408338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523657.log 2024-05-15T19:05:32.358 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.199875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472073.log 2024-05-15T19:05:32.358 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107279.log 2024-05-15T19:05:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.523657.log: /var/log/ceph/ceph-client.admin.472073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511981.log 2024-05-15T19:05:32.360 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.107279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564675.log 2024-05-15T19:05:32.361 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.511981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265333.log 2024-05-15T19:05:32.363 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.564675.log: gzip -5 83.7% -- replaced with /var/log/ceph/ceph-client.admin.482847.log.gz 2024-05-15T19:05:32.363 INFO:teuthology.orchestra.run.smithi077.stderr: --verbose -- /var/log/ceph/ceph-client.admin.560034.log 2024-05-15T19:05:32.363 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.483888.log.gz 2024-05-15T19:05:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.265333.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.564675.log.gz 2024-05-15T19:05:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141123.log 2024-05-15T19:05:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.560034.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.250786.log.gz 2024-05-15T19:05:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42751.log 2024-05-15T19:05:32.366 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.141123.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.176933.log.gz 2024-05-15T19:05:32.366 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198969.log 2024-05-15T19:05:32.366 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.249928.log.gz 2024-05-15T19:05:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232355.log 2024-05-15T19:05:32.368 INFO:teuthology.orchestra.run.smithi077.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.189510.log.gz 80.2% -- replaced with /var/log/ceph/ceph-client.admin.462400.log.gz 2024-05-15T19:05:32.368 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:32.368 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.198969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198065.log 2024-05-15T19:05:32.369 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.232355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249919.log 2024-05-15T19:05:32.371 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.198065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526620.log 2024-05-15T19:05:32.372 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.249919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407460.log 2024-05-15T19:05:32.373 INFO:teuthology.orchestra.run.smithi077.stderr:gzip 80.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.536806.log.gz --verbose 2024-05-15T19:05:32.373 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.526620.log: -- /var/log/ceph/ceph-client.admin.250777.log 2024-05-15T19:05:32.374 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.407460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493933.log 2024-05-15T19:05:32.375 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.250777.log: -- /var/log/ceph/ceph-client.admin.511972.log 2024-05-15T19:05:32.376 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.493933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551037.log 2024-05-15T19:05:32.376 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115128.log 2024-05-15T19:05:32.377 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.511972.log: /var/log/ceph/ceph-client.admin.551037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414311.log 2024-05-15T19:05:32.378 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.115128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125123.log 2024-05-15T19:05:32.379 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.464601.log.gz 2024-05-15T19:05:32.379 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.414311.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.541338.log 2024-05-15T19:05:32.379 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.553246.log.gz 2024-05-15T19:05:32.380 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.125123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436453.log 2024-05-15T19:05:32.381 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341003.log 2024-05-15T19:05:32.382 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.541338.log: /var/log/ceph/ceph-client.admin.436453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43315.log 2024-05-15T19:05:32.383 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.341003.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.346970.log.gz 2024-05-15T19:05:32.383 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465884.log 2024-05-15T19:05:32.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220277.log 2024-05-15T19:05:32.384 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.465884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227630.log 2024-05-15T19:05:32.385 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.220277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202494.log 2024-05-15T19:05:32.386 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.227630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424866.log 2024-05-15T19:05:32.387 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.202494.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.378317.log 2024-05-15T19:05:32.388 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.424866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529156.log 2024-05-15T19:05:32.389 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5/var/log/ceph/ceph-client.admin.378317.log: --verbose -- /var/log/ceph/ceph-client.admin.444537.log 2024-05-15T19:05:32.389 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.529156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503175.log 2024-05-15T19:05:32.390 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.444537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433877.log 2024-05-15T19:05:32.391 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.503175.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.545254.log.gz 2024-05-15T19:05:32.391 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547002.log 2024-05-15T19:05:32.392 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.433877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433012.log 2024-05-15T19:05:32.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.547002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366370.log 2024-05-15T19:05:32.393 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.433012.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.238085.log.gz 2024-05-15T19:05:32.394 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47849.log 2024-05-15T19:05:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.366370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157787.log 2024-05-15T19:05:32.396 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.47849.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.123423.log 2024-05-15T19:05:32.397 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.157787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464173.log 2024-05-15T19:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.123423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484736.log 2024-05-15T19:05:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.464173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234078.log 2024-05-15T19:05:32.399 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.484736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407469.log 2024-05-15T19:05:32.400 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.234078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497771.log 2024-05-15T19:05:32.401 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.407469.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.122107.log.gz 2024-05-15T19:05:32.401 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114235.log 2024-05-15T19:05:32.402 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.497771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402011.log 2024-05-15T19:05:32.405 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.114235.log: /var/log/ceph/ceph-client.admin.402011.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46948.log.gz 2024-05-15T19:05:32.406 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.491751.log.gz 2024-05-15T19:05:32.409 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46469.log.gz 2024-05-15T19:05:32.411 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.246874.log.gz 2024-05-15T19:05:32.412 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.230185.log.gz 2024-05-15T19:05:32.413 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.278372.log.gz 2024-05-15T19:05:32.418 INFO:teuthology.orchestra.run.smithi077.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.535001.log.gz 2024-05-15T19:05:32.418 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.534587.log.gz 2024-05-15T19:05:32.431 INFO:teuthology.orchestra.run.smithi077.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43578.log.gz 2024-05-15T19:05:32.431 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.115128.log.gz 2024-05-15T19:05:32.434 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.134113.log.gz 2024-05-15T19:05:32.434 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.215384.log.gz 2024-05-15T19:05:32.437 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.149936.log.gz 2024-05-15T19:05:32.438 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.532793.log.gz 2024-05-15T19:05:32.439 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.560034.log.gz 2024-05-15T19:05:32.439 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.409212.log.gz 2024-05-15T19:05:32.440 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.198969.log.gz 2024-05-15T19:05:32.440 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.199875.log.gz 2024-05-15T19:05:32.440 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.108638.log.gz 2024-05-15T19:05:32.442 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202494.log.gz 2024-05-15T19:05:32.442 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.486922.log.gz 2024-05-15T19:05:32.445 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.234078.log.gz 2024-05-15T19:05:32.450 INFO:teuthology.orchestra.run.smithi077.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.390701.log.gz 2024-05-15T19:05:32.451 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.389754.log.gz 2024-05-15T19:05:32.452 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.495204.log.gz 2024-05-15T19:05:32.452 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.265333.log.gz 2024-05-15T19:05:32.453 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.264073.log.gz 2024-05-15T19:05:32.464 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.547002.log.gz 2024-05-15T19:05:32.464 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.503175.log.gz 2024-05-15T19:05:32.467 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431314.log.gz 2024-05-15T19:05:32.481 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.363820.log.gz 2024-05-15T19:05:32.483 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.365956.log.gz 2024-05-15T19:05:32.486 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.359511.log.gz 2024-05-15T19:05:32.488 INFO:teuthology.orchestra.run.smithi077.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.551920.log.gz 2024-05-15T19:05:32.494 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.350940.log.gz 2024-05-15T19:05:32.501 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.425311.log.gz 2024-05-15T19:05:32.502 INFO:teuthology.orchestra.run.smithi077.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.387732.log.gz 2024-05-15T19:05:32.512 INFO:teuthology.orchestra.run.smithi077.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.359934.log.gz 2024-05-15T19:05:32.544 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2024-05-15T19:05:32.558 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.408757.log.gz 2024-05-15T19:05:32.558 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.410056.log.gz 2024-05-15T19:05:32.565 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44250.log.gz 2024-05-15T19:05:32.566 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2024-05-15T19:05:32.566 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43572.log.gz 2024-05-15T19:05:32.567 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44659.log.gz 2024-05-15T19:05:32.568 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.134530.log.gz 2024-05-15T19:05:32.568 INFO:teuthology.orchestra.run.smithi077.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.159208.log.gz 2024-05-15T19:05:32.577 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.238967.log.gz 2024-05-15T19:05:32.577 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.188955.log.gz 2024-05-15T19:05:32.578 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.237670.log.gz 2024-05-15T19:05:32.601 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.176942.log.gz 2024-05-15T19:05:32.603 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.372495.log.gz 2024-05-15T19:05:32.610 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.446241.log.gz 2024-05-15T19:05:32.612 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.273059.log.gz 2024-05-15T19:05:32.614 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.386740.log.gz 2024-05-15T19:05:32.615 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.416590.log.gz 2024-05-15T19:05:32.622 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.338879.log.gz 2024-05-15T19:05:32.622 INFO:teuthology.orchestra.run.smithi077.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.341003.log.gz 2024-05-15T19:05:32.627 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.232355.log.gz 2024-05-15T19:05:32.647 INFO:teuthology.orchestra.run.smithi077.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45378.log.gz 2024-05-15T19:05:32.649 INFO:teuthology.orchestra.run.smithi077.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46196.log.gz 2024-05-15T19:05:32.650 INFO:teuthology.orchestra.run.smithi077.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.180047.log.gz 2024-05-15T19:05:32.650 INFO:teuthology.orchestra.run.smithi077.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.211542.log.gz 2024-05-15T19:05:32.662 INFO:teuthology.orchestra.run.smithi077.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.139408.log.gz 2024-05-15T19:05:32.668 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.557329.log.gz 2024-05-15T19:05:32.675 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.177797.log.gz 2024-05-15T19:05:32.676 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2024-05-15T19:05:32.680 INFO:teuthology.orchestra.run.smithi077.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.374799.log.gz 2024-05-15T19:05:32.680 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42663.log.gz 2024-05-15T19:05:32.680 INFO:teuthology.orchestra.run.smithi083.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-15T19:05:32.681 INFO:teuthology.orchestra.run.smithi077.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.267978.log.gz 2024-05-15T19:05:32.683 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.375232.log.gz 2024-05-15T19:05:32.685 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.217254.log.gz 2024-05-15T19:05:32.685 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.210201.log.gz 2024-05-15T19:05:32.688 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.444959.log.gz 2024-05-15T19:05:32.694 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2024-05-15T19:05:32.695 INFO:teuthology.orchestra.run.smithi083.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-15T19:05:32.696 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.135394.log.gz 2024-05-15T19:05:32.696 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.130298.log.gz 2024-05-15T19:05:32.697 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.149503.log.gz 2024-05-15T19:05:32.697 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.156940.log.gz 2024-05-15T19:05:32.697 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.378326.log.gz 2024-05-15T19:05:32.698 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.124278.log.gz 2024-05-15T19:05:32.699 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.191305.log.gz 2024-05-15T19:05:32.699 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.443658.log.gz 2024-05-15T19:05:32.700 INFO:teuthology.orchestra.run.smithi077.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.235834.log.gz 2024-05-15T19:05:32.704 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.197171.log.gz 2024-05-15T19:05:32.707 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.547457.log.gz 2024-05-15T19:05:32.711 INFO:teuthology.orchestra.run.smithi077.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.434718.log.gz 2024-05-15T19:05:32.711 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.260680.log.gz 2024-05-15T19:05:32.712 INFO:teuthology.orchestra.run.smithi077.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.124692.log.gz 2024-05-15T19:05:32.712 INFO:teuthology.orchestra.run.smithi077.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.488663.log.gz 2024-05-15T19:05:32.715 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.199884.log.gz 2024-05-15T19:05:32.720 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.484745.log.gz 2024-05-15T19:05:32.722 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.131982.log.gz 2024-05-15T19:05:32.730 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.463757.log.gz 2024-05-15T19:05:32.733 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.523648.log.gz 2024-05-15T19:05:32.735 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.467719.log.gz 2024-05-15T19:05:32.735 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.468157.log.gz 2024-05-15T19:05:32.738 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.122559.log.gz 2024-05-15T19:05:32.742 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.486508.log.gz 2024-05-15T19:05:32.744 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.513569.log.gz 2024-05-15T19:05:32.745 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.351364.log.gz 2024-05-15T19:05:32.745 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.357400.log.gz 2024-05-15T19:05:32.746 INFO:teuthology.orchestra.run.smithi077.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.356133.log.gz 2024-05-15T19:05:32.746 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.418214.log.gz 2024-05-15T19:05:32.746 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.383616.log.gz 2024-05-15T19:05:32.752 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.220710.log.gz 2024-05-15T19:05:32.767 INFO:teuthology.orchestra.run.smithi077.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.557752.log.gz 2024-05-15T19:05:32.767 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.531323.log.gz 2024-05-15T19:05:32.779 INFO:teuthology.orchestra.run.smithi077.stderr: 77.0% -- replaced with /var/log/ceph/ceph-client.admin.530879.log.gz 2024-05-15T19:05:32.781 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.526620.log.gz 2024-05-15T19:05:32.781 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.526196.log.gz 2024-05-15T19:05:32.782 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.224456.log.gz 2024-05-15T19:05:32.783 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.246451.log.gz 2024-05-15T19:05:32.783 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.556449.log.gz 2024-05-15T19:05:32.784 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.218153.log.gz 2024-05-15T19:05:32.788 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.481848.log.gz 2024-05-15T19:05:32.795 INFO:teuthology.orchestra.run.smithi077.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.411333.log.gz 2024-05-15T19:05:32.798 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.341440.log.gz 2024-05-15T19:05:32.804 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-05-15T19:05:32.808 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.134104.log.gz 2024-05-15T19:05:32.817 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.532802.log.gz 2024-05-15T19:05:32.817 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.543968.log.gz 2024-05-15T19:05:32.817 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.544818.log.gz 2024-05-15T19:05:32.822 INFO:teuthology.orchestra.run.smithi077.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.196259.log.gz 2024-05-15T19:05:32.822 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.197614.log.gz 2024-05-15T19:05:32.829 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.263219.log.gz 2024-05-15T19:05:32.830 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46720.log.gz 2024-05-15T19:05:32.830 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.492166.log.gz 2024-05-15T19:05:32.832 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.400666.log.gz 2024-05-15T19:05:32.841 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.208002.log.gz 2024-05-15T19:05:32.841 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.136714.log.gz 2024-05-15T19:05:32.844 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.119999.log.gz 2024-05-15T19:05:32.845 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.185964.log.gz 2024-05-15T19:05:32.847 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.236262.log.gz 2024-05-15T19:05:32.849 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47979.log.gz 2024-05-15T19:05:32.851 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.524080.log.gz 2024-05-15T19:05:32.858 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.431737.log.gz 2024-05-15T19:05:32.858 INFO:teuthology.orchestra.run.smithi077.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.521101.log.gz 2024-05-15T19:05:32.858 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.258979.log.gz 2024-05-15T19:05:32.865 INFO:teuthology.orchestra.run.smithi077.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.418116.log.gz 2024-05-15T19:05:32.865 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.351355.log.gz 2024-05-15T19:05:32.877 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.367239.log.gz 2024-05-15T19:05:32.881 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.176505.log.gz 2024-05-15T19:05:32.882 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.174389.log.gz 2024-05-15T19:05:32.883 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.430430.log.gz 2024-05-15T19:05:32.889 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.416130.log.gz 2024-05-15T19:05:32.924 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.190853.log.gz 2024-05-15T19:05:32.926 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.480927.log.gz 2024-05-15T19:05:32.928 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.539908.log.gz 2024-05-15T19:05:32.929 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46511.log.gz 2024-05-15T19:05:32.933 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.183131.log.gz 93.5% 2024-05-15T19:05:32.933 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.505329.log.gz 2024-05-15T19:05:32.933 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.371058.log.gz 2024-05-15T19:05:32.934 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43189.log.gz 2024-05-15T19:05:32.934 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36798.log.gz 2024-05-15T19:05:32.941 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.234502.log.gz 2024-05-15T19:05:32.943 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44575.log.gz 2024-05-15T19:05:32.950 INFO:teuthology.orchestra.run.smithi077.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.138084.log.gz 2024-05-15T19:05:32.955 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.248640.log.gz 2024-05-15T19:05:32.957 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.226774.log.gz 2024-05-15T19:05:32.958 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.226360.log.gz 2024-05-15T19:05:32.960 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.198978.log.gz 2024-05-15T19:05:32.961 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.255468.log.gz 2024-05-15T19:05:32.963 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.128164.log.gz 2024-05-15T19:05:32.964 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.131145.log.gz 2024-05-15T19:05:32.967 INFO:teuthology.orchestra.run.smithi077.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.260248.log.gz 2024-05-15T19:05:32.969 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.233203.log.gz 2024-05-15T19:05:32.969 INFO:teuthology.orchestra.run.smithi077.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.264064.log.gz 2024-05-15T19:05:32.972 INFO:teuthology.orchestra.run.smithi077.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.496916.log.gz 2024-05-15T19:05:32.972 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.264496.log.gz 2024-05-15T19:05:32.973 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.125546.log.gz 2024-05-15T19:05:32.985 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.516544.log.gz 2024-05-15T19:05:33.010 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.221124.log.gz 2024-05-15T19:05:33.011 INFO:teuthology.orchestra.run.smithi077.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.184052.log.gz 2024-05-15T19:05:33.019 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.257171.log.gz 2024-05-15T19:05:33.020 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.267969.log.gz 2024-05-15T19:05:33.040 INFO:teuthology.orchestra.run.smithi077.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.552800.log.gz 2024-05-15T19:05:33.045 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.427440.log.gz 2024-05-15T19:05:33.047 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356142.log.gz 2024-05-15T19:05:33.047 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.362067.log.gz 2024-05-15T19:05:33.048 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.360357.log.gz 2024-05-15T19:05:33.048 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.357831.log.gz 2024-05-15T19:05:33.048 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.380879.log.gz 2024-05-15T19:05:33.051 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.417442.log.gz 2024-05-15T19:05:33.051 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.424014.log.gz 2024-05-15T19:05:33.055 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.223104.log.gz 2024-05-15T19:05:33.064 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.183140.log.gz 2024-05-15T19:05:33.067 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.420532.log.gz 2024-05-15T19:05:33.068 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.421388.log.gz 2024-05-15T19:05:33.072 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.522372.log.gz 2024-05-15T19:05:33.073 INFO:teuthology.orchestra.run.smithi077.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.522799.log.gz 2024-05-15T19:05:33.073 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.527883.log.gz 2024-05-15T19:05:33.075 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.527469.log.gz 2024-05-15T19:05:33.080 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.173952.log.gz 2024-05-15T19:05:33.081 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.370212.log.gz 2024-05-15T19:05:33.081 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42937.log.gz 2024-05-15T19:05:33.082 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43105.log.gz 2024-05-15T19:05:33.084 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.231030.log.gz 2024-05-15T19:05:33.095 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.560949.log.gz 2024-05-15T19:05:33.095 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.129442.log.gz 2024-05-15T19:05:33.096 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.258556.log.gz 2024-05-15T19:05:33.097 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.259411.log.gz 2024-05-15T19:05:33.097 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.340147.log.gz 2024-05-15T19:05:33.104 INFO:teuthology.orchestra.run.smithi077.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.198517.log.gz 2024-05-15T19:05:33.108 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.187645.log.gz 2024-05-15T19:05:33.110 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.261094.log.gz 2024-05-15T19:05:33.112 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.434299.log.gz 2024-05-15T19:05:33.113 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.490879.log.gz 2024-05-15T19:05:33.115 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.147315.log.gz 2024-05-15T19:05:33.116 INFO:teuthology.orchestra.run.smithi077.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.538620.log.gz 2024-05-15T19:05:33.118 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.482274.log.gz 2024-05-15T19:05:33.119 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.175226.log.gz 2024-05-15T19:05:33.120 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.177788.log.gz 2024-05-15T19:05:33.122 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.431728.log.gz 2024-05-15T19:05:33.122 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.177375.log.gz 2024-05-15T19:05:33.124 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.494780.log.gz 2024-05-15T19:05:33.125 INFO:teuthology.orchestra.run.smithi077.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.228914.log.gz 2024-05-15T19:05:33.126 INFO:teuthology.orchestra.run.smithi077.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.555532.log.gz 2024-05-15T19:05:33.126 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.229337.log.gz 2024-05-15T19:05:33.135 INFO:teuthology.orchestra.run.smithi077.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.519432.log.gz 2024-05-15T19:05:33.136 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.524503.log.gz 2024-05-15T19:05:33.138 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.525349.log.gz 2024-05-15T19:05:33.138 INFO:teuthology.orchestra.run.smithi077.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.390232.log.gz 2024-05-15T19:05:33.138 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.392149.log.gz 2024-05-15T19:05:33.140 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.479503.log.gz 2024-05-15T19:05:33.142 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.208854.log.gz 2024-05-15T19:05:33.142 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.548805.log.gz 2024-05-15T19:05:33.143 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.342715.log.gz 2024-05-15T19:05:33.152 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.215994.log.gz 2024-05-15T19:05:33.152 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.388238.log.gz 2024-05-15T19:05:33.185 INFO:teuthology.orchestra.run.smithi077.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.228053.log.gz 2024-05-15T19:05:33.188 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.109140.log.gz 2024-05-15T19:05:33.190 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.183596.log.gz 2024-05-15T19:05:33.198 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.402448.log.gz 2024-05-15T19:05:33.198 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.236271.log.gz 2024-05-15T19:05:33.198 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.540404.log.gz 2024-05-15T19:05:33.212 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42579.log.gz 2024-05-15T19:05:33.212 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43063.log.gz 2024-05-15T19:05:33.213 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.246883.log.gz 2024-05-15T19:05:33.217 INFO:teuthology.orchestra.run.smithi077.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.443220.log.gz 2024-05-15T19:05:33.220 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.555068.log.gz 2024-05-15T19:05:33.220 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44449.log.gz 2024-05-15T19:05:33.221 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.445841.log.gz 2024-05-15T19:05:33.221 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2024-05-15T19:05:33.222 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.136294.log.gz 2024-05-15T19:05:33.222 INFO:teuthology.orchestra.run.smithi077.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.122973.log.gz 2024-05-15T19:05:33.224 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.542621.log.gz 2024-05-15T19:05:33.225 INFO:teuthology.orchestra.run.smithi077.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.194432.log.gz 2024-05-15T19:05:33.225 INFO:teuthology.orchestra.run.smithi077.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.194885.log.gz 2024-05-15T19:05:33.226 INFO:teuthology.orchestra.run.smithi077.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.201639.log.gz 2024-05-15T19:05:33.226 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.494357.log.gz 2024-05-15T19:05:33.226 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.435565.log.gz 2024-05-15T19:05:33.231 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.229770.log.gz 2024-05-15T19:05:33.237 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.238976.log.gz 2024-05-15T19:05:33.240 INFO:teuthology.orchestra.run.smithi077.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.183587.log.gz 2024-05-15T19:05:33.257 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.174812.log.gz 2024-05-15T19:05:33.263 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.480449.log.gz 2024-05-15T19:05:33.265 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.530004.log.gz 2024-05-15T19:05:33.267 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.460579.log.gz 2024-05-15T19:05:33.268 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.420969.log.gz 2024-05-15T19:05:33.275 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.346105.log.gz 2024-05-15T19:05:33.276 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.468166.log.gz 2024-05-15T19:05:33.281 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.473851.log.gz 2024-05-15T19:05:33.287 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.386731.log.gz 2024-05-15T19:05:33.287 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.362972.log.gz 2024-05-15T19:05:33.287 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.423146.log.gz 2024-05-15T19:05:33.308 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.354872.log.gz 2024-05-15T19:05:33.308 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.353570.log.gz 2024-05-15T19:05:33.315 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.487777.log.gz 2024-05-15T19:05:33.328 INFO:teuthology.orchestra.run.smithi077.stderr: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.273050.log.gz 2024-05-15T19:05:33.328 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.372486.log.gz 2024-05-15T19:05:33.329 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.213255.log.gz 2024-05-15T19:05:33.341 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.414787.log.gz 2024-05-15T19:05:33.342 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2024-05-15T19:05:33.342 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.415705.log.gz 2024-05-15T19:05:33.342 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.200785.log.gz 2024-05-15T19:05:33.343 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.130721.log.gz 2024-05-15T19:05:33.346 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.174380.log.gz 2024-05-15T19:05:33.347 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.125114.log.gz 2024-05-15T19:05:33.352 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.494366.log.gz 2024-05-15T19:05:33.362 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.218576.log.gz 2024-05-15T19:05:33.364 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.380034.log.gz 2024-05-15T19:05:33.373 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.537720.log.gz 2024-05-15T19:05:33.375 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.201221.log.gz 2024-05-15T19:05:33.379 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.409635.log.gz 2024-05-15T19:05:33.386 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.470812.log.gz 2024-05-15T19:05:33.386 INFO:teuthology.orchestra.run.smithi077.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.350931.log.gz 2024-05-15T19:05:33.386 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.349956.log.gz 2024-05-15T19:05:33.410 INFO:teuthology.orchestra.run.smithi077.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.68876.log.gz 2024-05-15T19:05:33.411 INFO:teuthology.orchestra.run.smithi077.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.241432.log.gz 2024-05-15T19:05:33.415 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.492598.log.gz 2024-05-15T19:05:33.419 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47116.log.gz 2024-05-15T19:05:33.429 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.549253.log.gz 2024-05-15T19:05:33.437 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.560958.log.gz 2024-05-15T19:05:33.441 INFO:teuthology.orchestra.run.smithi077.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.557320.log.gz 2024-05-15T19:05:33.442 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.550136.log.gz 2024-05-15T19:05:33.446 INFO:teuthology.orchestra.run.smithi077.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.558186.log.gz 2024-05-15T19:05:33.451 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47158.log.gz 2024-05-15T19:05:33.455 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.254179.log.gz 2024-05-15T19:05:33.469 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.212842.log.gz 2024-05-15T19:05:33.478 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.448179.log.gz 2024-05-15T19:05:33.479 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.245381.log.gz 2024-05-15T19:05:33.480 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2024-05-15T19:05:33.482 INFO:teuthology.orchestra.run.smithi077.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48189.log.gz 2024-05-15T19:05:33.484 INFO:teuthology.orchestra.run.smithi077.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.110069.log.gz 2024-05-15T19:05:33.485 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.420111.log.gz 2024-05-15T19:05:33.496 INFO:teuthology.orchestra.run.smithi077.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.537263.log.gz 2024-05-15T19:05:33.506 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.228923.log.gz 2024-05-15T19:05:33.510 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.499092.log.gz 2024-05-15T19:05:33.514 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.456650.log.gz 2024-05-15T19:05:33.515 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.497338.log.gz 2024-05-15T19:05:33.525 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.149927.log.gz 2024-05-15T19:05:33.529 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.485660.log.gz 2024-05-15T19:05:33.529 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.488248.log.gz 2024-05-15T19:05:33.531 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.148167.log.gz 2024-05-15T19:05:33.536 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.214956.log.gz 2024-05-15T19:05:33.538 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.459202.log.gz 2024-05-15T19:05:33.540 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.459655.log.gz 2024-05-15T19:05:33.542 INFO:teuthology.orchestra.run.smithi077.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.237661.log.gz 2024-05-15T19:05:33.543 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.495213.log.gz 2024-05-15T19:05:33.544 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.204177.log.gz 2024-05-15T19:05:33.544 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.203763.log.gz 2024-05-15T19:05:33.554 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.382168.log.gz 2024-05-15T19:05:33.554 INFO:teuthology.orchestra.run.smithi077.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.417004.log.gz 2024-05-15T19:05:33.555 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.424857.log.gz 2024-05-15T19:05:33.571 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.489096.log.gz 2024-05-15T19:05:33.577 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.441947.log.gz 2024-05-15T19:05:33.583 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.475759.log.gz 2024-05-15T19:05:33.587 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.509057.log.gz 2024-05-15T19:05:33.599 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.189970.log.gz 2024-05-15T19:05:33.601 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.121231.log.gz 2024-05-15T19:05:33.609 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.471227.log.gz 2024-05-15T19:05:33.614 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.550591.log.gz 2024-05-15T19:05:33.618 INFO:teuthology.orchestra.run.smithi077.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.159217.log.gz 2024-05-15T19:05:33.620 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.539475.log.gz 2024-05-15T19:05:33.620 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.529165.log.gz 2024-05-15T19:05:33.623 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.155042.log.gz 2024-05-15T19:05:33.630 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.219431.log.gz 2024-05-15T19:05:33.636 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48021.log.gz 2024-05-15T19:05:33.636 INFO:teuthology.orchestra.run.smithi077.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.121673.log.gz 2024-05-15T19:05:33.638 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.207144.log.gz 2024-05-15T19:05:33.640 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.276251.log.gz 2024-05-15T19:05:33.640 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.110502.log.gz 2024-05-15T19:05:33.641 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.129865.log.gz 2024-05-15T19:05:33.641 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.132837.log.gz 2024-05-15T19:05:33.650 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.158526.log.gz 2024-05-15T19:05:33.650 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.229346.log.gz 2024-05-15T19:05:33.651 INFO:teuthology.orchestra.run.smithi077.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47074.log.gz 2024-05-15T19:05:33.652 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.121240.log.gz 2024-05-15T19:05:33.655 INFO:teuthology.orchestra.run.smithi077.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.114226.log.gz 2024-05-15T19:05:33.657 INFO:teuthology.orchestra.run.smithi077.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.545245.log.gz 2024-05-15T19:05:33.661 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.503166.log.gz 2024-05-15T19:05:33.663 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.257180.log.gz 2024-05-15T19:05:33.665 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.225927.log.gz 2024-05-15T19:05:33.670 INFO:teuthology.orchestra.run.smithi077.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.376103.log.gz 2024-05-15T19:05:33.674 INFO:teuthology.orchestra.run.smithi077.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.534578.log.gz 2024-05-15T19:05:33.674 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.198074.log.gz 2024-05-15T19:05:33.675 INFO:teuthology.orchestra.run.smithi077.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.535424.log.gz 2024-05-15T19:05:33.676 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.176086.log.gz 2024-05-15T19:05:33.690 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.176514.log.gz 2024-05-15T19:05:33.694 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.343980.log.gz 2024-05-15T19:05:33.702 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.360780.log.gz 2024-05-15T19:05:33.703 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.362981.log.gz 2024-05-15T19:05:33.707 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.363405.log.gz 2024-05-15T19:05:33.708 INFO:teuthology.orchestra.run.smithi077.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.415696.log.gz 2024-05-15T19:05:33.709 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.365533.log.gz 2024-05-15T19:05:33.724 INFO:teuthology.orchestra.run.smithi077.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.459211.log.gz 2024-05-15T19:05:33.736 INFO:teuthology.orchestra.run.smithi077.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.501239.log.gz 2024-05-15T19:05:33.737 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.428279.log.gz 2024-05-15T19:05:33.737 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428288.log.gz 2024-05-15T19:05:33.741 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.355289.log.gz 2024-05-15T19:05:33.757 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.238518.log.gz 2024-05-15T19:05:33.760 INFO:teuthology.orchestra.run.smithi077.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.463293.log.gz 2024-05-15T19:05:33.767 INFO:teuthology.orchestra.run.smithi077.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.530436.log.gz 2024-05-15T19:05:33.774 INFO:teuthology.orchestra.run.smithi077.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-05-15T19:05:33.775 INFO:teuthology.orchestra.run.smithi077.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.212411.log.gz 2024-05-15T19:05:33.796 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48399.log.gz 2024-05-15T19:05:33.797 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43917.log.gz 2024-05-15T19:05:33.797 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.132414.log.gz 2024-05-15T19:05:33.815 INFO:teuthology.orchestra.run.smithi083.stderr: 95.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-15T19:05:33.823 INFO:teuthology.orchestra.run.smithi077.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.389745.log.gz 2024-05-15T19:05:33.832 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.247730.log.gz 2024-05-15T19:05:33.833 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401105.log.gz 2024-05-15T19:05:33.834 INFO:teuthology.orchestra.run.smithi077.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.405110.log.gz 2024-05-15T19:05:33.836 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.501230.log.gz 2024-05-15T19:05:33.838 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.481360.log.gz 2024-05-15T19:05:33.839 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.175654.log.gz 2024-05-15T19:05:33.841 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.476248.log.gz 2024-05-15T19:05:33.841 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.254188.log.gz 2024-05-15T19:05:33.843 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.420541.log.gz 2024-05-15T19:05:33.844 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.267526.log.gz 2024-05-15T19:05:33.845 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.209758.log.gz 2024-05-15T19:05:33.850 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.522381.log.gz 2024-05-15T19:05:33.854 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.189519.log.gz 2024-05-15T19:05:33.856 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.158794.log.gz 2024-05-15T19:05:33.866 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.417856.log.gz 2024-05-15T19:05:33.867 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.425320.log.gz 2024-05-15T19:05:33.867 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.547011.log.gz 2024-05-15T19:05:33.881 INFO:teuthology.orchestra.run.smithi077.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.551474.log.gz 2024-05-15T19:05:33.887 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.233212.log.gz 2024-05-15T19:05:33.892 INFO:teuthology.orchestra.run.smithi077.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.463302.log.gz 2024-05-15T19:05:33.901 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.220701.log.gz 2024-05-15T19:05:33.909 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.487768.log.gz 2024-05-15T19:05:33.914 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.474276.log.gz 2024-05-15T19:05:33.920 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.195798.log.gz 2024-05-15T19:05:33.923 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.147749.log.gz 2024-05-15T19:05:33.927 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.537729.log.gz 2024-05-15T19:05:33.927 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.491318.log.gz 2024-05-15T19:05:33.932 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.539058.log.gz 2024-05-15T19:05:33.934 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.524917.log.gz 2024-05-15T19:05:33.937 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47211.log.gz 2024-05-15T19:05:33.942 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.543482.log.gz 2024-05-15T19:05:33.945 INFO:teuthology.orchestra.run.smithi077.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.241871.log.gz 2024-05-15T19:05:33.954 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.447765.log.gz 2024-05-15T19:05:33.954 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.220268.log.gz 2024-05-15T19:05:33.955 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2024-05-15T19:05:33.956 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.123846.log.gz 2024-05-15T19:05:33.957 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.131991.log.gz 2024-05-15T19:05:33.968 INFO:teuthology.orchestra.run.smithi077.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.472983.log.gz 2024-05-15T19:05:33.975 INFO:teuthology.orchestra.run.smithi077.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.191748.log.gz 2024-05-15T19:05:33.979 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.256324.log.gz 2024-05-15T19:05:33.980 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.181803.log.gz 2024-05-15T19:05:33.982 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.233654.log.gz 2024-05-15T19:05:34.004 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.359097.log.gz 2024-05-15T19:05:34.013 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.521524.log.gz 2024-05-15T19:05:34.016 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.533657.log.gz 2024-05-15T19:05:34.018 INFO:teuthology.orchestra.run.smithi077.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.553692.log.gz 2024-05-15T19:05:34.020 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.175235.log.gz 2024-05-15T19:05:34.053 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.353984.log.gz 2024-05-15T19:05:34.053 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.422269.log.gz 2024-05-15T19:05:34.066 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.352723.log.gz 2024-05-15T19:05:34.067 INFO:teuthology.orchestra.run.smithi077.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.356556.log.gz 2024-05-15T19:05:34.068 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.420102.log.gz 2024-05-15T19:05:34.068 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.427855.log.gz 2024-05-15T19:05:34.069 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.363829.log.gz 2024-05-15T19:05:34.106 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.543049.log.gz 2024-05-15T19:05:34.109 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.547906.log.gz 2024-05-15T19:05:34.109 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.263634.log.gz 2024-05-15T19:05:34.111 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.340577.log.gz 2024-05-15T19:05:34.113 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.471236.log.gz 2024-05-15T19:05:34.113 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.491309.log.gz 2024-05-15T19:05:34.115 INFO:teuthology.orchestra.run.smithi077.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.555997.log.gz 2024-05-15T19:05:34.124 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.273477.log.gz 2024-05-15T19:05:34.126 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.370221.log.gz 2024-05-15T19:05:34.134 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.277954.log.gz 2024-05-15T19:05:34.135 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.215985.log.gz 2024-05-15T19:05:34.136 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.408329.log.gz 2024-05-15T19:05:34.136 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.149054.log.gz 2024-05-15T19:05:34.137 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133253.log.gz 2024-05-15T19:05:34.140 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.479070.log.gz 2024-05-15T19:05:34.145 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.549700.log.gz 2024-05-15T19:05:34.153 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.139846.log.gz 2024-05-15T19:05:34.154 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.490042.log.gz 2024-05-15T19:05:34.161 INFO:teuthology.orchestra.run.smithi077.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.115975.log.gz 2024-05-15T19:05:34.162 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.491742.log.gz 2024-05-15T19:05:34.164 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.432585.log.gz 2024-05-15T19:05:34.164 INFO:teuthology.orchestra.run.smithi077.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.254603.log.gz 2024-05-15T19:05:34.165 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.458766.log.gz 2024-05-15T19:05:34.165 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.480440.log.gz 2024-05-15T19:05:34.175 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.243189.log.gz 2024-05-15T19:05:34.178 INFO:teuthology.orchestra.run.smithi077.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.234493.log.gz 2024-05-15T19:05:34.186 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.250358.log.gz 2024-05-15T19:05:34.188 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.345692.log.gz 2024-05-15T19:05:34.189 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.363396.log.gz 2024-05-15T19:05:34.189 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.384952.log.gz 2024-05-15T19:05:34.189 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.251633.log.gz 2024-05-15T19:05:34.190 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.362554.log.gz 2024-05-15T19:05:34.190 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.413861.log.gz 2024-05-15T19:05:34.194 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.221133.log.gz 2024-05-15T19:05:34.221 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43567.log.gz 2024-05-15T19:05:34.221 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43581.log.gz 2024-05-15T19:05:34.221 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-05-15T19:05:34.222 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.224011.log.gz 2024-05-15T19:05:34.236 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.155970.log.gz 2024-05-15T19:05:34.238 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.194894.log.gz 2024-05-15T19:05:34.239 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.376548.log.gz 2024-05-15T19:05:34.239 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.411342.log.gz 2024-05-15T19:05:34.241 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.462409.log.gz 2024-05-15T19:05:34.249 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.540910.log.gz 2024-05-15T19:05:34.254 INFO:teuthology.orchestra.run.smithi077.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142028.log.gz 2024-05-15T19:05:34.254 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.265795.log.gz 2024-05-15T19:05:34.256 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2024-05-15T19:05:34.259 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.211997.log.gz 2024-05-15T19:05:34.262 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.243608.log.gz 2024-05-15T19:05:34.262 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.216840.log.gz 2024-05-15T19:05:34.264 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.244031.log.gz 2024-05-15T19:05:34.267 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48507.log.gz 2024-05-15T19:05:34.267 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47500.log.gz 2024-05-15T19:05:34.269 INFO:teuthology.orchestra.run.smithi077.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.536349.log.gz 2024-05-15T19:05:34.270 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.551929.log.gz 2024-05-15T19:05:34.277 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.115552.log.gz 2024-05-15T19:05:34.281 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.207153.log.gz 2024-05-15T19:05:34.283 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.190388.log.gz 2024-05-15T19:05:34.283 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.500967.log.gz 2024-05-15T19:05:34.283 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.504016.log.gz 2024-05-15T19:05:34.287 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.267517.log.gz 2024-05-15T19:05:34.287 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.264919.log.gz 2024-05-15T19:05:34.296 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.410479.log.gz 2024-05-15T19:05:34.297 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.199430.log.gz 2024-05-15T19:05:34.309 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.252489.log.gz 2024-05-15T19:05:34.323 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.173961.log.gz 2024-05-15T19:05:34.329 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.470336.log.gz 2024-05-15T19:05:34.330 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.415205.log.gz 2024-05-15T19:05:34.330 INFO:teuthology.orchestra.run.smithi077.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.507461.log.gz 2024-05-15T19:05:34.332 INFO:teuthology.orchestra.run.smithi077.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.348233.log.gz 2024-05-15T19:05:34.333 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.346114.log.gz 2024-05-15T19:05:34.334 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.353138.log.gz 2024-05-15T19:05:34.336 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.364244.log.gz 2024-05-15T19:05:34.336 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.383128.log.gz 2024-05-15T19:05:34.337 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.384511.log.gz 2024-05-15T19:05:34.339 INFO:teuthology.orchestra.run.smithi077.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.456179.log.gz 2024-05-15T19:05:34.368 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.276675.log.gz 2024-05-15T19:05:34.372 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.430002.log.gz 2024-05-15T19:05:34.385 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.357409.log.gz 2024-05-15T19:05:34.410 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.125964.log.gz 2024-05-15T19:05:34.415 INFO:teuthology.orchestra.run.smithi077.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.432161.log.gz 2024-05-15T19:05:34.417 INFO:teuthology.orchestra.run.smithi077.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.214947.log.gz 2024-05-15T19:05:34.419 INFO:teuthology.orchestra.run.smithi077.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.140272.log.gz 2024-05-15T19:05:34.420 INFO:teuthology.orchestra.run.smithi077.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.140700.log.gz 2024-05-15T19:05:34.420 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.242765.log.gz 2024-05-15T19:05:34.421 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.410488.log.gz 2024-05-15T19:05:34.422 INFO:teuthology.orchestra.run.smithi077.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.131559.log.gz 2024-05-15T19:05:34.423 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.192661.log.gz 2024-05-15T19:05:34.424 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.242337.log.gz 2024-05-15T19:05:34.425 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.255896.log.gz 2024-05-15T19:05:34.433 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.502329.log.gz 2024-05-15T19:05:34.435 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.503600.log.gz 2024-05-15T19:05:34.440 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.371067.log.gz 2024-05-15T19:05:34.445 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.407047.log.gz 2024-05-15T19:05:34.446 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.474763.log.gz 2024-05-15T19:05:34.448 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.460570.log.gz 2024-05-15T19:05:34.450 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.460090.log.gz 2024-05-15T19:05:34.450 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.527044.log.gz 2024-05-15T19:05:34.453 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.204600.log.gz 2024-05-15T19:05:34.456 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.155462.log.gz 2024-05-15T19:05:34.464 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.546544.log.gz 2024-05-15T19:05:34.465 INFO:teuthology.orchestra.run.smithi077.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.550582.log.gz 2024-05-15T19:05:34.470 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.138988.log.gz 2024-05-15T19:05:34.472 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.344417.log.gz 2024-05-15T19:05:34.473 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.362545.log.gz 2024-05-15T19:05:34.473 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.365099.log.gz 2024-05-15T19:05:34.477 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.427864.log.gz 2024-05-15T19:05:34.496 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.429993.log.gz 2024-05-15T19:05:34.497 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.429574.log.gz 2024-05-15T19:05:34.506 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.465452.log.gz 2024-05-15T19:05:34.506 INFO:teuthology.orchestra.run.smithi077.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.466723.log.gz 2024-05-15T19:05:34.516 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.528316.log.gz 2024-05-15T19:05:34.531 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-05-15T19:05:34.532 INFO:teuthology.orchestra.run.smithi077.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.533222.log.gz 2024-05-15T19:05:34.532 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.214110.log.gz 2024-05-15T19:05:34.556 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.489087.log.gz 2024-05-15T19:05:34.557 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.210210.log.gz 2024-05-15T19:05:34.559 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.367657.log.gz 2024-05-15T19:05:34.581 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.492175.log.gz 2024-05-15T19:05:34.582 INFO:teuthology.orchestra.run.smithi077.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.179173.log.gz 2024-05-15T19:05:34.582 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.176077.log.gz 2024-05-15T19:05:34.583 INFO:teuthology.orchestra.run.smithi077.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.237238.log.gz 2024-05-15T19:05:34.585 INFO:teuthology.orchestra.run.smithi077.stderr: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.510449.log.gz 2024-05-15T19:05:34.585 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.253337.log.gz 2024-05-15T19:05:34.586 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.257594.log.gz 2024-05-15T19:05:34.588 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356565.log.gz 2024-05-15T19:05:34.589 INFO:teuthology.orchestra.run.smithi077.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.156417.log.gz 2024-05-15T19:05:34.599 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46070.log.gz 2024-05-15T19:05:34.599 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46333.log.gz 2024-05-15T19:05:34.622 INFO:teuthology.orchestra.run.smithi077.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.371512.log.gz 2024-05-15T19:05:34.625 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.247297.log.gz 2024-05-15T19:05:34.634 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.401583.log.gz 2024-05-15T19:05:34.635 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.182256.log.gz 2024-05-15T19:05:34.638 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.223095.log.gz 2024-05-15T19:05:34.643 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.339721.log.gz 2024-05-15T19:05:34.645 INFO:teuthology.orchestra.run.smithi077.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.342283.log.gz 2024-05-15T19:05:34.645 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.232788.log.gz 2024-05-15T19:05:34.649 INFO:teuthology.orchestra.run.smithi077.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.504891.log.gz 2024-05-15T19:05:34.655 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.198526.log.gz 2024-05-15T19:05:34.659 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.496067.log.gz 2024-05-15T19:05:34.665 INFO:teuthology.orchestra.run.smithi077.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.262795.log.gz 2024-05-15T19:05:34.669 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.250349.log.gz 2024-05-15T19:05:34.672 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.255031.log.gz 2024-05-15T19:05:34.674 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.464182.log.gz 2024-05-15T19:05:34.678 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.138979.log.gz 2024-05-15T19:05:34.681 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.441532.log.gz 2024-05-15T19:05:34.684 INFO:teuthology.orchestra.run.smithi077.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.521948.log.gz 2024-05-15T19:05:34.686 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.344832.log.gz 2024-05-15T19:05:34.688 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.364253.log.gz 2024-05-15T19:05:34.688 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.382159.log.gz 2024-05-15T19:05:34.688 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.343138.log.gz 2024-05-15T19:05:34.690 INFO:teuthology.orchestra.run.smithi077.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.126427.log.gz 2024-05-15T19:05:34.711 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.549244.log.gz 2024-05-15T19:05:34.711 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.471650.log.gz 2024-05-15T19:05:34.731 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46028.log.gz 2024-05-15T19:05:34.731 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.377431.log.gz 2024-05-15T19:05:34.737 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2024-05-15T19:05:34.745 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.224465.log.gz 2024-05-15T19:05:34.747 INFO:teuthology.orchestra.run.smithi077.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.534090.log.gz 2024-05-15T19:05:34.752 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.467161.log.gz 2024-05-15T19:05:34.756 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.273917.log.gz 2024-05-15T19:05:34.758 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.242328.log.gz 2024-05-15T19:05:34.760 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.404224.log.gz 2024-05-15T19:05:34.760 INFO:teuthology.orchestra.run.smithi077.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44617.log.gz 2024-05-15T19:05:34.761 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43575.log.gz 2024-05-15T19:05:34.770 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461981.log.gz 2024-05-15T19:05:34.789 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.255887.log.gz 2024-05-15T19:05:34.789 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.203340.log.gz 2024-05-15T19:05:34.818 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.251209.log.gz 2024-05-15T19:05:34.856 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.520840.log.gz 2024-05-15T19:05:34.864 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.528741.log.gz 2024-05-15T19:05:34.874 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.259825.log.gz 2024-05-15T19:05:34.876 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.258565.log.gz 2024-05-15T19:05:34.876 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.239416.log.gz 2024-05-15T19:05:34.884 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.226783.log.gz 2024-05-15T19:05:34.891 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.467729.log.gz 2024-05-15T19:05:34.891 INFO:teuthology.orchestra.run.smithi077.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.469004.log.gz 2024-05-15T19:05:34.895 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.223558.log.gz 2024-05-15T19:05:34.919 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.479079.log.gz 2024-05-15T19:05:34.922 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.538187.log.gz 2024-05-15T19:05:34.939 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.139417.log.gz 2024-05-15T19:05:34.940 INFO:teuthology.orchestra.run.smithi077.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.151718.log.gz 2024-05-15T19:05:34.942 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.241423.log.gz 2024-05-15T19:05:34.949 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.498218.log.gz 2024-05-15T19:05:34.951 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.277518.log.gz 2024-05-15T19:05:34.951 INFO:teuthology.orchestra.run.smithi077.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-05-15T19:05:34.958 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.475279.log.gz 2024-05-15T19:05:34.966 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.195337.log.gz 2024-05-15T19:05:34.969 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.359088.log.gz 2024-05-15T19:05:34.984 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.496058.log.gz 2024-05-15T19:05:34.985 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231939.log.gz 2024-05-15T19:05:34.991 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.458343.log.gz 2024-05-15T19:05:34.997 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.151249.log.gz 2024-05-15T19:05:34.999 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.545667.log.gz 2024-05-15T19:05:35.003 INFO:teuthology.orchestra.run.smithi077.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.177366.log.gz 2024-05-15T19:05:35.008 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.134539.log.gz 2024-05-15T19:05:35.009 INFO:teuthology.orchestra.run.smithi077.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.107693.log.gz 2024-05-15T19:05:35.011 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.111455.log.gz 2024-05-15T19:05:35.021 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.113812.log.gz 2024-05-15T19:05:35.024 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.375646.log.gz 2024-05-15T19:05:35.033 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.476737.log.gz 2024-05-15T19:05:35.034 INFO:teuthology.orchestra.run.smithi077.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.499937.log.gz 2024-05-15T19:05:35.066 INFO:teuthology.orchestra.run.smithi077.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.360789.log.gz 2024-05-15T19:05:35.066 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.522808.log.gz 2024-05-15T19:05:35.071 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.557761.log.gz 2024-05-15T19:05:35.078 INFO:teuthology.orchestra.run.smithi077.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.440075.log.gz 2024-05-15T19:05:35.079 INFO:teuthology.orchestra.run.smithi077.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.0.48767.log.gz 2024-05-15T19:05:35.103 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.182265.log.gz 2024-05-15T19:05:35.113 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42401.log.gz 2024-05-15T19:05:35.114 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.553255.log.gz 2024-05-15T19:05:35.116 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.214524.log.gz 2024-05-15T19:05:35.119 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.541771.log.gz 2024-05-15T19:05:35.119 INFO:teuthology.orchestra.run.smithi077.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.410903.log.gz 2024-05-15T19:05:35.120 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2024-05-15T19:05:35.121 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.443229.log.gz 2024-05-15T19:05:35.126 INFO:teuthology.orchestra.run.smithi077.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46906.log.gz 2024-05-15T19:05:35.127 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.202071.log.gz 2024-05-15T19:05:35.132 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.501906.log.gz 2024-05-15T19:05:35.133 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.493516.log.gz 2024-05-15T19:05:35.133 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.150350.log.gz 2024-05-15T19:05:35.138 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.138565.log.gz 2024-05-15T19:05:35.139 INFO:teuthology.orchestra.run.smithi077.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.147306.log.gz 2024-05-15T19:05:35.144 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.252052.log.gz 2024-05-15T19:05:35.146 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.476746.log.gz 2024-05-15T19:05:35.146 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.498678.log.gz 2024-05-15T19:05:35.148 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.135385.log.gz 2024-05-15T19:05:35.155 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.480936.log.gz 2024-05-15T19:05:35.160 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.414302.log.gz 2024-05-15T19:05:35.162 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.466308.log.gz 2024-05-15T19:05:35.167 INFO:teuthology.orchestra.run.smithi077.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.547448.log.gz 2024-05-15T19:05:35.168 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.345260.log.gz 2024-05-15T19:05:35.192 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.418166.log.gz 2024-05-15T19:05:35.197 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.141605.log.gz 2024-05-15T19:05:35.222 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.386293.log.gz 2024-05-15T19:05:35.236 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.472082.log.gz 2024-05-15T19:05:35.243 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.540413.log.gz 2024-05-15T19:05:35.246 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.473415.log.gz 2024-05-15T19:05:35.247 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.387227.log.gz 2024-05-15T19:05:35.254 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.274366.log.gz 2024-05-15T19:05:35.263 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.214101.log.gz 2024-05-15T19:05:35.269 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.107270.log.gz 2024-05-15T19:05:35.279 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.142499.log.gz 2024-05-15T19:05:35.284 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237247.log.gz 2024-05-15T19:05:35.288 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.234949.log.gz 2024-05-15T19:05:35.289 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.543959.log.gz 2024-05-15T19:05:35.296 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.493933.log.gz 2024-05-15T19:05:35.296 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.267102.log.gz 2024-05-15T19:05:35.297 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.197623.log.gz 2024-05-15T19:05:35.297 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.493019.log.gz 2024-05-15T19:05:35.298 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.496925.log.gz 2024-05-15T19:05:35.306 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.371521.log.gz 2024-05-15T19:05:35.308 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.373474.log.gz 2024-05-15T19:05:35.311 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.441956.log.gz 2024-05-15T19:05:35.314 INFO:teuthology.orchestra.run.smithi077.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.129018.log.gz 2024-05-15T19:05:35.316 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.252480.log.gz 2024-05-15T19:05:35.317 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.380457.log.gz 2024-05-15T19:05:35.319 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.499101.log.gz 2024-05-15T19:05:35.333 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.473406.log.gz 2024-05-15T19:05:35.361 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.551483.log.gz 2024-05-15T19:05:35.361 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.541329.log.gz 2024-05-15T19:05:35.365 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.457074.log.gz 2024-05-15T19:05:35.366 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.180484.log.gz 2024-05-15T19:05:35.366 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.125973.log.gz 2024-05-15T19:05:35.367 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.384520.log.gz 2024-05-15T19:05:35.375 INFO:teuthology.orchestra.run.smithi077.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.367230.log.gz 2024-05-15T19:05:35.379 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.349518.log.gz 2024-05-15T19:05:35.382 INFO:teuthology.orchestra.run.smithi077.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.402011.log.gz 2024-05-15T19:05:35.394 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43315.log.gz 2024-05-15T19:05:35.395 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.410065.log.gz 2024-05-15T19:05:35.433 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.197162.log.gz 2024-05-15T19:05:35.433 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.227630.log.gz 2024-05-15T19:05:35.441 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.423577.log.gz 2024-05-15T19:05:35.441 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.424005.log.gz 2024-05-15T19:05:35.452 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.421841.log.gz 2024-05-15T19:05:35.456 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.353561.log.gz 2024-05-15T19:05:35.478 INFO:teuthology.orchestra.run.smithi077.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.273486.log.gz 2024-05-15T19:05:35.485 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.234958.log.gz 2024-05-15T19:05:35.488 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.157787.log.gz 2024-05-15T19:05:35.493 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.470345.log.gz 2024-05-15T19:05:35.493 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.260257.log.gz 2024-05-15T19:05:35.494 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.256743.log.gz 2024-05-15T19:05:35.496 INFO:teuthology.orchestra.run.smithi077.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.432152.log.gz 2024-05-15T19:05:35.496 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.185452.log.gz 2024-05-15T19:05:35.497 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.225461.log.gz 2024-05-15T19:05:35.506 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.433868.log.gz 2024-05-15T19:05:35.508 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.436453.log.gz 2024-05-15T19:05:35.509 INFO:teuthology.orchestra.run.smithi077.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.250777.log.gz 2024-05-15T19:05:35.511 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.465884.log.gz 2024-05-15T19:05:35.514 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.191757.log.gz 2024-05-15T19:05:35.523 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.196720.log.gz 2024-05-15T19:05:35.525 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.198065.log.gz 2024-05-15T19:05:35.529 INFO:teuthology.orchestra.run.smithi077.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.274867.log.gz 2024-05-15T19:05:35.531 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.181388.log.gz 2024-05-15T19:05:35.535 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.150359.log.gz 2024-05-15T19:05:35.561 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.107702.log.gz 2024-05-15T19:05:35.562 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.129874.log.gz 2024-05-15T19:05:35.570 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.148176.log.gz 2024-05-15T19:05:35.581 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.541338.log.gz 2024-05-15T19:05:35.582 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.546131.log.gz 2024-05-15T19:05:35.582 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.484736.log.gz 2024-05-15T19:05:35.586 INFO:teuthology.orchestra.run.smithi077.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.249919.log.gz 2024-05-15T19:05:35.593 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.476257.log.gz 2024-05-15T19:05:35.620 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.107279.log.gz 2024-05-15T19:05:35.624 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.366370.log.gz 2024-05-15T19:05:35.629 INFO:teuthology.orchestra.run.smithi077.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.245999.log.gz 2024-05-15T19:05:35.642 INFO:teuthology.orchestra.run.smithi077.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.202062.log.gz 2024-05-15T19:05:35.651 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.529156.log.gz 2024-05-15T19:05:35.658 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.155961.log.gz 2024-05-15T19:05:35.660 INFO:teuthology.orchestra.run.smithi077.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.339294.log.gz 2024-05-15T19:05:35.660 INFO:teuthology.orchestra.run.smithi077.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.495628.log.gz 2024-05-15T19:05:35.661 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433877.log.gz 2024-05-15T19:05:35.664 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.205455.log.gz 2024-05-15T19:05:35.664 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.433012.log.gz 2024-05-15T19:05:35.666 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.535010.log.gz 2024-05-15T19:05:35.674 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.376971.log.gz 2024-05-15T19:05:35.676 INFO:teuthology.orchestra.run.smithi077.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.246008.log.gz 2024-05-15T19:05:35.686 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.407460.log.gz 2024-05-15T19:05:35.687 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.407469.log.gz 2024-05-15T19:05:35.688 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.408338.log.gz 2024-05-15T19:05:35.699 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.468589.log.gz 2024-05-15T19:05:35.710 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.341864.log.gz 2024-05-15T19:05:35.710 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.348655.log.gz 2024-05-15T19:05:35.712 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.348242.log.gz 2024-05-15T19:05:35.725 INFO:teuthology.orchestra.run.smithi077.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.485225.log.gz 2024-05-15T19:05:35.725 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.485234.log.gz 2024-05-15T19:05:35.741 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.184981.log.gz 2024-05-15T19:05:35.747 INFO:teuthology.orchestra.run.smithi077.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz 2024-05-15T19:05:35.757 INFO:teuthology.orchestra.run.smithi077.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.354407.log.gz 2024-05-15T19:05:35.760 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.427008.log.gz 2024-05-15T19:05:35.774 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.114714.log.gz 2024-05-15T19:05:35.792 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.225936.log.gz 2024-05-15T19:05:35.794 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.226351.log.gz 2024-05-15T19:05:35.794 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.224945.log.gz 2024-05-15T19:05:35.796 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.127313.log.gz 2024-05-15T19:05:35.797 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.128600.log.gz 2024-05-15T19:05:35.797 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.208426.log.gz 2024-05-15T19:05:35.811 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.238094.log.gz 2024-05-15T19:05:35.813 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.490465.log.gz 2024-05-15T19:05:35.820 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.123423.log.gz 2024-05-15T19:05:35.823 INFO:teuthology.orchestra.run.smithi077.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47710.log.gz 2024-05-15T19:05:35.824 INFO:teuthology.orchestra.run.smithi077.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.485651.log.gz 2024-05-15T19:05:35.824 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.137659.log.gz 2024-05-15T19:05:35.832 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.378757.log.gz 2024-05-15T19:05:35.849 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.464610.log.gz 2024-05-15T19:05:35.862 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.347820.log.gz 2024-05-15T19:05:35.870 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.426162.log.gz 2024-05-15T19:05:35.881 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.555523.log.gz 2024-05-15T19:05:35.901 INFO:teuthology.orchestra.run.smithi077.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.524494.log.gz 2024-05-15T19:05:35.901 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.526187.log.gz 2024-05-15T19:05:35.904 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.526611.log.gz 2024-05-15T19:05:35.904 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.530888.log.gz 2024-05-15T19:05:35.937 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.384037.log.gz 2024-05-15T19:05:35.938 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.384961.log.gz 2024-05-15T19:05:35.939 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.123432.log.gz 2024-05-15T19:05:35.941 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.146886.log.gz 2024-05-15T19:05:35.945 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.182717.log.gz 2024-05-15T19:05:35.945 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.222038.log.gz 2024-05-15T19:05:35.945 INFO:teuthology.orchestra.run.smithi077.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.227621.log.gz 2024-05-15T19:05:35.946 INFO:teuthology.orchestra.run.smithi077.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.228491.log.gz 2024-05-15T19:05:35.963 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.495637.log.gz 2024-05-15T19:05:35.980 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428716.log.gz 2024-05-15T19:05:36.003 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.216417.log.gz 2024-05-15T19:05:36.004 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.220277.log.gz 2024-05-15T19:05:36.022 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.125123.log.gz 2024-05-15T19:05:36.040 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.552374.log.gz 2024-05-15T19:05:36.043 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.178249.log.gz 2024-05-15T19:05:36.047 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.426594.log.gz 2024-05-15T19:05:37.777 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.554593.log.gz 2024-05-15T19:05:37.777 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.141123.log.gz 2024-05-15T19:05:37.778 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.554584.log.gz 2024-05-15T19:05:37.778 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.355720.log.gz 2024-05-15T19:05:37.778 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.524926.log.gz 2024-05-15T19:05:37.778 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442378.log.gz 2024-05-15T19:05:37.778 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.438142.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% 92.3% -- replaced with /var/log/ceph/ceph-client.admin.554147.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.199421.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.137188.log.gz 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433021.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.120478.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.149063.log.gz 80.6% -- replaced with /var/log/ceph/ceph-client.admin.349090.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.444110.log.gz 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.779 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% 79.7% -- replaced with /var/log/ceph/ceph-client.admin.188531.log.gz 2024-05-15T19:05:37.780 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.376112.log.gz 2024-05-15T19:05:37.780 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.339303.log.gz 81.5% -- replaced with /var/log/ceph/ceph-client.admin.372978.log.gz 2024-05-15T19:05:37.780 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.780 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.359520.log.gz 90.2% 2024-05-15T19:05:37.780 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.437723.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.251624.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.389261.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 81.6% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.441523.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.196711.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% 79.3% -- replaced with /var/log/ceph/ceph-client.admin.275818.log.gz 94.0% -- replaced with /var/log/ceph/ceph-client.admin.200337.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.186799.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.234069.log.gz 2024-05-15T19:05:37.781 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.458775.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.527892.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% 79.4% 80.2% -- replaced with /var/log/ceph/ceph-client.admin.525340.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.184043.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.362076.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141614.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.275360.log.gz 2024-05-15T19:05:37.782 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43273.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44249.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.174803.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.181812.log.gz 84.1% -- replaced with /var/log/ceph/ceph-client.admin.492589.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.159660.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% 90.1% -- replaced with /var/log/ceph/ceph-client.admin.252061.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.274375.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.252913.log.gz -- replaced with /var/log/ceph/ceph-client.admin.343561.log.gz 2024-05-15T19:05:37.783 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.142919.log.gz 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% 81.3% 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.376962.log.gz 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.540901.log.gz 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.222633.log.gz 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.423155.log.gz 85.0% 85.9% -- replaced with /var/log/ceph/ceph-client.admin.403322.log.gz -- replaced with /var/log/ceph/ceph-client.admin.110965.log.gz 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.413870.log.gz 2024-05-15T19:05:37.784 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: 79.1% 79.1% 78.2% -- replaced with /var/log/ceph/ceph-client.admin.424428.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.253328.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.216408.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.425739.log.gz -- replaced with /var/log/ceph/ceph-client.admin.523232.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.496496.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.194441.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140709.log.gz 2024-05-15T19:05:37.785 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.538629.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.402439.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42751.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.493028.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% 84.5% -- replaced with /var/log/ceph/ceph-client.admin.444537.log.gz -- replaced with /var/log/ceph/ceph-client.admin.152175.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.378317.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% 92.9% -- replaced with /var/log/ceph/ceph-client.admin.151727.log.gz 2024-05-15T19:05:37.786 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156949.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.388762.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192209.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.156426.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.215393.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% 80.4% -- replaced with /var/log/ceph/ceph-client.admin.132828.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.401096.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.340586.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 88.3% 82.6% -- replaced with /var/log/ceph/ceph-client.admin.210653.log.gz 2024-05-15T19:05:37.787 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.129451.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42895.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.479960.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.178240.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.486931.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.275827.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.556440.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2024-05-15T19:05:37.788 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% 81.2% -- replaced with /var/log/ceph/ceph-client.admin.458352.log.gz 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.262786.log.gz 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46864.log.gz 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: 83.4% 82.2% -- replaced with /var/log/ceph/ceph-client.admin.501469.log.gz -- replaced with /var/log/ceph/ceph-client.admin.500497.log.gz 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.258047.log.gz 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: 86.1% 79.2% -- replaced with /var/log/ceph/ceph-client.admin.203754.log.gz -- replaced with /var/log/ceph/ceph-client.admin.264910.log.gz 2024-05-15T19:05:37.789 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.205032.log.gz 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.204609.log.gz 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 80.8% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42853.log.gz -- replaced with /var/log/ceph/ceph-client.admin.531757.log.gz 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.560465.log.gz 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.447343.log.gz 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% 90.3% -- replaced with /var/log/ceph/ceph-client.admin.523657.log.gz 2024-05-15T19:05:37.790 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.487354.log.gz 2024-05-15T19:05:37.791 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.383119.log.gz 2024-05-15T19:05:37.791 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.361652.log.gz 2024-05-15T19:05:37.791 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.475768.log.gz 2024-05-15T19:05:37.791 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.528307.log.gz 2024-05-15T19:05:37.791 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.472073.log.gz 2024-05-15T19:05:37.791 INFO:teuthology.orchestra.run.smithi077.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.472496.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.403791.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.400675.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.544382.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.218999.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.242756.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.247306.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48147.log.gz 2024-05-15T19:05:37.792 INFO:teuthology.orchestra.run.smithi077.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.277945.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42793.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.208845.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.205446.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.243617.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 85.1% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.434727.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.351787.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.502320.log.gz 2024-05-15T19:05:37.793 INFO:teuthology.orchestra.run.smithi077.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.556883.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.411802.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.417865.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.146451.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.405534.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.408766.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.219008.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46804.log.gz 2024-05-15T19:05:37.794 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.499523.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113803.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.180475.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.206303.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.128173.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.196268.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461069.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% 81.0% -- replaced with /var/log/ceph/ceph-client.admin.558629.log.gz -- replaced with /var/log/ceph/ceph-client.admin.352200.log.gz 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:37.795 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218162.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.447756.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: 81.1% 84.2% 83.9% -- replaced with /var/log/ceph/ceph-client.admin.511972.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.255040.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135813.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.207569.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: 89.8% 84.7% -- replaced with /var/log/ceph/ceph-client.admin.202908.log.gz 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.543058.log.gz 90.3% 2024-05-15T19:05:37.796 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.263643.log.gz 2024-05-15T19:05:37.797 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.443649.log.gz 2024-05-15T19:05:37.797 INFO:teuthology.orchestra.run.smithi077.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.190844.log.gz 2024-05-15T19:05:37.797 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.247721.log.gz 2024-05-15T19:05:37.797 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.549691.log.gz 2024-05-15T19:05:37.797 INFO:teuthology.orchestra.run.smithi077.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.544391.log.gz 2024-05-15T19:05:37.797 INFO:teuthology.orchestra.run.smithi077.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.370635.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.410912.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.359943.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% 83.8% -- replaced with /var/log/ceph/ceph-client.admin.181379.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.379611.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.542197.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.501897.log.gz 2024-05-15T19:05:37.798 INFO:teuthology.orchestra.run.smithi077.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.376539.log.gz 2024-05-15T19:05:37.820 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.418263.log.gz 2024-05-15T19:05:37.822 INFO:teuthology.orchestra.run.smithi077.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.195346.log.gz 2024-05-15T19:05:37.830 INFO:teuthology.orchestra.run.smithi077.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.371999.log.gz 2024-05-15T19:05:37.876 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.446120.log.gz 2024-05-15T19:05:37.890 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.457083.log.gz 2024-05-15T19:05:37.893 INFO:teuthology.orchestra.run.smithi077.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.464173.log.gz 2024-05-15T19:05:38.125 INFO:teuthology.orchestra.run.smithi077.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.344408.log.gz 2024-05-15T19:05:38.192 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.461549.log.gz 2024-05-15T19:05:38.203 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.548352.log.gz 2024-05-15T19:05:38.204 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.533231.log.gz 2024-05-15T19:05:38.249 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.552809.log.gz 2024-05-15T19:05:38.251 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.403800.log.gz 2024-05-15T19:05:38.251 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.200794.log.gz 2024-05-15T19:05:38.253 INFO:teuthology.orchestra.run.smithi077.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.268426.log.gz 2024-05-15T19:05:38.256 INFO:teuthology.orchestra.run.smithi077.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.211533.log.gz 2024-05-15T19:05:38.268 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.430860.log.gz 2024-05-15T19:05:38.270 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.500521.log.gz 2024-05-15T19:05:38.273 INFO:teuthology.orchestra.run.smithi077.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42979.log.gz 2024-05-15T19:05:38.282 INFO:teuthology.orchestra.run.smithi077.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.482856.log.gz 2024-05-15T19:05:38.344 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.354416.log.gz 2024-05-15T19:05:38.372 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.219845.log.gz 2024-05-15T19:05:38.378 INFO:teuthology.orchestra.run.smithi077.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.184972.log.gz 2024-05-15T19:05:38.379 INFO:teuthology.orchestra.run.smithi077.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.256752.log.gz 2024-05-15T19:05:38.380 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.207578.log.gz 2024-05-15T19:05:38.385 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.341431.log.gz 2024-05-15T19:05:38.429 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.543473.log.gz 2024-05-15T19:05:38.466 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.469472.log.gz 2024-05-15T19:05:38.486 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.545676.log.gz 2024-05-15T19:05:38.499 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.353993.log.gz 2024-05-15T19:05:38.500 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.345683.log.gz 2024-05-15T19:05:38.515 INFO:teuthology.orchestra.run.smithi077.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.517968.log.gz 2024-05-15T19:05:38.564 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.551037.log.gz 2024-05-15T19:05:38.571 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.193989.log.gz 2024-05-15T19:05:38.598 INFO:teuthology.orchestra.run.smithi077.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47849.log.gz 2024-05-15T19:05:38.599 INFO:teuthology.orchestra.run.smithi077.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.106669.log.gz 2024-05-15T19:05:38.633 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.193076.log.gz 2024-05-15T19:05:38.635 INFO:teuthology.orchestra.run.smithi077.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.203331.log.gz 2024-05-15T19:05:38.645 INFO:teuthology.orchestra.run.smithi077.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.409203.log.gz 2024-05-15T19:05:38.657 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.384046.log.gz 2024-05-15T19:05:38.701 INFO:teuthology.orchestra.run.smithi077.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.446129.log.gz 2024-05-15T19:05:38.703 INFO:teuthology.orchestra.run.smithi077.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.188077.log.gz 2024-05-15T19:05:38.715 INFO:teuthology.orchestra.run.smithi077.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.365947.log.gz 2024-05-15T19:05:38.719 INFO:teuthology.orchestra.run.smithi077.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.381302.log.gz 2024-05-15T19:05:38.779 INFO:teuthology.orchestra.run.smithi077.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.447334.log.gz 2024-05-15T19:05:38.785 INFO:teuthology.orchestra.run.smithi077.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.224936.log.gz 2024-05-15T19:05:38.795 INFO:teuthology.orchestra.run.smithi077.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.377886.log.gz 2024-05-15T19:05:38.798 INFO:teuthology.orchestra.run.smithi077.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.435142.log.gz 2024-05-15T19:05:38.812 INFO:teuthology.orchestra.run.smithi077.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.132405.log.gz 2024-05-15T19:05:38.838 INFO:teuthology.orchestra.run.smithi077.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.411793.log.gz 2024-05-15T19:05:38.915 INFO:teuthology.orchestra.run.smithi077.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42309.log.gz 2024-05-15T19:05:38.939 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.210662.log.gz 2024-05-15T19:05:38.948 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.372987.log.gz 2024-05-15T19:05:38.994 INFO:teuthology.orchestra.run.smithi077.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.358244.log.gz 2024-05-15T19:05:39.059 INFO:teuthology.orchestra.run.smithi077.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.420960.log.gz 2024-05-15T19:05:39.132 INFO:teuthology.orchestra.run.smithi077.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.540677.log.gz 2024-05-15T19:05:39.135 INFO:teuthology.orchestra.run.smithi077.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.231039.log.gz 2024-05-15T19:05:39.143 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.550145.log.gz 2024-05-15T19:05:39.147 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.151258.log.gz 2024-05-15T19:05:39.154 INFO:teuthology.orchestra.run.smithi077.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.535433.log.gz 2024-05-15T19:05:39.192 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.185461.log.gz 2024-05-15T19:05:39.198 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.553701.log.gz 2024-05-15T19:05:39.203 INFO:teuthology.orchestra.run.smithi077.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.469481.log.gz 2024-05-15T19:05:39.203 INFO:teuthology.orchestra.run.smithi077.stderr: 82.7% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.200328.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47933.log.gz 2024-05-15T19:05:39.204 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T19:05:39.302 INFO:teuthology.orchestra.run.smithi077.stderr: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.347811.log.gz 2024-05-15T19:05:39.308 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.342292.log.gz 2024-05-15T19:05:39.491 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.150787.log.gz 2024-05-15T19:05:39.629 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.418223.log.gz 2024-05-15T19:05:39.785 INFO:teuthology.orchestra.run.smithi077.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.113375.log.gz 2024-05-15T19:05:39.840 INFO:teuthology.orchestra.run.smithi077.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.184543.log.gz 2024-05-15T19:05:39.854 INFO:teuthology.orchestra.run.smithi077.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44743.log.gz 2024-05-15T19:05:39.926 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.533666.log.gz 2024-05-15T19:05:40.042 INFO:teuthology.orchestra.run.smithi077.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.48441.log.gz 2024-05-15T19:05:40.094 INFO:teuthology.orchestra.run.smithi077.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.390241.log.gz 2024-05-15T19:05:40.106 INFO:teuthology.orchestra.run.smithi077.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.546553.log.gz 2024-05-15T19:05:40.107 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.380043.log.gz 2024-05-15T19:05:40.219 INFO:teuthology.orchestra.run.smithi077.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.390710.log.gz 2024-05-15T19:05:40.221 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.180936.log.gz 2024-05-15T19:05:40.227 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.158219.log.gz 2024-05-15T19:05:40.238 INFO:teuthology.orchestra.run.smithi077.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.388247.log.gz 2024-05-15T19:05:40.272 INFO:teuthology.orchestra.run.smithi077.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.373465.log.gz 2024-05-15T19:05:40.275 INFO:teuthology.orchestra.run.smithi077.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.202485.log.gz 2024-05-15T19:05:40.571 INFO:teuthology.orchestra.run.smithi077.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.431305.log.gz 2024-05-15T19:05:40.703 INFO:teuthology.orchestra.run.smithi077.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.205869.log.gz 2024-05-15T19:05:40.741 INFO:teuthology.orchestra.run.smithi083.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-15T19:05:40.765 INFO:teuthology.orchestra.run.smithi077.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.406039.log.gz 2024-05-15T19:05:40.893 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.418272.log.gz 2024-05-15T19:05:40.907 INFO:teuthology.orchestra.run.smithi077.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-15T19:05:40.909 INFO:teuthology.orchestra.run.smithi077.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.149512.log.gz 2024-05-15T19:05:40.916 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.352209.log.gz 2024-05-15T19:05:41.402 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.387741.log.gz 2024-05-15T19:05:41.606 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.482283.log.gz 2024-05-15T19:05:41.621 INFO:teuthology.orchestra.run.smithi077.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.273926.log.gz 2024-05-15T19:05:41.807 INFO:teuthology.orchestra.run.smithi077.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.258988.log.gz 2024-05-15T19:05:41.808 INFO:teuthology.orchestra.run.smithi077.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.437300.log.gz 2024-05-15T19:05:42.232 INFO:teuthology.orchestra.run.smithi077.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.404648.log.gz 2024-05-15T19:05:42.294 INFO:teuthology.orchestra.run.smithi077.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.504447.log.gz 2024-05-15T19:05:42.981 INFO:teuthology.orchestra.run.smithi077.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.418497.log.gz 2024-05-15T19:05:44.543 INFO:teuthology.orchestra.run.smithi077.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.418506.log.gz 2024-05-15T19:05:44.544 INFO:teuthology.orchestra.run.smithi077.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.403331.log.gz 2024-05-15T19:05:45.323 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.418175.log.gz 2024-05-15T19:05:47.798 INFO:teuthology.orchestra.run.smithi077.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.108137.log.gz 2024-05-15T19:05:48.540 INFO:teuthology.orchestra.run.smithi083.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-15T19:05:49.331 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% 94.2% -- replaced with /var/log/ceph/ceph-client.admin.424866.log.gz 2024-05-15T19:05:49.332 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.418126.log.gz 2024-05-15T19:05:49.332 INFO:teuthology.orchestra.run.smithi077.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.217686.log.gz 2024-05-15T19:05:51.206 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.110511.log.gz 2024-05-15T19:05:52.743 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.120487.log.gz 2024-05-15T19:05:55.806 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.413358.log.gz 2024-05-15T19:05:55.808 INFO:teuthology.orchestra.run.smithi077.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.405543.log.gz 2024-05-15T19:06:00.298 INFO:teuthology.orchestra.run.smithi083.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-15T19:06:01.389 INFO:teuthology.orchestra.run.smithi083.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-15T19:06:03.396 INFO:teuthology.orchestra.run.smithi077.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.257603.log.gz 2024-05-15T19:06:03.648 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.245390.log.gz 2024-05-15T19:06:03.871 INFO:teuthology.orchestra.run.smithi077.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-15T19:06:04.480 INFO:teuthology.orchestra.run.smithi077.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.222642.log.gz 2024-05-15T19:06:08.546 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.136723.log.gz 2024-05-15T19:06:08.555 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.135822.log.gz 2024-05-15T19:06:09.076 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.120008.log.gz 2024-05-15T19:06:11.159 INFO:teuthology.orchestra.run.smithi077.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.349965.log.gz 2024-05-15T19:06:11.740 INFO:teuthology.orchestra.run.smithi077.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.422697.log.gz 2024-05-15T19:06:11.895 INFO:teuthology.orchestra.run.smithi077.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.350486.log.gz 2024-05-15T19:06:14.470 INFO:teuthology.orchestra.run.smithi077.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.375655.log.gz 2024-05-15T19:06:14.742 INFO:teuthology.orchestra.run.smithi077.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.122982.log.gz 2024-05-15T19:06:15.326 INFO:teuthology.orchestra.run.smithi077.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.110078.log.gz 2024-05-15T19:06:15.650 INFO:teuthology.orchestra.run.smithi083.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-15T19:06:16.149 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.119529.log.gz 2024-05-15T19:06:17.096 INFO:teuthology.orchestra.run.smithi077.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.349527.log.gz 2024-05-15T19:06:17.365 INFO:teuthology.orchestra.run.smithi077.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.225470.log.gz 2024-05-15T19:06:17.536 INFO:teuthology.orchestra.run.smithi077.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.477169.log.gz 2024-05-15T19:06:18.027 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.142037.log.gz 2024-05-15T19:06:18.154 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.244942.log.gz 2024-05-15T19:06:18.329 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.137197.log.gz 2024-05-15T19:06:18.575 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.138093.log.gz 2024-05-15T19:06:20.978 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.114235.log.gz 2024-05-15T19:06:21.618 INFO:teuthology.orchestra.run.smithi077.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.537272.log.gz 2024-05-15T19:06:21.876 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.244464.log.gz 2024-05-15T19:06:23.093 INFO:teuthology.orchestra.run.smithi077.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.109641.log.gz 2024-05-15T19:06:24.371 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.536815.log.gz 2024-05-15T19:06:27.110 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.536358.log.gz 2024-05-15T19:06:27.284 INFO:teuthology.orchestra.run.smithi077.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.382655.log.gz 2024-05-15T19:06:28.735 INFO:teuthology.orchestra.run.smithi077.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.456188.log.gz 2024-05-15T19:06:29.041 INFO:teuthology.orchestra.run.smithi077.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.111464.log.gz 2024-05-15T19:06:31.080 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.535892.log.gz 2024-05-15T19:06:33.642 INFO:teuthology.orchestra.run.smithi077.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.275369.log.gz 2024-05-15T19:06:36.618 INFO:teuthology.orchestra.run.smithi077.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.558638.log.gz 2024-05-15T19:06:36.943 INFO:teuthology.orchestra.run.smithi077.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.221556.log.gz 2024-05-15T19:06:46.586 INFO:teuthology.orchestra.run.smithi077.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.241880.log.gz 2024-05-15T19:06:48.120 INFO:teuthology.orchestra.run.smithi077.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.115984.log.gz 2024-05-15T19:06:50.290 INFO:teuthology.orchestra.run.smithi077.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.412225.log.gz 2024-05-15T19:06:52.068 INFO:teuthology.orchestra.run.smithi077.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.414311.log.gz 2024-05-15T19:06:55.535 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.499946.log.gz 2024-05-15T19:07:15.671 INFO:teuthology.orchestra.run.smithi083.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-15T19:07:15.673 INFO:teuthology.orchestra.run.smithi083.stderr: 2024-05-15T19:07:15.673 INFO:teuthology.orchestra.run.smithi083.stderr:real 1m44.479s 2024-05-15T19:07:15.673 INFO:teuthology.orchestra.run.smithi083.stderr:user 2m25.481s 2024-05-15T19:07:15.673 INFO:teuthology.orchestra.run.smithi083.stderr:sys 0m6.329s 2024-05-15T19:07:23.533 INFO:teuthology.orchestra.run.smithi077.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.497771.log.gz 2024-05-15T19:07:24.611 INFO:teuthology.orchestra.run.smithi077.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.239425.log.gz 2024-05-15T19:08:10.983 INFO:teuthology.orchestra.run.smithi077.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.248153.log.gz 2024-05-15T19:08:22.492 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.113140.log.gz 2024-05-15T19:08:25.556 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.178700.log.gz 2024-05-15T19:08:49.416 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.145962.log.gz 2024-05-15T19:08:57.636 INFO:teuthology.orchestra.run.smithi077.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.126436.log.gz 2024-05-15T19:08:57.727 INFO:teuthology.orchestra.run.smithi077.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.367666.log.gz 2024-05-15T19:10:14.786 INFO:teuthology.orchestra.run.smithi077.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.179182.log.gz 2024-05-15T19:10:42.982 INFO:teuthology.orchestra.run.smithi077.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.222047.log.gz 2024-05-15T19:10:58.884 INFO:teuthology.orchestra.run.smithi077.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.385385.log.gz 2024-05-15T19:11:23.371 INFO:teuthology.orchestra.run.smithi077.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-15T19:11:43.960 INFO:teuthology.orchestra.run.smithi077.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.155471.log.gz 2024-05-15T19:12:51.167 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.141132.log.gz 2024-05-15T19:13:57.130 INFO:teuthology.orchestra.run.smithi077.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.188964.log.gz 2024-05-15T19:14:59.029 INFO:teuthology.orchestra.run.smithi077.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.108647.log.gz 2024-05-15T19:15:46.543 INFO:teuthology.orchestra.run.smithi077.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.159669.log.gz 2024-05-15T19:16:28.283 INFO:teuthology.orchestra.run.smithi077.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.415214.log.gz 2024-05-15T19:17:23.582 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.110974.log.gz 2024-05-15T19:19:08.432 INFO:teuthology.orchestra.run.smithi077.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.559096.log.gz 2024-05-15T19:21:46.810 INFO:teuthology.orchestra.run.smithi077.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.258056.log.gz 2024-05-15T19:22:10.328 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-15T19:23:05.923 INFO:teuthology.orchestra.run.smithi077.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.392158.log.gz 2024-05-15T19:23:28.802 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.520850.log.gz 2024-05-15T19:23:33.594 INFO:teuthology.orchestra.run.smithi077.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-15T19:25:02.984 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.111940.log.gz 2024-05-15T19:25:26.525 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.109149.log.gz 2024-05-15T19:30:06.432 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.509066.log.gz 2024-05-15T19:30:12.723 INFO:teuthology.orchestra.run.smithi077.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.236708.log.gz 2024-05-15T19:31:01.749 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.510458.log.gz 2024-05-15T19:31:45.804 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.511981.log.gz 2024-05-15T19:32:01.297 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.505782.log.gz 2024-05-15T19:32:18.131 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.507470.log.gz 2024-05-15T19:33:00.057 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.515067.log.gz 2024-05-15T19:33:17.886 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.513578.log.gz 2024-05-15T19:33:24.653 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.517977.log.gz 2024-05-15T19:33:29.484 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.516553.log.gz 2024-05-15T19:33:48.733 INFO:teuthology.orchestra.run.smithi077.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.519441.log.gz 2024-05-15T19:39:54.857 INFO:teuthology.orchestra.run.smithi077.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.185973.log.gz 2024-05-15T19:39:57.419 INFO:teuthology.orchestra.run.smithi077.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.448188.log.gz 2024-05-15T19:40:38.572 INFO:teuthology.orchestra.run.smithi077.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.278381.log.gz 2024-05-15T19:49:35.356 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-15T19:52:28.809 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.440084.log.gz 2024-05-15T19:53:02.125 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.438151.log.gz 2024-05-15T19:58:28.483 INFO:teuthology.orchestra.run.smithi077.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.268435.log.gz 2024-05-15T19:59:54.951 INFO:teuthology.orchestra.run.smithi077.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-15T20:02:39.223 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-15T20:03:51.082 INFO:teuthology.orchestra.run.smithi077.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.152184.log.gz 2024-05-15T20:05:16.607 INFO:teuthology.orchestra.run.smithi077.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-15T21:04:48.049 INFO:teuthology.orchestra.run.smithi077.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.561398.log.gz 2024-05-15T21:10:25.480 INFO:teuthology.orchestra.run.smithi077.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.142928.log.gz 2024-05-15T21:11:15.956 INFO:teuthology.orchestra.run.smithi077.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.531766.log.gz 2024-05-15T21:11:15.959 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-05-15T21:11:15.960 INFO:teuthology.orchestra.run.smithi077.stderr:real 125m44.790s 2024-05-15T21:11:15.960 INFO:teuthology.orchestra.run.smithi077.stderr:user 62m44.087s 2024-05-15T21:11:15.960 INFO:teuthology.orchestra.run.smithi077.stderr:sys 2m56.465s 2024-05-15T21:11:15.961 INFO:tasks.ceph:Archiving logs... 2024-05-15T21:11:15.963 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/remote/smithi077/log 2024-05-15T21:11:15.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T21:22:30.244 DEBUG:teuthology.misc:Transferring archived files from smithi083:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/remote/smithi083/log 2024-05-15T21:22:30.274 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-15T21:25:37.722 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-15T21:25:37.733 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-15T21:25:37.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T21:25:37.739 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-15T21:25:37.970 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-15T21:25:37.979 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-15T21:25:37.980 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T21:25:37.983 DEBUG:teuthology.orchestra.run.smithi083:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-15T21:25:38.001 INFO:teuthology.orchestra.run.smithi083.stderr:bash: line 1: ntpq: command not found 2024-05-15T21:25:38.012 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-05-15T21:25:38.023 INFO:teuthology.orchestra.run.smithi083.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T21:25:38.023 INFO:teuthology.orchestra.run.smithi083.stdout:=============================================================================== 2024-05-15T21:25:38.024 INFO:teuthology.orchestra.run.smithi083.stdout:^* hv01.front.sepia.ceph.com 3 9 377 412 +588us[ +564us] +/- 61ms 2024-05-15T21:25:38.024 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 26 +351us[ +351us] +/- 64ms 2024-05-15T21:25:38.024 INFO:teuthology.orchestra.run.smithi083.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 209 -1804us[-1804us] +/- 67ms 2024-05-15T21:25:38.024 INFO:teuthology.orchestra.run.smithi083.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T21:25:38.047 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-15T21:25:38.048 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-05-15T21:25:38.048 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 7 377 29 +751us[ +765us] +/- 67ms 2024-05-15T21:25:38.048 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 42 +545us[ +559us] +/- 64ms 2024-05-15T21:25:38.048 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 39 -1622us[-1607us] +/- 69ms 2024-05-15T21:25:38.048 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-15T21:25:38.050 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-15T21:25:38.059 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-15T21:25:38.059 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-15T21:25:38.069 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T21:25:38.444 DEBUG:teuthology.orchestra.run.smithi083:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-15T21:25:38.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T21:25:38.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T21:25:38.626 DEBUG:teuthology.orchestra.run.smithi083:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-15T21:25:38.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T21:25:38.657 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-15T21:25:38.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-15T21:25:38.684 INFO:teuthology.task.internal:Duration was 33783.608051 seconds 2024-05-15T21:25:38.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-15T21:25:38.693 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-15T21:25:38.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T21:25:38.698 DEBUG:teuthology.orchestra.run.smithi083:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-15T21:25:38.757 INFO:teuthology.orchestra.run.smithi083.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T21:25:38.841 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-15T21:25:39.187 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-15T21:25:39.188 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-05-15T21:25:39.188 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T21:25:39.237 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi083.front.sepia.ceph.com 2024-05-15T21:25:39.238 DEBUG:teuthology.orchestra.run.smithi083:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-15T21:25:39.273 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-15T21:25:39.274 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T21:25:39.277 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-15T21:25:39.343 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-15T21:25:39.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T21:25:39.347 DEBUG:teuthology.orchestra.run.smithi083:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-15T21:25:39.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-15T21:25:39.808 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-15T21:25:39.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T21:25:39.851 DEBUG:teuthology.orchestra.run.smithi083:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-15T21:25:39.879 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-15T21:25:39.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T21:25:39.897 DEBUG:teuthology.orchestra.run.smithi083:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-15T21:25:39.954 INFO:teuthology.orchestra.run.smithi083.stdout:kernel.core_pattern = core 2024-05-15T21:25:39.973 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-05-15T21:25:40.020 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T21:25:40.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T21:25:40.054 DEBUG:teuthology.orchestra.run.smithi083:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-15T21:25:40.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T21:25:40.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-15T21:25:40.080 INFO:teuthology.task.internal:Transferring archived files... 2024-05-15T21:25:40.081 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/remote/smithi077 2024-05-15T21:25:40.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T21:25:40.162 DEBUG:teuthology.misc:Transferring archived files from smithi083:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992/remote/smithi083 2024-05-15T21:25:40.162 DEBUG:teuthology.orchestra.run.smithi083:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-15T21:25:40.198 INFO:teuthology.task.internal:Removing archive directory... 2024-05-15T21:25:40.198 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T21:25:40.202 DEBUG:teuthology.orchestra.run.smithi083:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-15T21:25:40.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-15T21:25:40.259 INFO:teuthology.task.internal:Not uploading archives. 2024-05-15T21:25:40.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-15T21:25:40.269 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-15T21:25:40.269 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T21:25:40.275 DEBUG:teuthology.orchestra.run.smithi083:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-15T21:25:40.303 INFO:teuthology.orchestra.run.smithi083.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 15 21:25 /home/ubuntu/cephtest 2024-05-15T21:25:40.304 INFO:teuthology.orchestra.run.smithi077.stdout: 265468 4 drwxr-xr-x 3 ubuntu ubuntu 4096 May 15 21:25 /home/ubuntu/cephtest 2024-05-15T21:25:40.304 INFO:teuthology.orchestra.run.smithi077.stdout: 406127 4 d--------- 2 ubuntu ubuntu 4096 May 15 12:10 /home/ubuntu/cephtest/mnt.0 2024-05-15T21:25:40.304 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-05-15T21:25:40.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-15T21:25:40.305 INFO:teuthology.orchestra.run.smithi077.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-05-15T21:25:40.306 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi077 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-15T21:25:40.317 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-15T21:25:40.328 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-15T21:25:40.340 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi077 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-05-15T21:25:40.340 INFO:teuthology.nuke:Checking targets against current locks 2024-05-15T21:25:40.371 DEBUG:teuthology.nuke:shortname: smithi077 2024-05-15T21:25:40.372 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T21:25:40.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 11:54:00.412252', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBET1uHmh3L1CxDQtkWV7J4GKRHZfra2AJVv3EStswvyv4KlEyWeCPNN/jYGkyms8+xg0apcb69x8CqYYtvRBMes='} 2024-05-15T21:25:40.402 DEBUG:teuthology.nuke:shortname: smithi083 2024-05-15T21:25:40.402 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-15T21:25:40.425 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi083.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-15_11:41:37-fs-wip-lusov-quiesce-distro-default-smithi/7706992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-15 11:54:00.410838', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxS/v0ZUCE+U5ZcfaMmdavL5WrSvFZLQzNkRfhFpxVTHPxEOD72uINkJ9Om6u24iH9nuMM/HBvCQLiLN1RGTkU='} 2024-05-15T21:25:40.447 INFO:teuthology.orchestra.console.smithi077:Power off 2024-05-15T21:25:40.448 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T21:25:40.472 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2024-05-15T21:25:40.472 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:40.488 INFO:teuthology.orchestra.console.smithi083:Power off 2024-05-15T21:25:40.489 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-15T21:25:40.499 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-05-15T21:25:40.514 DEBUG:teuthology.orchestra.console.smithi083:power off output: Chassis Power Control: Down/Off 2024-05-15T21:25:40.514 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:40.540 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-05-15T21:25:44.500 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:44.542 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:44.614 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-05-15T21:25:44.653 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-05-15T21:25:48.617 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:48.655 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:48.727 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2024-05-15T21:25:48.766 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is on 2024-05-15T21:25:52.729 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:52.767 DEBUG:teuthology.orchestra.console.smithi083:pexpect command: ipmitool -H smithi083.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-15T21:25:52.840 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2024-05-15T21:25:52.879 DEBUG:teuthology.orchestra.console.smithi083:check power output: Chassis Power is off 2024-05-15T21:25:52.942 INFO:teuthology.orchestra.console.smithi077:Power off completed 2024-05-15T21:25:52.981 INFO:teuthology.orchestra.console.smithi083:Power off completed 2024-05-15T21:25:53.087 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} duration: 33783.60805058479 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1d880c1fff044e3b88b2b47f524c6881 status: fail success: false 2024-05-15T21:25:53.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-15T21:25:53.165 INFO:teuthology.run:FAIL